Skip to main content
Filter by
Sorted by
Tagged with
0 votes
0 answers
17 views

How to store a lot of small text files with fast access?

I need to store a lot of small text files (~3 billions and it grows by 70m every day) with size from 100B to a few kB. I can group them, but group will have unpredictable number of items: from 1 to ...
Roman N's user avatar
  • 5,030
-1 votes
0 answers
9 views

Hbase regionserver wal.AbstractFSWAL: Slow sync cost:111 ms, current pipeline to datanode

hadoop-3.2.2 hbase-2.5.0 When hbase write hfile to hdfs, regionserver show message [AsyncFSWAL-0-hdfs://bigdatacluster/hbase] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [...
ZhaoWen Guo's user avatar
0 votes
0 answers
65 views

RowTooBigException when using allowPartialResults

I'm getting: Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException: org.apache.hadoop.hbase.regionserver.RowTooBigException: Max row size allowed: 1073741824, but the row is bigger than ...
Fogo's user avatar
  • 1
1 vote
0 answers
25 views

Null Pointer Exception while reading Hbase Dataframe

**When I load an Hbase table I get this exception: ** java.lang.NullPointerException at org.apache.hadoop.hbase.spark.HBaseRelation.<init>(DefaultSource.scala:138) at org.apache.hadoop....
pgb314's user avatar
  • 13
0 votes
1 answer
27 views

Problems running "import-hbase.sh" file for metadata ingestion from hbase

I am running a Docker stack with the following containers: atlas (Apache Atlas) storm cassandra nimbus kafka hbase zookeeper Apache Atlas service is running and I have access to the user interface ...
datagov's user avatar
0 votes
0 answers
17 views

Issues with ImportTsv - Job Fails with Exit Code 1

I am currently facing an issue while using the ImportTsv command to load data into an HBase table. I am running the command and the job is failing with a non-zero exit code 1. Hadoop version : 3.4.0 ...
Amandi Ekanayake's user avatar
0 votes
0 answers
7 views

Spark Hbase Phoenix(SHC) connector result wrong value for Date field

I am new to the SHC connector. I am trying to decode values stores in Hbase via Phoenix SQL using Spark. Below is my Phoenix table syntax: CREATE TABLE SOME_NAMESPACE.some_sample_table( col1 VARCHAR ...
Nishant Aggarwal's user avatar
0 votes
1 answer
74 views

Issue with `hbase:meta` region not online

The hbase master is not initialized the logs shows: 2024-08-06 13:53:49,324 INFO [ProcExecTimeout] assignment.AssignmentManager: Found 0 OPEN regions on dead servers and 240 OPEN regions on unknown ...
Omkar Kumbhar's user avatar
0 votes
0 answers
27 views

Spark 3.5 and Hbase Connector

I am trying to compile the Hbase Spark connector for Spark 3.5 but I am getting below errors. (It works for Spark 3.1) Is there any other way to connect Hbase via Spark 3.5 ? Main Repo; https://github....
BrsAtmn's user avatar
0 votes
0 answers
18 views

Decoding Apache Phoenix Table Column Name using HBase API

I am working on a UseCase where in I need to read the data created from Phoenix table using Hbase API. However while reading the data from Hbase API I am getting data in encoded form. All the columns ...
Nishant Aggarwal's user avatar
0 votes
1 answer
30 views

Upgrading hadoop to 3.1.2 with hbase-testing-utility 2.2.3

The goal I want to switch from the HDFS to the s3a client. To this end I need to upgrade from Hadoop 2.8.5 to at least 3.1.2, because I need to use the AssumedRoleCredentialProvider for AWS access. ...
Milo's user avatar
  • 35
0 votes
0 answers
10 views

Usage of HBase Seeking in Keys

What is the Correct Usage of HBase Seeking in rowKey and columnKey while applying Filters in hbase and would like to now about seeking
dev_coders's user avatar
0 votes
0 answers
15 views

Hbase 2.0.0 with Hadooop 2.6.5 : Hbase shell Unhandled Java exception: java.lang.IncompatibleClassChangeError:java.lang.IncompatibleClassChangeError:

I am running Hadoop 2.6.5 with hbase 2.0.0 . When I try to log into hbase with $hbase shell , i get the following below I tried Hbase 2.5.8 with hadoop 2.6.5 same issue . I tired Hbase 1.3.1 with ...
user3884278's user avatar
0 votes
0 answers
45 views

Is there a way to access HBase with Thrift and Kerberos in Rust?

I successfully implemented a Rust sample app that accesses an HBase server without authentication using the hbase-thrift crate. Now, I need to access HBase with Kerberos authentication. Since the ...
jsoh's user avatar
  • 1
0 votes
0 answers
32 views

Fetch HBase key info (rowkey, colum family, qualifier) without values

Im trying to remove all columns that start with some prefix from all rows, its taking a really long and Im trying to optimize it by not fetching the values since they can be heavy. e.g., if I have a ...
Fogo's user avatar
  • 1

15 30 50 per page
1
2 3 4 5
464