6,948
questions
0
votes
0
answers
17
views
How to store a lot of small text files with fast access?
I need to store a lot of small text files (~3 billions and it grows by 70m every day) with size from 100B to a few kB. I can group them, but group will have unpredictable number of items: from 1 to ...
-1
votes
0
answers
9
views
Hbase regionserver wal.AbstractFSWAL: Slow sync cost:111 ms, current pipeline to datanode
hadoop-3.2.2
hbase-2.5.0
When hbase write hfile to hdfs, regionserver show message
[AsyncFSWAL-0-hdfs://bigdatacluster/hbase] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [...
0
votes
0
answers
65
views
RowTooBigException when using allowPartialResults
I'm getting:
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException:
org.apache.hadoop.hbase.regionserver.RowTooBigException: Max row size
allowed: 1073741824, but the row is bigger than ...
1
vote
0
answers
25
views
Null Pointer Exception while reading Hbase Dataframe
**When I load an Hbase table I get this exception: **
java.lang.NullPointerException
at org.apache.hadoop.hbase.spark.HBaseRelation.<init>(DefaultSource.scala:138)
at org.apache.hadoop....
0
votes
1
answer
27
views
Problems running "import-hbase.sh" file for metadata ingestion from hbase
I am running a Docker stack with the following containers:
atlas (Apache Atlas)
storm
cassandra
nimbus
kafka
hbase
zookeeper
Apache Atlas service is running and I have access to the user interface ...
0
votes
0
answers
17
views
Issues with ImportTsv - Job Fails with Exit Code 1
I am currently facing an issue while using the ImportTsv command to load data into an HBase table. I am running the command and the job is failing with a non-zero exit code 1.
Hadoop version : 3.4.0
...
0
votes
0
answers
7
views
Spark Hbase Phoenix(SHC) connector result wrong value for Date field
I am new to the SHC connector.
I am trying to decode values stores in Hbase via Phoenix SQL using Spark.
Below is my Phoenix table syntax:
CREATE TABLE SOME_NAMESPACE.some_sample_table(
col1 VARCHAR ...
0
votes
1
answer
74
views
Issue with `hbase:meta` region not online
The hbase master is not initialized the logs shows:
2024-08-06 13:53:49,324 INFO [ProcExecTimeout] assignment.AssignmentManager: Found 0 OPEN regions on dead servers and 240 OPEN regions on unknown ...
0
votes
0
answers
27
views
Spark 3.5 and Hbase Connector
I am trying to compile the Hbase Spark connector for Spark 3.5 but I am getting below errors. (It works for Spark 3.1)
Is there any other way to connect Hbase via Spark 3.5 ?
Main Repo;
https://github....
0
votes
0
answers
18
views
Decoding Apache Phoenix Table Column Name using HBase API
I am working on a UseCase where in I need to read the data created from Phoenix table using Hbase API. However while reading the data from Hbase API I am getting data in encoded form.
All the columns ...
0
votes
1
answer
30
views
Upgrading hadoop to 3.1.2 with hbase-testing-utility 2.2.3
The goal
I want to switch from the HDFS to the s3a client. To this end I need to upgrade from Hadoop 2.8.5 to at least 3.1.2, because I need to use the AssumedRoleCredentialProvider for AWS access. ...
0
votes
0
answers
10
views
Usage of HBase Seeking in Keys
What is the Correct Usage of HBase Seeking in rowKey and columnKey while applying Filters in hbase and would like to now about seeking
0
votes
0
answers
15
views
Hbase 2.0.0 with Hadooop 2.6.5 : Hbase shell Unhandled Java exception: java.lang.IncompatibleClassChangeError:java.lang.IncompatibleClassChangeError:
I am running Hadoop 2.6.5 with hbase 2.0.0 .
When I try to log into hbase with $hbase shell , i get the following below
I tried Hbase 2.5.8 with hadoop 2.6.5 same issue .
I tired Hbase 1.3.1 with ...
0
votes
0
answers
45
views
Is there a way to access HBase with Thrift and Kerberos in Rust?
I successfully implemented a Rust sample app that accesses an HBase server without authentication using the hbase-thrift crate. Now, I need to access HBase with Kerberos authentication. Since the ...
0
votes
0
answers
32
views
Fetch HBase key info (rowkey, colum family, qualifier) without values
Im trying to remove all columns that start with some prefix from all rows, its taking a really long and Im trying to optimize it by not fetching the values since they can be heavy.
e.g., if I have a ...