Questions tagged [hbase]

HBase is the Hadoop database (columnar). Use it when you need random, real time read/write access to your Big Data. This project's goal is the hosting of very large tables -- billions of rows X millions of columns -- atop clusters of commodity hardware.

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

.format("org.apache.phoenix.spark") vs .format("jdbc")

I wonder what is the difference of using .format("org.apache.phoenix.spark") vs .format("jdbc") when loading HBase table (through Phoenix) to spark dataframe. val tracesDF = spark....
Mahadi Siregar's user avatar
0 votes
0 answers
14 views

How to deploy Hbase with zookeeper (standalone Hbase) on kubernetes?

I want a single-node deployment of hbase on my local kubernetes cluster. I have a micro-service running on kubernetes, which I want to connect with hbase. What should be the configurations and the ...
Rishabh's user avatar
  • 11
0 votes
0 answers
6 views

Running HBaseTestingUtil in non-test code fail with ClassNotFoundException: org.junit.Assert

We have a non-standard setup where we run our application with an HBaseTestingUtil during our integration tests, but we bring up the mini cluster in non-test code. <dependency> <groupId&...
DevF's user avatar
  • 11
0 votes
0 answers
23 views

ERROR util.ResourceLeakDetector: LEAK: ByteBuf.release() Connection.getTable().put(List)

I am trying to do a lot of PUTs in Hbase, however, after some time of operation, a memory leak occurs due to the following error: ERROR util.ResourceLeakDetector: LEAK: ByteBuf.release() was not ...
Fabrissou's user avatar
0 votes
0 answers
13 views

hbase 2.5.6 Windows 10 Errors

C:\hbase-2.5.6\bin>start-hbase.cmd Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/LoggerFactoryat org.apache.hadoop.conf.Configuration.<clinit>(Configuration....
Abdelruhman Tamer's user avatar
0 votes
0 answers
5 views

hbase cannot convert instance of class org.jruby.RubyString to long

HBase 1.0.0 hbase shell hbase(main):046:0> get 'test', 'rk0001', {COLUMN => 'name', TIMESTAMP => '1700203128386'} It will occurred an unknown error like below: `COLUMN ...
Find Bugs's user avatar
  • 125
-1 votes
0 answers
18 views

Increase Hbase timeout by rest api parameter

I have queries that are exceeding the default timeout while fetching a table in hbase rest api Currently i can't change the hbase-site.xml file to increase the timeouts on all queries, and so i've ...
maayan ben tsur's user avatar
0 votes
0 answers
13 views

How to get kerberos authentication on spark's executor

For some reason, I need to build a connection to access hbase in a mapPartition. hbase/hadoop both have kerberos enabled. the Spark application is also running under kerberos. The hbase connection is ...
Smokeriu's user avatar
  • 169
0 votes
0 answers
10 views

HBase is not launching zookeeper on 1 node out of 3

I'm trying to set up HBase on a small cluster as a learning exercise. The machines are 17, 47 and 50. 47 is supposed to be the master, with 17 as a backup master and 17 and 50 as region servers. They ...
Pascal's user avatar
  • 259
0 votes
0 answers
8 views

Return just the rowKeys - no other qualifer/value

scan 'TaxWashSales', {ROWPREFIXFILTER=>'999_524723_3_20230929_', FILTER=> "FirstKeyOnlyFilter() AND KeyOnlyFilter()"} ROW ...
Sanjeev Dhiman's user avatar
0 votes
0 answers
10 views

HBase - deleteAll with rowPrefix - how to do in Java?

On Hbase shell - deleteall 'table', {rowPrefixFilter=> '100_x_'} How to do it in Java? Is below the right way? scan.setRowPrefixFilter('100_x_'); scan.addFilter(new KeyOnlyFilter());``` // now go ...
Sanjeev Dhiman's user avatar
0 votes
0 answers
20 views

How to reduce network round trip between hbase hadoop and application server

we have an spring boot application which is connecting to hbase using phoneix framework. This app is deployed in private cloud and hbase db is in different geographical location. There was a network ...
user2720251's user avatar
0 votes
0 answers
20 views

Detect HBase cluster health

I have 2 HBase clusters and I want to read from a cluster which is healthy. (anyone if both are healthy) I am currently on HBase version: 2.2.3.7.1.7 Is there any API that I can hit and find the ...
Vishwanath's user avatar
0 votes
0 answers
21 views

Issue in integration of Apache Atlas with Kerberized HBase and Solr

I am facing and issue related to the integration of Apache Atlas with Solr and HBase. I have encountered an "Error 401 Authentication required" error when attempting to update the vertex ...
arjun s's user avatar
  • 11
0 votes
0 answers
21 views

Breakpoint not working for TableMapper class

I am trying to debug the map function of a hbase mapreducer job in Intellij. The hadoop and hbase environment is setup in my local. We have written a class TMapper that extends from org.apache.hadoop....
Soumabha Sarkar's user avatar
0 votes
0 answers
16 views

Atlas Integration with kerberized Hbase and solr

I successfully configured Apache Atlas of version 2.3.0 with my HBase and Solr instances, and everything was functioning smoothly. Subsequently, I implemented Kerberos security for both HBase and Solr,...
arjun s's user avatar
  • 11
0 votes
1 answer
69 views

Write in Hbase with Spark 2.3 and assign timestamp

I am writing in Hbase using HBase-Spark connector, but I want to assign a Timestamp to each row based in a column in the DS. It is possible to do such thing? Here is an example of what I a want to do ...
jmjO's user avatar
  • 1
0 votes
1 answer
43 views

Catching a Dependency Issue in an Apache HBase Project in Java

While I am diving today in the source code of apache hbase project, I encountered some difficulties to follow up with a dependency to access its source code: HBase Unsafe, which is mentioned in the ...
Akram BEN GHANEM's user avatar
1 vote
0 answers
44 views

How can i read data with column names which exported from hbase to hdfs?

I use hbase export tool to put hbase data to hdfs : hbase org.apache.hadoop.hbase.mapreduce.Export \ <tablename> <outputdir> And i see data on my hdfs when i want to read that data ...
CompEng's user avatar
  • 7,201
0 votes
0 answers
11 views

About pinpoint apm installation Why don't start-collector.cmd, start-testapp.cmd, start-web.cmd files exist

I cloned a folder in github, installed hbase, and ran the cmd file as it was in the official document. And I put the jar file in the location. Why do I get an error saying that I couldn't connect with ...
양명덩어리's user avatar
0 votes
0 answers
20 views

Hbase service not starting: Failed construction RegionServer

I am trying to start hbase service using start-hbase.sh in my Centos machine due to which Kylin is not reflecting any project and cubes. Here is my error log: 2023-09-11 17:34:59,457 ERROR [main] ...
Neeraj Mehta's user avatar
  • 1,695
0 votes
0 answers
68 views

Exception from container-launch. Container exited with a non-zero exit code 1

when I tranfer the data from hdfs to hbase by using this commands : hadoopusr@DESKTOP-1CFP2U7:~/hbase$ bin/hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.separator=',' -Dimporttsv....
Abhishek Gole's user avatar
0 votes
1 answer
30 views

How do we rename or copy the existing Hbase table in MapR without snapshot?

I am trying to rename existing HBase table but MapR is not supporting any of the existing solutions that I googled. Example export, snapshot etc. Can someone please post the correct steps to rename ...
swathi's user avatar
  • 31
0 votes
2 answers
120 views

Is each column in Google Big Table indexed by index key?

From the google cloud documentation, I see: Each table has only one index, the row key However, I see someone mentioned (I can not find the source anymore) big table has index for every column. The ...
ZZZ's user avatar
  • 3,584
0 votes
0 answers
25 views

Parse json string to search for a particular key from Phoenix table

I am trying to access a table created through Phoenix from Hbase. The value for a REQUEST column is JSON string and I want to write a phoenix query to search for a particular key e.g. "merchant&...
Santhoshhadoop's user avatar
0 votes
0 answers
16 views

HBase scan based on time range. Does it scan all regions and all rows for the table or does it uses timestamp indexing to filter out rows?

Use Case I want to perform hourly roll up on my 1 year data. For that, I will be running scans for hourly data like below scan 't1', {COLUMNS => 'c1', TIMERANGE => [1692748800000, 1692752400000]}...
Nitish Goyal's user avatar
0 votes
0 answers
15 views

Wildcard in subqueries not supported Apache Phoenix SQL

I am new to Phoenix SQL / using Hbase database. Currently, I am experiencing an error in my nested subquery. Here is my query: SELECT DISTINCT res.zipfile, res.recordtimestamp, ...
Alexander Prasetyo Christianto's user avatar
0 votes
0 answers
35 views

Hmaster not starting Hadoop 3.3.5 / hbase 2.4.17

Installed hadoop 3.3.5. On Single node server. File hbase-site.xml contains <configuration> <property> <name>hbase.master.namespace.init.timeout</name> <...
user2986469's user avatar
0 votes
0 answers
14 views

Insert data into HBASE on AWS EMR via pentaho 5

We have pentaho (version5) jobs (ktr files) which generate some data and inserts into DB2 tables. Now as part of migration we need to insert the data to HBASE on EMR. There are 2 ways that comes to my ...
Ab_sin's user avatar
  • 121
0 votes
2 answers
40 views

Selecting suitable database for analytics data

We need to create enterprise product and need to select the storage option for analytics data, initially data will be in tb's(10-40tb) but in coming years could go up to few PB's. Requirements: high ...
Explore Mayank's user avatar
0 votes
0 answers
29 views

Getting Errors while starting hbase service

I installed hbase-2.4.17 hbase-2.4.17-bin.tar.gz (standalone),when i start the hbase instance getting errors ./start-hbase.sh ERROR: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.372.b07-1.el7_9.x86_64/bin/...
sravani's user avatar
0 votes
1 answer
23 views

How to open an application or a program in Python?

To read the codes of a program in Python or how to access the codes of an application I want to look at the code inside the program, but I don't know how to access it in Python. Is there a library ...
Idi's user avatar
  • 1
0 votes
0 answers
39 views

EMR HBASE - "java.io.FileNotFoundException: File does not exist" seen using Scan from read replica. Scan from replica-0 is successful

I am using single 20-node EMR HBASE (HDFS) cluster. I have created a table with region replication enabled (REGION_REPLICATION=>'3') and column family (REPLICATION_SCOPE=>'1'). There are about a ...
Adivandhya Br's user avatar
0 votes
0 answers
154 views

Hbase too many items queued

I use the async client of hbase in java. I execute the get method (CompletableFuture<Result> get(Get get);) about 10000 times in a loop. Then I got the message: org.apache.hadoop.hbase....
sr ao's user avatar
  • 23
0 votes
0 answers
62 views

java.lang.IllegalStateException: Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. Classpath is not sane

We use HBase Java client to read and write data to HBase service running in GCP Dataproc cluster. Recently we update Java version, HBase client version and Spring boot version. Java runtime version ...
Nuwan Sameera's user avatar
0 votes
1 answer
43 views

Analytic query( like count query ) is causing performance issue in Apache Phoenix

We have Hadoop cluster contains Phoenix table over HBase service and supporting 10k QPS. While running analytic query in the same table like count, group by for some operational purpose it's causing ...
Ajay's user avatar
  • 47
0 votes
0 answers
54 views

Writing to HBase using Pyspark too slow - row by row?

I want to write a dataframe using Pyspark into HBase, so I am using the below code: properties = { "hbase.zookeeper.quorum": "my_quorum", "hbase.zookeeper....
ChackM's user avatar
  • 9
1 vote
0 answers
23 views

HBase HBaseAdmin.getCompactionState produces NPE

I use the java HBase 2.5.3 client to compact the table and wait for compaction to be done: public static void compactTable(Admin admin, byte[] tableName) throws IOException, InterruptedException { ...
Egor's user avatar
  • 1,334
0 votes
1 answer
37 views

GCP Bigtable : Availability within a zone

Background I am planning to use GCP's Bigtable (BT) offering for one of my projects. This is a NOT_SO_CRITICAL use-case, hence i am exploring a single cluster setup (COST factor). Question What are ...
Harshit's user avatar
  • 1,174
0 votes
0 answers
12 views

Apache Phoenix Hbase analytical query performance issue

When I am executing analytical query( eg count(field1) group by field1), it's causing some of the already running oltp query to fail due to timeout. Is there any way to tune this.
Rahul's user avatar
  • 459
0 votes
1 answer
82 views

Hbase API migration from onprem to Bigtable GCP

There are multiple application which is using Hbase data in on-prem. Now we are planning to migrate the Hbase data to GCP Bigtable. Post migration of this Hbase to Bigtable. The multiple applications ...
Amit Rai's user avatar
0 votes
0 answers
11 views

Creating the index over a non pk column in phoenix-sqlline

I am using phoenix-sqlline over hbase tables. I have multiple tables out of which one is a metadata table. The primary key of the metadata table is used in all other tables to fetch the metadata. The ...
user1097482's user avatar
0 votes
1 answer
32 views

SparkException cause by java.lang.NoClassDefFoundError: org/apache/htrace/core/HTraceConfiguration

It seems no class HTraceConfiguration found in jar package. But, I do found this class in jar package. jar ftv app.jar | grep HTraceConfiguration 2814 Tue Jul 10 17:26:52 CST 2018 org/apache/hadoop/...
pain's user avatar
  • 319
0 votes
0 answers
54 views

ConcurrentHasnMap has duplicate key when size are big

I have 975,641 rows of pure string data as rowkeys for HBase, where the lengths of the strings vary. After using distinct in MySQL to remove duplicates, there are 884,508 unique data entries. When I ...
william's user avatar
  • 285
1 vote
1 answer
58 views

g++: error: /usr/lib/libboost_unit_test_framework.a: No such file or directory

I am stuck in compiling Thrift. I passed the ./Configure --host=arm process but was stuck in compiling with the Command "make". I have no idea how to solve that. I went into the Makefile to ...
Ronald Yin's user avatar
0 votes
0 answers
18 views

Java API connect Apache Phoenix failed,ERROR 2006 (INT08)

enter image description here enter image description here My Hadoop is 3.1.3,HBase is 2.0.5,Phoenix is 5.0.0 When i am running Java API code to connect Apache Phoenix in test,output the problem: ...
defcharlielin's user avatar
0 votes
1 answer
36 views

How to find all the options when read/write with Spark for a specific format?

Is there any way to find all the options when reading/writing with Spark for a specific format? I think they must be in the source code somewhere but I can't find it. Below is my code to use spark to ...
Hoang Minh Quang FX15045's user avatar
0 votes
0 answers
15 views

HBase region split didn't happen when it exceeds the size

The HBase region split is not happening when the existing region storefile size reached its configured size. In my case, the configured size is 10 GB but it is not split even when the size grows ...
Mohan's user avatar
  • 91
0 votes
0 answers
35 views

What is different between Bucket cache accesses/hits and cachingAccesses/cachingHits stat?

Below is the Hbase L2 Block cache stats. Can someone explain the difference between accesses/hits and cachingAccesses/cachingHits? I can't find documentation for the block cache stats. It would be ...
R H's user avatar
  • 387
1 vote
0 answers
91 views

MIniHBaseCluster shutting down with java.lang.RuntimeException: Master not initialized after 200000ms

To give a background, our project uses bigtable. For unit testing, we are using the package hbase-testing-util:2.2.3 for creating a local mini hbase cluster. Our code base is in Java 8 and I'm trying ...
ASG's user avatar
  • 11

1
2 3 4 5
140