Questions tagged [apache-phoenix]
The apache-phoenix tag has no usage guidance.
694
questions
0
votes
1
answer
31
views
SQL CASE WHEN Logic does not work for comparison to NOW() date
I am using Apache Phoenix Query Server. I need to manipulate the payment_status column so that it follows the logic below and be corrected.
However, I noticed that even when paid_date is equal to ...
0
votes
1
answer
22
views
Wrong index data after importing Phoenix/HBASE table (by snapshot )
I need to migrate Phoenix/HBase tables from a very-old cluster to new one.
Origin cluster versions
HDP-2.5.3.0
HBASE 1.1.2 (HDP-2.5.3.0-37)
Phoenix 4.7.0 (HDP-2.5.3.0-37)
Ubuntu 12.04
Target cluster ...
1
vote
0
answers
32
views
hbase, phoenix - upserting 'value' to existing null column doesn't works on some records
I'm facing with a very weird behaviour with an UPSERT instruction: the operation doesn't have effect on columns that was previously stored with null value;
for example, if we have 'tab1'
create table ...
0
votes
0
answers
58
views
"Data source org.apache.phoenix.spark does not support streamed writing" in Structured Streaming
**I'm trying to connect to the Phoenix driver using Spark Structured Streaming and I'm getting the following exception when I'm trying to load the HBase table data via the Phoenix driver...please help ...
0
votes
0
answers
143
views
GraphQL notification in flutter - how to catch result?
I subscribe to a graphql document:
// Dart imports:
import 'dart:async';
// Package imports:
import 'package:graphql_flutter/graphql_flutter.dart';
import 'package:phoenix_socket/phoenix_socket.dart';...
1
vote
0
answers
101
views
PhoenixNonRetryableRuntimeException: Could not load/instantiate class org.apache.phoenix.query.DefaultGuidePostsCacheFactory (from database clients))
I am trying to use various database clients (Squirrel 4.1.0, DBVisualizer Free 12.1.1) to connect to an HBase database, but I get an error:
PhoenixNonRetryableRuntimeException: Could not load/...
1
vote
0
answers
173
views
Phoenix Library not working with Android 12
I am devloping one app which will restart after phone reboot for that I used Phoenix Third party library it is working upto Android pie version but for higher version it is not working.
Below is a ...
1
vote
0
answers
94
views
Save dataframe to a schema/database.table (in HBase) using Phoenix (by Scala)
I successfully save dataframe to HBase table (with no schema) using Phoenix with this code:
df_user.write
.format("org.apache.phoenix.spark")
.mode(SaveMode.Overwrite)
.option("...
0
votes
0
answers
37
views
How to have dual write datasystem
I am looking for a solution to write data into HBASE and the same to DataBricks. I can have a solution to add secondary indexes on timestamp column on HBASE (Phoenix supported) and another async ...
0
votes
1
answer
24
views
For spark-phoenix, I don't want to pull the whole data from HBase. Is there any way to pull the data from table according to my condition?
It is too slow to pull the whole data from Hbase. I only need to process data for one hour.
So I want to know whether I can specify the SQL in config and pull one-hour data like Spark's support to ...
0
votes
0
answers
22
views
How to clear the screen in Apache Phoenix sqlline cmd on windows?
As described in the title, I wonder how to use the cmd like cls in phoenix sqlline.py to clear the screen on windows platform.
I have try to use the cmd like clear or cls, but it didn't work. what ...
1
vote
0
answers
109
views
HBase region split unexpected, each region size less than 1g
The hbase.hregion.max.filesize is 10g.
The split policy is SteppingSplitPolicy.
The table was created by phoenix with salt_buckets = 6.
According to source code of SteppingSplitPolicy:
protected ...
0
votes
1
answer
183
views
Google Bigtable secondary indices
In reviewing Google Bigtable I found that it does not offer the ability to define secondary indices.
So if you have a billion transactions, for 10 million customers, it would seem you need a full ...
0
votes
0
answers
193
views
Subscription with Phoenix in Flutter. How to get response from subscription
What happened?
When I click on the button confirm, a method _doSend is called. This method call a HTTP POST request (the method sends a transaction to a blockchain and waits the result). HTTP POST ...
1
vote
0
answers
105
views
Receive a Kafka message through Spark Streaming and delete Phoenix/HBase data
In my project, I have the current workflow:
Kafka message => Spark Streaming/processing => Insert/Update to HBase and/or Phoenix
Both the Insert and Update operation works with HBase directly or ...
0
votes
1
answer
229
views
SQLException: No suitable driver found for jdbc:phoenix:(hosts)
I am running a spark-submit command that will do some database work via a Scala class.
spark-submit
--verbose
--class mycompany.MyClass
--conf spark.driver.extraJavaOptions=-Dconfig.resource=dev-...
0
votes
0
answers
25
views
How to map HBase native timestamp to phoenix non-pk column
The phoenix provides row_timestamp to map hbase native timestamp to phoenix column, however the column should be primary key. I want to handle the data which out of order, but it can't.
For example:
I ...
0
votes
0
answers
163
views
Interpretation of rows in Phoenix SYSTEM.CATALOG
When I create a Phoenix table there are two extra rows in SYSTEM.CATALOG. These are the first and the second rows in the output of SELECT * FROM SYSTEM.CATALOG ...... below. Can someone please help me ...
0
votes
1
answer
73
views
Phoenix table split by composite row key
Is it possible to specify region split values when creating a table in Phoenix with composite primary key? For instance:
CREATE TABLE TEST_TABLE(A VARCHAR, B VARCHAR CONSTRAINT PRIMARY KEY (A,B)) ...
0
votes
0
answers
43
views
HConnection Closed - JDBC - Connection-Pool
We're using JDBC Connection through Hikari CP to connect to Apache Phoenix & we're facing "HConnection-Closed" Issues. It's because of stale connections present in the pool and the pool ...
0
votes
0
answers
20
views
Why retrieving hbase region mapping from zookeeper is much faster on spark than from local jdbc
i want to understand why querying hbase from spark-job (cluster mode) is much faster than from local jdbc.
I know that data locality improve performance but my point is on region mapping retrieved ...
1
vote
1
answer
247
views
How to bulk load data to Apache Phoenix 5.1.2. using Apache Spark 3.2.1?
I am trying to bulk load CSV files (30 - 300 GB each) into Apache Phoenix tables. I am trying to do that with the Apache Spark plugin (https://phoenix.apache.org/phoenix_spark.html).
However, when I ...
0
votes
0
answers
41
views
Generate Create Table script from existing Phoenix Table
I'm curious if phoenix currently has the capability to generate the create scripts from an existing phoenix table.
0
votes
0
answers
225
views
Can't connect to Phoenix with DBeaver running on AWS EMR
I have phoenix running on/in hbase on an AWS EMR Cluster and most everything works fine. Just connecting with DBeaver using the JDBC driver doesn't work. I have set up ssh tunnelling in DBeaver and it ...
0
votes
2
answers
248
views
How to set a timeout to Phoenix thin driver?
I am developing a microservice with Spring Boot and using the Phoenix thin driver to query a HBase table.
I want to set the timeout to value of 2 minutes but the settings are being ignored:
...
0
votes
2
answers
153
views
How do you recreate an existing HBASE table to add salted keys?
I have an HBASE table with 100 of thousands of rows and we're experience issues with hotspotting.
I'd like to recreate this table with salted row keys.
I've attempted to "org.apache.hadoop.hbase....
0
votes
1
answer
57
views
Apache phoenix PySpark dependencies
I want to query a Phoenix table from spark using spark connector. In Hortonwork environment i used to do following
pyspark --jars
/usr/hdp/2.6.4.0-91/phoenix/phoenix-spark2.jar,/usr/hdp/2.6.4.0-91/...
1
vote
0
answers
63
views
Write Spark Stream to Phoenix table
I am trying to figure out how to write a Spark Stream to a Phoenix table in the least convoluted way.
So far I have only found this solution: kafka-to-phoenix, which requires some deep ad-hoc ...
0
votes
1
answer
564
views
Esbuild in Phoenix + jQuery
I currently use esbuild to load my static assets.
I use it with a package.json file to maintain my javascript plugins.
The jQuery plugin is available in my app.js, but not in my node_modules. The ...
-4
votes
1
answer
65
views
Does an HTML form submit sorted results?
Does an html form like this submit results in an order like below? from top of form to bottom of form.
<form method="GET">
<input type="text" name="fname">
...
0
votes
0
answers
194
views
Apache Phoenix - Count query returns more than 100k rows, but SELECT query does not return any row
Using Apache Spark 3, I manipulated some CSV data, stored in a dataframe, with the intention of sending it to HBase.
The data is successfully sent using JavaHBaseContext's bulkPut() method.
However, ...
0
votes
1
answer
42
views
How to modify a project Makefile to integrate boehm gc
Please, is someone familiar with Boehm GC?
I want to use it in the word-count app of Phoenix (https://github.com/kozyraki/phoenix), but I fail to modify the Makefile to include the GC library.
On the ...
1
vote
0
answers
123
views
Phoenix-Spark-5.0.0-HBase-2.0 compatibility with scala 2.12
I am using Phoenix Spark 5.0.0-HBase-2.0 with an environment that provides scala 2.12
the issue is the method
public String[] getFieldArray(boolean skipNormalizingIdentifier, Dataset<Row> data)
...
0
votes
1
answer
22
views
question sql phoenix : for each different value of column A, get first result of column B?
Hello I'm learning SQL recently and I'm struggled with this pb for hours:
for each different value of column A, I want to get first result of column B
did someone know how to do this?
Here's an ...
0
votes
1
answer
226
views
Change column datatype from VARCHAR to BIGINT in phoenix table
I have an existing apache phoenix table that has all the columns defined as VARCHAR. I want to change the datatype of one of the columns to BIGINT. Is this possible in phoenix? How can I achieve this?
0
votes
1
answer
69
views
Apache Phoenix - Create view on existing phoenix table with additional calculated field
I want to create a view in apache phoenix on an existing phoenix table and with an additional column. The following create view statements are throwing error:
CREATE VIEW SCHEMA01.OSLE_VW (...
0
votes
1
answer
128
views
Is there a way to UPSERT a TIMESTAMP with TIME ZONE information in Apache Phoenix?
I am trying to UPSERT into a Phoenix table from Nifi using the PutSQL processor.
Let's say my table name is X and its schema looks like this:
id [INT],
ts [TIMESTAMP]
Statement looks like:
UPSERT INTO ...
1
vote
1
answer
214
views
Problem with powershell script in setup Exploit Education Phoenix
Hey I wanted to start doing ctf in this website: https://exploit.education/phoenix/
But I have encountered a problem, I can't make the set up work. Here is a link to how to how to set up the ctf - ...
0
votes
1
answer
44
views
Apache Pheonix add a covered column to index table
I built a pheonix table using the shell command:
CREATE TABLE Student (Id VARCHAR, Grade VARCHAR, Name VARCHAR, College VARCHAR, Age VARCHAR, CONSTRAINT PK_CONSTRAINT PRIMARY KEY(Id));
I built an ...
1
vote
2
answers
486
views
Forced region split in HBase not causing any splits
I have an EMR cluster running HBase on s3. I have a table with the following configuration
hbase.regionserver.region.split.policy = org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy
I ...
0
votes
1
answer
88
views
How to push data to phoenix is chuncks
I am very new to the this field. I am trying to push data from spark to phoenix. The size of the data is more than 1 million. The spark job runs fine with 100 thousand record but gets stuck when the ...
0
votes
1
answer
222
views
Regex for escaping '^' in string
I have a problem with escaping from special characters.
I am using Phoenix SQL with function REGEXP_SUBSTR
with parameters (stringTerm, patternString, startInt)
Here is my problem:
Case
Original ...
1
vote
0
answers
105
views
Phoenix Driver ClassNotFound in Spark3 Streaming
I am migrating the existing spark streaming application from spark2.3 to spark3.1.1. I have updated below-mentioned spark dependencies
<dependency>
<groupId>org.apache....
4
votes
1
answer
315
views
Apache Phoenix - GCP Data Proc
I am doing a POC on Google Cloud Dataproc along with HBase as one of the component.
I created cluster and was able to get the cluster running along with the HBase service. I can list and create tables ...
0
votes
0
answers
169
views
Why does this error occur when using Trino to connect to Phoenix
enter image description here
I used dbeaver to connect to Trino of Phoenix, and there was such an error
Could not load/instantiate class org.apache.phoenix.query.DefaultGuidePostsCacheFactory
this my ...
1
vote
1
answer
379
views
Create Hive table with Phoenix handler throws NoClassDefFoundError: org.apache.hadoop.hbase.security.SecurityInfo
I want to create hive table on top of phoenix table in emr.
I am facing a NoClassDefFoundError: org.apache.hadoop.hbase.security.SecurityInfo
What I have done so far:
I followed the instructions ...
0
votes
1
answer
489
views
Phoenix Exporting CSV File
I’m quite new to HBase and Phoenix. I’m trying to export some data to a csv file. Tried this and seems to work.
!outputformat csv
!record /data.csv
select * from “data”;
!record
My question is where ...
0
votes
0
answers
240
views
Read HBase Table via Spark-Scala-Phoenix having peroid(.) in column name
I am reading a HBase table via Phoenix in spark-scala, I am able to read a column without a peroid/dot(.)
But when I try to read a column with dot ex: column name "first.name", it throws ...
2
votes
1
answer
510
views
apache tomcat start fails with phoenix-5.0.0-HBase-2.0-client.jar in project lib folder
i have a web application which connects to apache phoenix; therefore i added phoenix-5.0.0-HBase-2.0-client.jar to dependencies and it works perfectly in intellij on local but when i start tomcat in ...
0
votes
2
answers
120
views
hbase GREATER_OR_EQAUL operator does not work as expected
i have this row in my hbase table:
{rowkey:1_1611646861574/cf:value/1611646776287/Put/vlen=8/seqid=0}
now i want to do a simple scan and find rows where their column value is greater than "...