Questions tagged [kylin]
An open source distributed Analytical Engine from eBay to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop to support TB to PB size analysis.
162
questions
0
votes
0
answers
41
views
Connecting Kylin to Postgres in Docker: Unable to Retrieve Tables
I have a project where I need to establish communication between Kylin and Postgres, and I've already containerized everything. It appears that Kylin can detect the Postgres container (as verified by ...
1
vote
0
answers
25
views
Kylin / Web UI not loading in Docker
Summary
I'm trying to run Apache MDX for Kylin in a Docker container (in order to experiment / test it out) following the instructions on the Apache page, but it doesn't seem to work properly. ...
1
vote
1
answer
38
views
Apache Kylin is not available locally after commadn run `docker run`
I test the apache product 'Kylin'. My machine OS is a Ubuntu Linux 18.04.
After run commands below, I am unable to get response on url http://127.0.0.1:7070/kylin/login. Do you have any idea what and ...
0
votes
0
answers
20
views
Hbase service not starting: Failed construction RegionServer
I am trying to start hbase service using start-hbase.sh in my Centos machine due to which Kylin is not reflecting any project and cubes.
Here is my error log:
2023-09-11 17:34:59,457 ERROR [main] ...
0
votes
0
answers
17
views
measure column showing 1 as values instead of the actual values in Kylin SQL Query answer table
The measure is of type column (not constant) and is bigint. I selected the measure from the dropdown corretly as well.
measure column returns 1 for all column values instead of actual values when ...
0
votes
0
answers
58
views
How to setup development environment for kylin with Hadoop in Windows
I want to use a Kylin instance on my Windows machine.
I saw from the docs this link (https://kylin.apache.org/development40/dev_env.html) that explains how to setup development environment for Kylin ...
0
votes
1
answer
30
views
Compiling source code of Kylin throws maven error
I want to compile source code of Kylin and build it using Java 17 is that even possible?
I issue the following cmds:
git clone https://github.com/apache/kylin.git
mvn clean install -DskipTests
But ...
0
votes
1
answer
93
views
Missing hadoop conf files Docker Kylin 5
Last Docker image update Kylin 5.0 I have an error after command $KYLIN_HOME/bin/sample.sh
Missing hadoop conf files. Please contact Community support for more details.
Try $KYLIN_HOME/bin/check-env....
0
votes
0
answers
17
views
Data cannot be read from REDIS
My java project can read and write data on other linux systems normally, the newly deployed production environment is the Kirin Linux system under the arm architecture, when running the web system on ...
0
votes
0
answers
65
views
Connect to HIVE in kylin container (docker)
when executing a command: beeline -u jdbc:hive2://localhost:9000
I am getting below error:
WARN transport.TSaslTransport: Could not send failure response
... 30 more
Error: Could not open client ...
0
votes
0
answers
62
views
How to create calculated measure lastchild in Kylin MDX?
Colleagues, good afternoon!
There is no lastchild type for measures by default in Kylin. Therefore, a problem arises when calculating such indicators as the stock. Monthly stock = stock on the last ...
0
votes
0
answers
23
views
Current User Apache Kylin
Why "select current_user" in Apache Kylin always return 'sa'
How to get real user connected and queried kylin?
I tried docker image Kylin v 4.0.1. No matter who is Authorized - "select ...
0
votes
1
answer
233
views
Unable to connect Apache kylin to superset
I'm running Superset on docker on windows, and kylin is runnning on another machine both are in same virtual network. I have installed kylinpy on docker container to enable connection from kylin on ...
0
votes
0
answers
51
views
Row level security in Apache Kylin
I'm interessting is there a way to implement row level security in Apache Kylin (v4 or v5).
Or, can we get connected user login while hi is quering a cube? I see constant current_user, but i always ...
0
votes
1
answer
218
views
Pyhive connection on docker container
I am using Apache Kylin on a docker container, the services working normally, but I am having some troubles connecting to Hive using pyhive. I would like to list my databases using "show ...
0
votes
1
answer
137
views
How can I increase cluster capacity for Kylin inside Docker
I am currently running a job on Kylin built from Docker: https://kylin.apache.org/docs30/install/kylin_docker.html
I am seeing this:
2022-05-16 15:55:43,519 INFO [pool-1-thread-1] parser....
0
votes
1
answer
126
views
Apache Kylin - how to solve cube build error problem
When i built kylin_sales_cube in Apache Kylin,i get the error:
ERROR [main] org.apache.kylin.engine.mr.KylinReducer:java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.setStoragePolicy(Lorg/...
0
votes
1
answer
54
views
Turn subquery result to array in Kylin
How can I turn the result from subquery into an array in Kylin? In PostgresSQL, I can do it like the query below, but in Kylin it is an error.
SELECT ARRAY(
SELECT A.ID
FROM A
WHERE A.num =...
0
votes
1
answer
452
views
Kylin Additional Data Sources like SQL Server
I have a Kubernetes cluster with Kylin for Back-End and Superset as Front-End.
Everything works great for the example "Default" database within the Kylin application.
Now I am trying to add ...
1
vote
1
answer
1k
views
An error occurred while creating datasets: Dataset could not be created
I have a running Kylin Cluster in Kubernetes and Superset in Kubernets also.
Kylin is already configured with a built cube "kylin_sales_cube"
Superset is already configured with Kylin ...
0
votes
1
answer
2k
views
Could not load database driver: KylinEngineSpec
Just install Apache Superset within Kubernetes.
Already have a working Apache Kylin Cluster in the same Kubernetes Cluster.
While trying to connect Kylin within Superset i get the following error ...
0
votes
1
answer
167
views
Apache Kylin stuck on 'Convert Cuboid Data to HFile'
I installed the following stack on my lab setup:
Hadoop 2.7.1
Hive 1.2.2
HBase 1.7.1
Kylin 3.1.2
I now try to build a cube from the sample dataset provided by Kylin itself, and the process gets ...
0
votes
2
answers
2k
views
problemin connecting apache superset running inside docker container to Kylin
I have a running apache-superset inside a docker container that i want to connect to a running apache-kylin (Not inside docker ).
I am recieving the following error whenever i test connection with ...
0
votes
1
answer
188
views
Apache Kylin and Sqoop - Is there a way to edit the Sqoop generated SQL statement?
I am working with Apache Kylin and using Sqoop to connect to my PostgreSQL database. I have a cube created based on a fact table that references the same dimensional table twice. So the problem arises ...
1
vote
1
answer
133
views
Update to mapred-default.xml not visible in web UI configuration
I have an Apache Kylin container running in docker. I was getting a Java heap space error in map reduce phase so I tried updating some parameters in Hadoop mapred-default.xml file. After making the ...
0
votes
1
answer
83
views
Apache Kylin - Can't select partition date from date dimension
I am doing a project in Apache Kylin and I would like to use a date column from my date dimension as a partition column as I don't have any date columns in my fact table. However, as you can see in ...
1
vote
1
answer
433
views
Apache Kylin docker image fails to start
I have downloaded the Apache Kylin docker image from their site, I use the following command to run the image and it exits with code 139:
docker run -d -m 8G -p 7070:7070 -p 8088:8088 -p 50070:50070 -...
0
votes
1
answer
895
views
Unable to access localhost:7070 due to error in Apache Kylin
Good afternoon, I am having problems when trying to access http://:7070. I installed the following programs: apache-hive-3.1.2-bin , kylin-3.1.1-bin-hadoop3 , kafka_2.12-2.5.0 , hadoop-3.3.0 , and ...
1
vote
1
answer
32
views
Failed to get recommend Cuboid
when I click on model--planner--recommend,an error occurred.
"Failed to get recommend Cuboid;Check whether you have enabled System Cube."
1
vote
0
answers
366
views
How to load CSV file into Apache Kylin
I want to load a csv file that contains >10000000 rows of data into Apache Kylin. Currently, my Kylin (version 3.0.2) is installed in AWS EMR cluster. My csv file is currently stored in s3 bucket. ...
0
votes
2
answers
389
views
sed command to find and replace string with special characters to a string in command line
I am trying to use sed to find/replace a string with special characters in a .property file.
This is my original line in the file:
kylin.source.hive.beeline-params=-n root --hiveconf hive.security....
2
votes
1
answer
1k
views
Copy particular XML document element to Another XML document using shell commands
I am working on installing Kylin on AWS EMR via shell script . I have an xml file with below content from which I need to copy particular document element to another xml file . This is the manual step ...
0
votes
1
answer
99
views
Kylin Cardinality Calculation
I have a Kylin Cube built on some data that is partitioned on date. Whenever a new date's data is added into hive, Kylin is not able to detect it. Is this normal behaviour?
Currently I am manually ...
0
votes
1
answer
133
views
Kylin installation on CentOS Error /var/lib/docker/overlay2/
I am having some trouble installing Apache Kylin on centOS server. I already had install Kylin on this server. But I had to erase all the images from docker with sudo docker system prune -a, and then ...
0
votes
1
answer
247
views
Unable to run Apache Kylin inside Docker on Centos 7
I'm using the official repository of Kylin. And run it, as all tutorials suggest doing:
docker run -d \
-m 8G \
-p 7070:7070 \
-p 8088:8088 \
-p 50070:50070 \
-p 8032:8032 \
-p 8042:8042 \
-p 60010:...
1
vote
1
answer
518
views
Kylin Web UI and HBase Web UI on Docker does not work properly (Ubuntu 18)
I installed kylin on docker with this command docker pull apachekylin/apache-kylin-standalone:3.0.0-alpha2 and it was fine.
And then I ran
docker run -d \
-m 8G \
-p 7070:7070 \
-p 8088:8088 \
...
2
votes
0
answers
158
views
Kylin implementation
I'm planning to do a poc on kylin at my company. I went through the apache documentation and I have couple of questions regarding installation and overall architecture.
Can I have kylin(job/query) ...
1
vote
0
answers
813
views
Kylin start fail java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
I install kylin by https://github.com/cas-packone/ambari-kylin-service/
2020-01-13 01:52:16,673 INFO [main] utils.Compatibility:41 : Running in ZooKeeper 3.4.x compatibility mode
2020-01-13 01:52:16,...
1
vote
1
answer
133
views
An error was reported during the start of kylin
My CDH version is 5.16.1. Hive, hbase, spark, and yarn are all default versions. There is no manual upgrade. These components are functioning normally. The version of kylin I am using is 2.5, with ...
2
votes
2
answers
2k
views
java.lang.NoSuchMethodError: org.apache.hive.common.util.ShutdownHookManager.addShutdownHook
I'm trying to build a cube on Kylin with Spark as engine type. The cluster contains the following tools:
OS image: 1.0-debian9
Apache Spark 2.4.4 (changed from 1.6.2)
Apache Hadoop 2.7.4
Apache ...
0
votes
1
answer
46
views
IBM Cloud: How to open Analytics Engine port 7070?
I want to use big data services on the IBM Cloud, so I found Analytics Engine(AE) and BigInsight, but unfortunately, BigInsight is going to stop, so I can only choose AE. However, IBM AE is different ...
-3
votes
1
answer
102
views
Tech stack selection for DMP systems
Our DMP system has such a demand:
1. Audience Export: Audience based on tag need to export new demographic results to Redis or files every day, to DSP. Because the tag data is refreshed every day.We ...
1
vote
3
answers
744
views
Apache Kylin without Hadoop/Hive
I'm using Snowflake as my DWH and Spark for my ETL and I don't have Hive tables.
Is there an option to use Apache Kylin without the Hadoop ecosystem?
0
votes
0
answers
177
views
java.lang.IllegalArgumentException: Wrong FS: hdfs://nameservice1/kylin_metadata/kylin-..., excepted: hdfs://node111a11:8020
when I start use kylin to Scheduling cube,I meet the following error:
The job log of Cube as follows:
java.lang.IllegalArgumentException: Wrong FS: hdfs://nameservice1/kylin_metadata/kylin-..., ...
1
vote
1
answer
135
views
Unable to create a grouping in Apache Kylin
Hello I am running Apache Kylin apachekylin/apache-kylin-standalone:3.0.0-alpha2 Docker image
I started out by creating two Hive tables one to record store sales and one consisting of store metadata
...
0
votes
0
answers
79
views
Does kylin update aggregates on joined tables
We have 3 tables which are updated daily. In one of the query these 3 tables are joined and the final joined table has timestamp column. Final joined table is used to compute various aggregates. This ...
0
votes
2
answers
523
views
Install Apache Kylin in custom environment
I'm trying to install Apache Kylin in Ubuntu 16.04.
I installed:
hadoop 3.1.2 in pseudo distributed mode (fs.default.name: hdfs://localhost:9000)
apache hive 3.1.2 and db derby 10.14.2.0 (config ...
0
votes
1
answer
168
views
Kylin Build Cube failed somtimes at" #19 Step Name: Hive Cleanup" java.lang.RuntimeException: Failed to read kylin_hive_conf.xml
The error occurs sometimes ,and after reboot kylin(kylin.sh stop and then kylin.sh start), it will find the conf dir location and pass this step.
I am using Kylin version "2.6.2", and KYLIN_CONF="/...
1
vote
0
answers
103
views
Empty query result in Kylin Derived dimension
I’m using Apache Kylin, version: apache-kylin-2.6.2-bin-hadoop3/
In Insight query, I find the derived dimension column always returns an empty result. But using the same SQL in Hive shows that the ...
0
votes
0
answers
79
views
connect to kylin from R
I´m trying to access to Kylin cubes from my R code. My machine is Ubuntu server.
But I've been searching for packages or code to try it for long time to no avail.
What i've done so far after copied ...