Questions tagged [apache-zeppelin]
Apache Zeppelin is a web-based notebook that enables data-driven interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL, Python, Scala and more. It also supports Markdown syntax.
1,447
questions
0
votes
0
answers
8
views
Run Zeppelin paragraph when the value of an input text is modified
I have a Zeppelin notebook where the user needs to input a numeric value. If the value is correct, a button should appear in order to continue with the process. If the value is not numeric, an error ...
0
votes
0
answers
26
views
zeppelin spark read parquet mysql write sql exception
After reading the parquet file in Apache Spark,
I specified the fields with spark sql .
If it is executed after setting the field to be the same as the created database table (type also), an SQL ...
0
votes
0
answers
10
views
Cache error when querying table stored in Glue Data Catalog through Zeppelin
I have an error with the way Zeppelin cache tables. We update the data in the Glue Data Catalog in real time, so when we want to query a partition that was updated using Spark, sometimes we get the ...
0
votes
0
answers
30
views
apache zeppelin and spark on kubernetes no communication between executors possible over shuffle
i have this little Problem. I implemented apache zeppelin 0.10.1 on kubernetes. it uses the spark version 3.2.1 . The problem is that the executors cant communicate with each other while shuffling, ...
0
votes
0
answers
9
views
Change a curve color coming from a %sql paragraph in Apache Zeppelin
I'm using zeppelin to display two curves from an SQL request.
However, its default choice to show the first one in dark blue and the second in just a bit lighter blue isn't convenient, and I'd like to ...
0
votes
0
answers
11
views
The sort function in table does not sort numerically in Apache Zeppelin
The sort function in table does not sort numerically in Zeppelin
Type:Number not work
0
votes
2
answers
98
views
how to join two data streams along with sliding window function in Flink Table API?
I have two streaming tables from two Kafka topic and I want to join these streams and perform aggregate function on the data joined.
Streams need to be joined using sliding window. On joining and ...
0
votes
0
answers
6
views
Zeppelin-Interpreter-Spark2-Spark -RemoteInterpreterServer.java [createInterpreter]
Good afternoon
I'm using Ambari, Zeppelin and the interpreter %spark2.pyspark and cronexpression to execute the process, but sometimes RemoteInterpreterServer.java[createInterpreter] don't working
I ...
0
votes
0
answers
21
views
Zeppelin 0.10.1 does not highlight according to code syntax
version: '3.2'
services:
zeppelin:
container_name: zeppelin
image: apache/zeppelin:0.10.1
network_mode: "host"
I use the latest zeppelin docker image to test zeppelin.
I open ...
0
votes
0
answers
13
views
Zeppelin on kubernetes: How to connect Zeppelin to Spark3
i have spark3 installed in my kubernetes cluster ( I used bitnami ), for zeppelin i tired to install it using this tutorial https://zeppelin.apache.org/docs/0.10.0/quickstart/kubernetes.html. My ...
0
votes
0
answers
11
views
What are the options for getting data into JS/Angular from an Impala query within a Zeppelin note?
I'm currently getting data from an Impala query into Javascript/Angular, within a Zeppelin note, by using a %angular paragraph that does an AJAX call to the Zeppelin Notebook REST API (to run a ...
0
votes
0
answers
13
views
Error when running spark application with zeppelin
When I run the above spark application with zeppelin in Yarn cluster with cluster mode, I get the following error:
Where may be the problem? Thanks
0
votes
0
answers
13
views
Access to the "next" UI of Zeppelin through Knox
i am evaluated Zeppelin 0.10.1, it cames a new UI, called "next"
i access to zeppelin with an URL proxified by Apache Knox like :
https://<knox_hostname>/gateway/default/zeppelin
the ...
0
votes
1
answer
55
views
Zeppelin: Jobs are not loading, its showing as Running
Zeppelin:
Once I submit Spark Job over Zeppelin, the running job
or the finished job is not listed in JobManager.
Its stuck in loading state.
0
votes
0
answers
12
views
Zeppelin: Showing wrong job running time
I executed a Spark Job multiple time over Zeppelin and its progress is
show over the Zeppelin JobManager. But its displaying wrong time as when
it was executed. I had executed it recently, but its ...
0
votes
0
answers
16
views
Problem authentication for the first time to Zeppelin Server web UI
I already installed Cloudera manager. After that, I add Zeppelin service and I start it.
I want to launch the Zeppelin Server Web UI and to authenticate with user=admin and password=admin but I didn't ...
0
votes
0
answers
134
views
"Could not execute application" for streaming application deployed from Kinesis Analytics Studio
I have a Kinesis Analytics Studio notebook that is working well, and I'm trying to deploy the solution as an application by following the steps here (the steps for console), but I'm running into a few ...
0
votes
1
answer
34
views
Running a Spark Streaming job in Zeppelin throws connection refused 8998 error
I'm working in a virtual machine. I run a Spark Streaming job which I basically copied from a Databricks tutorial.
%pyspark
query = (
streamingCountsDF
.writeStream
...
0
votes
0
answers
43
views
Is there a way to share functions in Zeppelin with a spark interpreter instantiated per note?
I have searched all the way through the internet and could not find a solution for the following problem:
I am using a spark interpreter in Zeppelin that is instantiated per note. I have it this way ...
0
votes
0
answers
37
views
Run a Zeppelin notebook from a different Zeppelin notebook
I have a notebook with python functions defined in its paragraphs, and I'd like to run those function declarations from within other notebooks.
I know that Databricks has a magic command %run which ...
0
votes
0
answers
21
views
Problem deploying Zeppelin 0.10.0, cannot find 'conf' folder
I'm trying to deploy zeppelin 0.10.0 version.
I met an error when this line of code is executed:
RUN chown -R 1000 ${Z_HOME}/conf && \
chown -R 1000 ${Z_HOME}/k8s/interpreter
This is the ...
1
vote
2
answers
62
views
Zeppelin: While running Spark code getting spark-interpreter-0.10.0.jar file not found
Getting following error while executing spark code through Zeppelin.
ERROR deploy.ClientEndpoint: Exception from cluster was: java.nio.file.NoSuchFileException: /opt/zeppelin/zeppelin/interpreter/...
0
votes
0
answers
47
views
SparkSession doesen't read database despite correct configuration
I'm trying running this simple function using Spark 3.0.0 using Zeppelin 0.9.0:
def getSession(uri: String) : SparkSession = {
return SparkSession
.builder()
.master("local[*]")
...
0
votes
0
answers
14
views
Spark Failing to write to hdfs because field With AVG
I'm running a spark script in scala from an .sh. When running the same code in a Zeppelin notebook I had no problem. But running it from the script returns the following:
ERROR CodeGenerator: failed ...
0
votes
0
answers
45
views
Zeppelin, Spark Data Frame Error - java.net.SocketTimeoutException
I have a data frame which contains a file locations of 10000 files apart from other things. I am looping through the dataframe to extract contents of the files and after about 2000 iterations I get ...
0
votes
0
answers
16
views
Zeppelin Flink to show a table using StreamExecutionEnvironment
Using Kinesis Analytics Studio.
By default it shows a table when using %flink.ssql, but is it possible to show a table when using StreamExecutionEnvironment? Or when using anything other than Flink ...
0
votes
0
answers
58
views
Zeppelin Python Flink cannot print to console
I'm using Kinesis Data Analytics Studio which provides a Zeppelin environment.
Very simple code:
%flink.pyflink
from pyflink.common.serialization import JsonRowDeserializationSchema
from pyflink....
0
votes
0
answers
60
views
AWS KINISES Analytics Studio ZEPPELIN Flink HIVE error
I create a Studio Notebook at Kinesis analytics, I can see data come in by MQTT SQL Legacy of Analytics. So I am receiving data:
enter image description here
When I go to "open in apache zeppelin&...
0
votes
0
answers
35
views
Why does a cell with multiple PySpark "save" operations fail on Zeppelin Notebook?
I have a Zepellin (PySpark) notebook which writes two dataframes to Google Storage buckets in the end, in a single cell, which runs into the following error:
Py4JJavaError: An error occurred while ...
1
vote
1
answer
26
views
How to provide Knox public key to clients to use KnoxSSO if it's multiple instanses of Knox in HA mode
What I've done
I have set up Knox instances with KnoxSSO and with the same master secrets, accessable through nginx balancer
I have set up Zeppelin with shiro definding in knoxJwtRealm.publicKeyPath ...
0
votes
1
answer
178
views
Apache Zeppelin configuration for connect to Hive on HDP Virtualbox
I've been struggling with the Apache Zeppelin notebook version 0.10.0 setup for a while.
The idea is to be able to connect it to a remote Hortonworks 2.6.5 server that runs locally on Virtualbox in ...
0
votes
0
answers
126
views
Upload contents of spark dataframe as CSV to REST API using Python?
I'm trying to piece together the code required to run a query on a Hive/HDFS database (i.e. the same query I could run in Hive or Impala, using Zeppelin or Hue), then upload the contents of that to a ...
1
vote
0
answers
48
views
Zeppelin build fails with error - zeppelin-web: Failed to run task: 'npm install --no-lockfile' failed
I am trying to install Zeppelin (https://github.com/apache/zeppelin) on my virtual machine, Since docker is not supported on my VM, I had do all the setup manually, I had process failure when i tried ...
5
votes
1
answer
158
views
Cannot find conda info. Please verify your conda installation on EMR
I am trying to install conda on EMR and below is my bootstrap script, it looks like conda is getting installed but it is not getting added to environment variable. When I manually update the $PATH ...
0
votes
1
answer
117
views
What is wrong with Bokeh image() plotting? It succeed but showed no graph
I have initially a Spark dataframe with data like that:
+-------------------+--------------+------+-----+
|window_time |delayWindowEnd|values|index|
+-------------------+--------------+------+--...
0
votes
0
answers
16
views
How to Display leading zeros in Zeppelin JDBC-hive Interprator
We're using jdbc(hive) interpreter of zeppelin, but its is not showing leading zeroes of data fields while actual data saved(in orc files) and Hive shell shows leading zeroes.
Example:
select ...
0
votes
1
answer
66
views
How to build a values density heatmap in Bokeh for timed window occurencies calculated in Spark?
According to https://stackoverflow.com/a/48692943/1759063 it is possible to aggregate the occurence on values per time unit like that:
+---------+----------+------------------------+------------+------...
1
vote
0
answers
178
views
How can I fix the 'IProgress not found' in zeppelin
I install the Zeppelin0.10.1 and docker run to use the notebook, when I run these code, return a Error
ImportError: IProgress not found. Please update jupyter and ipywidgets. See https://ipywidgets....
-1
votes
1
answer
53
views
How to pass a variable into an Pyspark sequence to generate time series?
I want to generate a time series, from 2021-12-01 to 2021-12-31, but I want to pass the values with variables into de function secuence.
This is my code:
spark = SparkSession.builder.appName('sparkdf')...
0
votes
0
answers
56
views
How to apply changes to Zeppelin env and site in Amazon EMR?
I am trying to apply changes to the Zeppelin environmental values in my EMR after launch but it is not working. The changes I am trying to add are as below taken from https://zeppelin.apache.org/docs/...
0
votes
0
answers
55
views
Submitting spark jobs with yarn-cluster mode using Apache Zeppelin
I have Apache Zeppelin 0.8.0 instance running on my HDP 3.1 cluster and have configured my interpreter's spark.jars property as below:
/usr/hdp/current/kafka-clients-2.3.0.jar,
/usr/hdp/current/spark-...
0
votes
0
answers
17
views
How can a notebook cell become a data provider (through rest, jdbc, table... ?) in order to make transformed data available to external applications?
I am using Zeppelin to format some open data coming from French web site Synthèse des indicateurs de suivi de l’épidémie COVID-19, which provides a csv file requiring some field type detections (and ...
0
votes
0
answers
34
views
How correct Permission denied when generated class with Java Interpreter on Apache Zeppelin 0.10?
I installed Apache Zeppelin 0.10.0 on RedHat 8, running with java 1.8_301.
When I try to play Java interpreter example coming from official documentation.
I get the following issue:
line 6 : error ...
0
votes
0
answers
181
views
Apache Zeppelin notebook does not work with spark.pyspark
Apache Zeppelin Version 0.10.0
Java
openjdk version "1.8.0_292"
OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_292-b10)
OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.292-b10, ...
0
votes
0
answers
87
views
Broken plugin: [~airflow/plugins/hooks/zeppelin_hook.py] No module named 'pyzeppelin'
I'm trying to integrate zeppelin with Airflow with the intention of having a smooth transition from development stage to production stage. I've downloaded 2 plugins from https://github.com/zjffdu/...
0
votes
0
answers
10
views
Zeppelin jdbc broken pipe erro
In zeppelin we are getting this error daily for the interpreters jdbc1 and jdbc2 like broken pipe were we aren't able to run the query. Could anyone please help on this issue
0
votes
0
answers
60
views
Apache Zeppelin Not Showing Full Stack Trace
I have the following Paragraph that does some Outlier detection using the InterQuartileRange method and strangely it runs in an error, but Apache Zeppelin is kind of truncating it to be useful.
Here ...
0
votes
1
answer
48
views
Import python external library from S3 in Zeppelin
I develop a custom python library that I put in S3 bucket, and now I want to use Zeppelin with pyspark interpreter to interact with it. However, I can't find a way to do it. Anybody knows how to do so?...
0
votes
1
answer
102
views
Why does StringIndexer has no outputCols?
I am using Apache Zeppelin. My anaconda version is conda 4.8.4. and my spark version is:
%spark2.pyspark
spark.version
u'2.3.1.3.0.1.0-187'
When I run my code, it throws followed error:
Exception ...
0
votes
0
answers
31
views
How to design Dynamic Forms in Zeppelin with Spark
I want to add two or multiple columns in dynamic forms. Like this:
For now, I only have one drop-down column. Like this:
What should I do?