Questions tagged [apache-zookeeper]
Apache ZooKeeper is a distributed service that provides configuration information storage, naming, synchronization, coordination, and group services.
3,533
questions
0
votes
0
answers
9
views
spring zookeeper discovery service metadata
I have a spring-boot service and using the zookeeper discovery for the service registry. Now, I have to deploy the whole system in K8s, now I am getting the problem with Feign-client. The client try ...
0
votes
0
answers
3
views
Is there a way to use czxid instead of dataVersion when verifying znode changes?
Zookeeper enables its users to verify their updates/deletions of znodes by providing the expected dataVersion of that znone.
My question is if there is a way to use the czxid (i.e. Creation event ID) ...
0
votes
0
answers
15
views
Kafka ACL - Who CREATES the topic for plaintext connections?
For one of the requirements on the project I am working on, I need to open both plaintext connection and SSL connection for my Kafka Broker.
For the plaintext connections, I understand that all users ...
0
votes
0
answers
17
views
Kafka zookeeper "Error getting peer certificates", "peer not authenticated"
I am getting this error on the 3 zookeeper pods that I have installed on an openshift cluster:
2022-05-09 13:53:40,361 ERROR Error getting peer certificates (org.apache.zookeeper.server....
0
votes
1
answer
17
views
Modifying fields(index) in solrcloud after loading data
solr - solr-8.9.0, java version "11.0.12" 2021-07-20 LTS
I am using external zookeeper ensemble with 3 apache zookeeper instance (apache-zookeeper-3.6.1-bin.tar.gz)
Solr cloud have been ...
-2
votes
0
answers
18
views
Permission denied running Zookeeper
What permission does this need?
0
votes
0
answers
10
views
ZooKeeper fail access JMX?
Password file not readable: /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/management/jmxremote.password
sun.management.AgentConfigurationError
at sun.management.jmxremote.ConnectorBootstrap....
0
votes
1
answer
53
views
Unable to load database on disk
I got this error when I stop my zookeeper instance and copy all data of zookeeper in other path and change dataDir=/data/zookeeper-data in zookeeper.properties.
ERROR Unable to load database on disk (...
0
votes
1
answer
58
views
Kafka working in Azure Kubernetes cluster, but not locally in minikube
I am using Kafka and facing a problem.
Kafka doesn't seem to work locally using minikube.
I get this erorr: org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 1 ...
0
votes
1
answer
37
views
Zookeeper java.lang.NoClassDefFoundError: org/eclipse/jetty/server/Connector
I am getting the below error when starting Apache HBase with Zookeeper on my mac. I am using openjdk11.
************* WARN [main] admin.AdminServerFactory: Unable to load jetty, not starting ...
0
votes
0
answers
25
views
Apache Curator UnimplementedException for Zookeeper version 3.6.3
I am currently trying to upgrade Apache zookeeper, curator from zookeeper = 3.5.5, curator = 2.8.0 to zookeeper = 3.6.3, curator = 5.2.0
But getting org.apache.zookeeper.KeeperException$...
0
votes
0
answers
47
views
Migrate kafka from server to docker container
How to migrate from server kafka (as service) to docker?
I tried to copy all data from kafka and zookeeper data directory to new place. And started docker container. But have a problem. Zookeeper can ...
0
votes
0
answers
14
views
Not Able to Increase Replication Factor of Kafka Topic
We have a 3 node kafka-zookeeper cluster setup with kafka-zookeeper communicating on SSL.
We are currently using apache kafka 2.5 and zookeeper 3.5.7 . We are trying to increase the replication factor ...
0
votes
0
answers
28
views
Not Able to Update Replication Factor of Kafka Topic
We have a 3 node kafka-zookeeper cluster setup with kafka-zookeeper communicating on SSL.
We are currently using apache kafka 2.5 and zookeeper 3.5.7 . We are trying to increase the replication factor ...
0
votes
1
answer
31
views
Bitnami - exec: "zookeeper-shell.sh": executable file not found in $PATH: unknown
I have installed kafka on docker with following yml
version: "3"
services:
zookeeper:
image: 'bitnami/zookeeper:latest'
ports:
- '2181:2181'
environment:
- ALLOW_ANONYMOUS_LOGIN=yes
...
0
votes
0
answers
20
views
Kafaka Subscriber not receiving the messages
I am writing sample applications in .Net core to interact with Kafka.
I have downloaded Kafka and Zookeeper official docker images to my machine.
I am using Confluent.Kafka nuget package for both ...
0
votes
0
answers
64
views
Unable to resolve address for Kubernetes service
I have installed Kafka single-node using Confluent. There is an error in Kafka pod :
[WARN] 2022-04-26 14:29:47,008 [main-SendThread(zookeeper.confluent.svc.cluster.local:2181)] org.apache.zookeeper....
0
votes
0
answers
7
views
When is the zookeeper temporary node deleted if use connection pool
as everyone knows,We use connection pool to connect zookeeper,if i create a temporary node,then return,so the connection will put back to connection pool,as this time,will the session close??i think ...
0
votes
1
answer
21
views
ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s)
I was installing a Hive on Ambari.
But hive metastore is working well. only hiveserver2 isn't working.
the following error occurred:
*** stderr: /var/lib/ambari-agent/data/errors-362.txt**
...
1
vote
1
answer
26
views
Unable to connect Zookeeper in gke cluster
I am getting the below error while deploying the Apache Zookeeper bitnami charts
Unable to connect Zookeeper
To connect to your ZooKeeper server run the following commands:
export POD_NAME=$(kubectl ...
0
votes
0
answers
8
views
how to connect zookeeper after deploying helm chart in gke?
we are creating a vmware carvel package, I need do a sanity check for zookeeper, how can i check the output in gke?
Zookeeper output
Curl and localhost is failing to connect.
0
votes
0
answers
39
views
SolrCoreInitalizationException: SolrCore 'solrprodshard2' is not available due to init failure: Error opening new searcher
We store our Index in shared NAS drive. To perform DR exercise, we switched NAS to different cluster and reverted back. During this time we removed write.lock files on Index. When we reconfigured the ...
0
votes
0
answers
43
views
Deploying zookeeper from Bitnami Helm chart
We are using Zookeeper Bitnami chart for creating a vmware carvel package, firstly I tried deploying helm chart, but pod was pending, I got the below output. But how does I install zkCli.sh
I want to ...
1
vote
1
answer
87
views
Solr / Zookeeper : "An exception was thrown while closing send thread"
I am trying Solr for the first time on RHEL 8 with Openjdk version "17.0.2".
I am following the tutorial https://solr.apache.org/guide/8_11/solr-tutorial.html. I get the warning:
WARN - ...
1
vote
0
answers
62
views
how to set auth for zookeeper?
I want set auth for Node service ,not ACL for zknode one by one? Is there a solution to do?
And I try to use bitnami/zookeeper,But I don't know how to connected with Golang
// this is to run ...
-1
votes
1
answer
34
views
Kafka config chroot in zookeeper.connect
I want to use chroot in zookeeper for Kafka data. So I set the following config in server.properties:
zookeeper.connect=10.114.0.2:2181/kafka,10.114.0.3:2181/kafka,10.114.0.4:2181/kafka
But it does ...
0
votes
0
answers
37
views
Apache Pulsar corrupted ledger data keeps Lucidworks Fusion from starting up
I am new to Apache Pulsar and I am trying to recover from a situation. To start with I have Lucidworks Fusion running on Amazon EKS. Fusion uses Apache Pulsar as their distributed messaging platform. ...
0
votes
1
answer
124
views
Error in Zookeeper : Unreasonable length = 308375649 when creating topic in Kafka
I am setting up Kafka on my local Windows 10 machine. So downloaded all the required binaries and updated the two settings server and zookeeper properties as per the documentation.
But when running ...
0
votes
1
answer
76
views
Why i can't access kafka from an external machine?
I am new to kafka, i tried to setup my first cluster on a vps with Docker-compose. But i still cannot access it from my local pc ( outside the host ).
here is my docker compose
version: '2'
...
0
votes
0
answers
58
views
Curator disconnects from zookeeper when IPs change even when using DNS names in connection string
We are using the curator service discovery in docker and kubernetes environments. We setup the connection string using the DNS names of the containers/pods. The problem I am seeing is that it ...
0
votes
0
answers
4
views
What will a HRegionServer do if the zookeeper node that connected to the HRegionServer goes down?
In HBase, when a HRegionServer starts up, it will create an ephemeral znode in the ZooKeeper cluster. When the HRegionServer crashes, the ephemeral znode will be deleted, and the HMaster can be ...
0
votes
0
answers
107
views
Unable to check consumer group on Kafka topic
I have created the topic on 3 node kafka cluster as below
/opt/UMB/kafka/bin/kafka-topics.sh --create --zookeeper broker1:2181,broker2:2181,broker3:2181 --replication-factor 1 --partitions 64 --topic ...
0
votes
0
answers
53
views
Removing ZooKeeper node in Kafka cluster procedure?
What is the best way, procedure to remove Zookeeper node from Kafka cluster because of infrastructure changes?
Is it enought to stop this one node, remove it from Kafka configuration and do rolling ...
1
vote
0
answers
36
views
How can I configured jaas.conf in order to Kafka Inbound Endpoint WSO2 EI 6.6.0?
I have WSO2 EI 6.6.0 and I am using the next libs to configure Kafka Inbound Enpoint.
dropins:
org.apache.synapse.kafka.poll-1.0.10.jar
lib:
kafka_2.12-1.0.0.jar
kafka-clients-1.0.0.jar
metrics-...
0
votes
0
answers
41
views
Started flink 1.7.2 web dashboard but 0 Task Manager and Task Slots available
I am trying to start Flink application version 1.7.2 using bin/start-cluster.sh command inside the flink folder. When I run the jps to confirm it shows the following:
1329 Jps
1291 TaskManagerRunner
...
0
votes
0
answers
17
views
While checking server logs ERROR for ROCFM , facing disconnection in the ZOOKEEPER Connectivity
In the server logs, noticing that there is a disconnection in the zookeeper connection.
Details of the log is below :-
[ INFO] [Mon Apr 04 11:02:58 2022] [Server:sbin/recordprocessor] [...
0
votes
2
answers
69
views
why connect zookeeper take a long time on windows?
I'm run a simple demo that using the java zookeeper client to connect zookeeper server.
It take a long time(at least 10 seconds) to connect successful on windows, but it connect
successful on linux ...
0
votes
0
answers
25
views
Should zookeeper be run on independent machines? in production environment
in practice, I would like to build a server using the zookeeper and Kafka.
However, I heard that the zookeeper and Kafka should be built separately. I wonder why they should be built separately.
0
votes
0
answers
31
views
Zookeeper Znode count is different from use command that getAllChildrenNumber of zkcli.sh
How do I find the missing znodes?
I use Zookeeper version: 3.7.0 in the docker engine.
Method 1:
When I use ZooKeeper Commands - srvr to find znode number, it shows 5 znode count.
# echo srvr | nc ...
0
votes
0
answers
8
views
Why does setting zookeeper quotas not work?
The version of zookeeper is 3.8.0.
when setting the quota is not work!
eg :
create /a
setquota -n 1 /a
create /a/1
create /a/2
no warn log
should print warn log, but not!
0
votes
0
answers
23
views
zookeeper start using daemon on windows 10
I am trying to start zookeeper on windows 10 in the background using -daemon command and it comes back with "ERROR Invalid arguments, exiting abnormally (org.apache.zookeeper.server....
0
votes
0
answers
12
views
about the callback method in zookeeper
My question is focus on method process(WatchedEvent we) in inner class new Watcher(). Is this process() invoked automatically? I can not understand the whole process of callback.
0
votes
0
answers
20
views
Password rotation for kafka acl passwords which are stored in zookeeper
How to handle password rotation for kafka acls passwords?
Users cant access the kafka cluster without authentication, we are adding the user(& password) to zookeeper and adding the respective acls ...
0
votes
0
answers
29
views
Curatorframework checkexists() function, causing problems when overloaded, or add to zookeeper in high rate
I use the following to add node in zookeeper:
public void put(String key, String value) throws Exception {
String fullPath = calculateFullPath(key);
preparePath(fullPath). forPath(fullPath, value....
0
votes
1
answer
47
views
Remote(WAN) kafka client cannot write data to kafka which is in LAN
I'm trying to configure advertised.listener to receive data from remote host.
Producer running on remote host and sends data to kafka. Kafka running in our LAN. Also there is a port mapping: ...
0
votes
0
answers
14
views
Why retrieving hbase region mapping from zookeeper is much faster on spark than from local jdbc
i want to understand why querying hbase from spark-job (cluster mode) is much faster than from local jdbc.
I know that data locality improve performance but my point is on region mapping retrieved ...
0
votes
0
answers
10
views
Apache Kafka Server is Not Working (kafka-server-start.bat config\server.properties) But Zookeeper is properly working [duplicate]
start-up zookeeper
C:\kafka_2.13-3.1.0>zookeeper-server-start.bat config\zookeeper.properties
there is no error, the Zookeeper is working.
After the Start Kafka server, nothing happens, a line is ...
1
vote
0
answers
106
views
Apache Ranger Audit log connect with Solr Cloud Mode with SSL
I have three nodes with Solr and ZooKeeper with enabled TLS/SSL where the ZK listen only in securePort and Solr - HTTPS.
Now I want to connect Solr to Apache Ranger for audit logs
where I am setting:
...
0
votes
0
answers
163
views
Zookeeper - Due Date for Log4J Upgrade
Log4J version (1.x) used by Apache Zookeeper exposes users to the following CVE-s:
Critical -
CVE-2019-17571
CVE-2022-23305
CVE-2022-23307
High -
CVE-2022-23302
CVE-2021-4104
Low -
CVE-2020-9488
...
0
votes
0
answers
44
views
Spring hbase-client : Zookeeper session created for each request
I'm doing multiple scans in HBase with a java/spring boot API. However I have a doubt about performances of the way hbase-client manages connections (I use hbase-client 1.3.0).
Here is the code I use ...