Questions tagged [etcd]
etcd is a highly-available key value store for shared configuration and service discovery, inspired by Apache ZooKeeper and doozer.
542
questions
0
votes
0
answers
13
views
How to run etcdutl in a pod?
I am trying to restore an etcd backup, but running the following command issue a warning:
kubectl exec -t -n openshift-etcd etcd-crc-qm2dw-master-0 -- sh -c 'ETCDCTL_API=3 etcdctl -w fields ...
0
votes
0
answers
23
views
Frequent Replication Lag Issue in Patroni Cluster
I am sharing the logs for each services used related to Database HA Setup in the order of time of occurrence of unusual logs in different services.
Node2(Leader): ETCD Log::
{"level":"...
0
votes
0
answers
8
views
Do I need to compare the revision of events since etcd does not gaurantee linearizability of watch response?
As the document says, it does not ensure linearizability for watch operations.
etcd does not ensure linearizability for watch operations. Users are expected to verify the revision of watch responses ...
0
votes
0
answers
20
views
ETCD ERROR -- Error: Unable to find a match: etcd
I use Postgresql14 that is installed RHEL 9 . I want to install etcd but I get below error.
[root@cbspgbackuptest etcd]# yum -y install etcd
Updating Subscription Management repositories.
Last ...
0
votes
0
answers
16
views
kube-apiserver have error logs "watcher.go:218] watch chan error: etcdserver: no leader"
may I ask a question: I upgraded the binary deployed K8 cluster from 1.19.12 to 1.20.0. The upgrade method was to replace the binary file of 1.19.12 with the binary file of 1.20.0, and made ...
0
votes
0
answers
10
views
Listing etcd prefixes at a specific level
I need to analyze a very large etcd key value database that I have no previous knowledge of or schema documentation.
Using etcdctl I would just want to list top-level keys so I can start mind-mapping ...
0
votes
1
answer
26
views
etcd: How to define and use a new function of Node interface in raft/node.go
I am tring to define a new function that propose a new entry with the key in Node interface at raft/node.go and replace the origin Propose function.
// raft/Node.go
type Node interface {
...
0
votes
0
answers
20
views
get all previous keys on a range in jetcd
WatchOption watchOption = WatchOption.newBuilder()
.withRange(OptionsUtil.prefixEndOf(key))
.withPrevKV(true)
.isPrefix(true)
.build();
...
0
votes
0
answers
18
views
python grpc module has a process issue use with subprocess.getstatusoutput
Project introduction:
run in python env, grpc 1.38;
use flask frame and etcd3, flask frame use to accept the request, and use etcd3 to search the etcd datebase.
When the process problem appear:
...
1
vote
3
answers
137
views
Error doing a snapshot using etcdctl options in Kubernetes
I have setup a kubernetes cluster with 2 master nodes and 4 worker nodes, I am trying to do an etcd backup
as described in the documentation inside my etcd container.
ETCDCTL_API=3 etcdctl --...
0
votes
0
answers
14
views
etcd --experimental-corrupt-check-time seems to have no effect even if db and 000*.wal files are corrupted on a single node?
I run 3 nodes etcd cluster with additional flag --experimental-corrupt-check-time 1m. Flag itself does work, so I could see log messages from the Leader:
{"level":"info","ts&...
0
votes
1
answer
56
views
Is it possible to retrieve creation date & time of a key-value pair in etcd?
I would like to know if the etcd database stores the date and time of when a key-value pair were created. Additionally, I would also like to know if etcd stores such information about previous ...
0
votes
1
answer
101
views
Is it possible to restore etcd v3.5 cluster after quorum lost by just restarting the nodes?
Documentation names that case as disaster recovery, and guides you to use etcdctl snapshot restore for such cases. However, even when quorum of a cluster is lost (1 and 2 nodes went down out of 3), ...
0
votes
0
answers
43
views
etcd snapshot save vs copy file from member/snap/db?
I'm using etcd v3.5.7 and documentation says that when you perform a backup of your cluster, then you either:
snapshot save file.db
cp member/snap/db
But I'm not quite sure that these operations are ...
0
votes
1
answer
18
views
Can I change any member or cluster runtime reconfiguration in etcd?
etcd documentation for runtime reconfiguration (v3.5) only lists:
peer/client URL updates
adding members
removing members
But what if I wish to change:
for members
--quota-backend-bytes
--snapshot-...
0
votes
0
answers
16
views
How to install gRPC plugin in on-prem k8s cluster. I am new to this
I have 3 control planes and 2 master modes and wanted to secure etcd using kms. So i wanted to deploy kms plugin but don’t know how to do this. Please help. In K8s docs, installation of plugin is not ...
1
vote
1
answer
55
views
How can I properly use etcd Roles to control write permission on specific etcd key?
I start my etcd cluster using Go etcd/clientv3 with following parameters:
"--name", "etcd-cluster"
"--data-dir", "/var/lib/etcd&...
0
votes
1
answer
26
views
Disable write permission for etcd key?
I use etcdctl put /my/branch/1 value123 to insert value into /my/branch/1. I want to remove write access for that /my/branch/1 key using etcdctl, how can I do that?
Seems that role grant-permission or ...
0
votes
0
answers
159
views
Error renewing cluster certificates: ETCD pods not coming up due to "x509: certificate signed by unknown authority" error
I have a multi-master Kubernetes cluster with three etcd pods running on each node. Recently, the cluster certificates expired, and I used the command kubeadm alpha certs renew all to renew all the ...
0
votes
0
answers
335
views
How to install an etcd cluster on a single host using docker compose
My host is a Macbook Pro 14 M1 Pro and this is the docker-compose.yml file I wrote, but when I use docker-compose up -d to start it, I always get all kinds of errors.
docker version
~ » docker version
...
1
vote
2
answers
126
views
Restoring 5 master node k8s cluster dropping 2 masters
In a scenario where a zone/dc dropped and 2 master nodes out of 5 are now offline, I would like to restore etcd on the remaining 3 master nodes.
So far the best I could manage was restoring from etcd ...
0
votes
0
answers
21
views
Split Brain Problem in Different Data Center (Logic, Failover)
There is an issue that confuses me about split brain calculation.
Case-1: I have 7 nodes in one cluster in two different zones. zone1 has 4 nodes, zone2 has 3 nodes, My current master node in zone2.. ...
0
votes
0
answers
92
views
etcd: cluster-health vs endpoint health. When to use which one?
I am a bit confused regarding how do I check an etcd cluster's health. Should I use
etcdctl cluster-health or etcdctl --cluster=true endpoint health. Is the former command deprecated now? If yes, then ...
0
votes
2
answers
48
views
Can raft leader election algorithm run on serverless (lambda)?
Is it possible to run Raft on serverless lambdas instead of a cluster? The main benefit would be not having to maintain a cluster or VMs.
-2
votes
1
answer
293
views
Kubernetes: Frequently unable to communicate with kublet api (connection refused) [closed]
I'm deploying a new kubernetes cluster on a single node (Ubuntu 22.04)
The problem is I frequently get this error when running any kubectl commands (hostnames changed)
The connection to the server ...
0
votes
0
answers
65
views
What is the purpose of the client key in etcd cluster client auth?
I currently setting up a etcd cluster with three nodes for my Microk8s cluster following this and this guides. I want to enable client and peer auth via TLS using a self-signed CA.
The documentation ...
-1
votes
1
answer
106
views
how to implemet a grpc resolver with etcd in C++?
2 problems:
i've built and install grpc with guide https://github.com/grpc/grpc/blob/master/BUILDING.md, grpc tag is v1.41.0. but i can't find resolver.h nor balancer.h in /usr/local/include/grpc++/, ...
0
votes
1
answer
81
views
APISIX Gateway - Transfer settings from Integration to Production
We use an APISIX gateway that gets its configuration via etcd.
Is it possible to finish the configuration in one environment (e.g. INT) and then transfer it to the production environment with a click?
...
0
votes
0
answers
152
views
Error during etcd cluster initialization due to DNS issues using Minikube
I'm studing k8s operator by practicing the project :https://github.com/kubernetes-operators-book/chapters.git,after runing the following step:
cwd: chapter/03
k create -f etcd-operator-crd.yaml
k ...
2
votes
1
answer
241
views
Apache apisix : failed to fetch data from etcd
I'm using apisix in container mode in my local machine and I can't get to set routes using the config file, I read the logs and It turned out that the error is fetching data from etcd.
logs :
2023-04-...
0
votes
1
answer
66
views
What's the performance impact of consuming Kubernetes ConfigMaps mounted as files?
So I know this is possible and using ConfigMaps this way comes with auto update capability, which is great.
But when consuming such ConfigMap in a pod, what's exactly happening? Do we read these as ...
0
votes
1
answer
51
views
How Raft know previous term log entry committed or not
When I study raft, I have a problem.
A Raft cluster has 5 servers. we call them a,b,c,d,e. a is the leader. Now everything is ok.
Then, A handle a client request, makes a log entry.
scenario 1,
b &...
0
votes
0
answers
43
views
disable leader election in etcd
I'm running etcd on a single server and wanted to disable leader election. Couldn't find any config parameters to achieve this from config guide,
https://etcd.io/docs/v3.4/op-guide/configuration/
Was ...
1
vote
2
answers
460
views
How to return a custom user friendly error message in Kubernetes?
I have a backend with golang that talks to k8s. I want to reformulate the error response that i get from k8s and send it to the frontend.
I want to return a meaningful validation error messages for ...
0
votes
0
answers
74
views
Why kubernetes use protobuf format in etcd and not spilt up to many key-value pairs?
I noticed that kubernetes apiserver marshals the whole CRD object to protobuf format, and store it to etcd.
I have some questions below:
May be a CRD can have many fields(such as two millions fields?)...
2
votes
1
answer
149
views
How to change client listening address in etcd
I have installed a product called Apache APisix, on a Centos 8 vm, which uses etcd to store data.
When I run a command like etcdctl member list, the listening ip address is 127.0.0.1. This is a ...
2
votes
0
answers
72
views
[Golang]: How can I check if a K8s node is part of an ETCD cluster?
I know I can use client-go to programmatically check metadata about the node such as it's status. But how can I check if it is an active part of an ETCD cluster programmatically?
The equivalent action ...
1
vote
1
answer
481
views
ETCD export as json and decode from base64 all key/values to human readable
Is there any easy command line option to export my entire ETCD database to json file but also decode the keys and values automatically from base64?
What I succeeded to the moment is this(example show ...
0
votes
0
answers
132
views
Patroni HA setup Main PID: 3167 (code=exited, status=217/USER)
Here is a screen shot of patroni.service status:
enter image description here
Following is the configuration of my patroni.yml:
scope: pg_cluster
namespace: /service/
name: patroni1
restapi:
...
1
vote
1
answer
106
views
Etcdctl to GET key that contains bash invalid symbols
I cannot use Go nor Python etcd APIs to perform interaction with etcd.
I need to query:
env ETCDCTL_API=3 etcdctl --endpoints=server:2379 --cert ca.pem --key ca.key --cacert cacert.pem --command-...
0
votes
1
answer
89
views
Why kubernetes namesapce "kube-system" has pods of etcd?
I think etcd is the infrastructure of kubernetes, so it should be outside of kubernetes, instead of being pods inside kubernetes.
Why kubernetes list components in namespace "kube-system" ...
0
votes
1
answer
250
views
Get value of a key in etcd if key contains binary value?
I have an etcd key, which contains binary value:
/person/��h��1Ðn��;�Fx/timestamp
20230301091005
I query that key-value by:
env ETCDCTL_API=3 etcdctl --endpoints=server:2379 --cert ca.pem --key ca....
1
vote
1
answer
222
views
Etcdctl cuts JSON quotes after put command
I'm trying to change my whole json object using etcdctl:
etcdctl put /var/dir "{"key1" : "value1", "key2": "value2"}"
And after this idk how, but ...
0
votes
0
answers
211
views
Single node docker Rancher 2.6.8 is restarting with: Failed to get apiserver address from etcd: context deadline exceeded
Single node docker Rancher 2.6.8 is constantly restarting with error in k3s-cluster-reset.log:
Failed to get apiserver address from etcd: context deadline exceeded
In docker container log is:
INFO: ...
0
votes
1
answer
288
views
How etcd cluster data is read and synchronized under k8s clusters?
To build a highly available k8s cluster, you need to build an etcd cluster, which I see in the official k8s documentation.
Each control plane node creates a local etcd member and this etcd member ...
0
votes
1
answer
115
views
Accessing etcd metrics a pod
I'm trying to launch a prometheus pod in order to scrape the etcd metrics from within our kubernetes cluster.
I was trying to reproduce the solution proposed here: Access etcd metrics for Prometheus
...
1
vote
0
answers
43
views
GoLand proxy setting intercepts vpn connect after grpc update from 1.31 to 1.41
I was using goland 2022.3 on a windows 10 machine. I have been working on a project related to etcd and just updated from version 3.4 to 3.5 which also introduced a gRPC update from 1.3 to 1.4. ...
0
votes
0
answers
134
views
How to investigate the etcd leader change reason?
v3.5.1
The leader change can be initiated, if some follower hasn't received any heartbeats from the leader within election timeout interval only.
Q1: Is the statement above correct?
Q2: Is there some ...
0
votes
0
answers
80
views
patroni.yml file configuration for psql HA mode
I m setting up an 3 node postgres HA setup with patroni and etcd for high availability. when I define data directory variable in patroni.yml file, same directory on all 3 nodes ( local path ) its ...