Questions tagged [etcd]

etcd is a highly-available key value store for shared configuration and service discovery, inspired by Apache ZooKeeper and doozer.

Filter by
Sorted by
Tagged with
0 votes
0 answers
13 views

How to run etcdutl in a pod?

I am trying to restore an etcd backup, but running the following command issue a warning: kubectl exec -t -n openshift-etcd etcd-crc-qm2dw-master-0 -- sh -c 'ETCDCTL_API=3 etcdctl -w fields ...
Fabrice Jammes's user avatar
0 votes
0 answers
23 views

Frequent Replication Lag Issue in Patroni Cluster

I am sharing the logs for each services used related to Database HA Setup in the order of time of occurrence of unusual logs in different services. Node2(Leader): ETCD Log:: {"level":"...
Aviral Singh's user avatar
0 votes
0 answers
8 views

Do I need to compare the revision of events since etcd does not gaurantee linearizability of watch response?

As the document says, it does not ensure linearizability for watch operations. etcd does not ensure linearizability for watch operations. Users are expected to verify the revision of watch responses ...
Jason Hapyer's user avatar
0 votes
0 answers
20 views

ETCD ERROR -- Error: Unable to find a match: etcd

I use Postgresql14 that is installed RHEL 9 . I want to install etcd but I get below error. [root@cbspgbackuptest etcd]# yum -y install etcd Updating Subscription Management repositories. Last ...
yasemin büsra sergen's user avatar
0 votes
0 answers
16 views

kube-apiserver have error logs "watcher.go:218] watch chan error: etcdserver: no leader"

may I ask a question: I upgraded the binary deployed K8 cluster from 1.19.12 to 1.20.0. The upgrade method was to replace the binary file of 1.19.12 with the binary file of 1.20.0, and made ...
liuyanzhen34's user avatar
0 votes
0 answers
10 views

Listing etcd prefixes at a specific level

I need to analyze a very large etcd key value database that I have no previous knowledge of or schema documentation. Using etcdctl I would just want to list top-level keys so I can start mind-mapping ...
Rino Bino's user avatar
  • 366
0 votes
1 answer
26 views

etcd: How to define and use a new function of Node interface in raft/node.go

I am tring to define a new function that propose a new entry with the key in Node interface at raft/node.go and replace the origin Propose function. // raft/Node.go type Node interface { ...
shihaoyang's user avatar
0 votes
0 answers
20 views

get all previous keys on a range in jetcd

WatchOption watchOption = WatchOption.newBuilder() .withRange(OptionsUtil.prefixEndOf(key)) .withPrevKV(true) .isPrefix(true) .build(); ...
Teddy Tsai's user avatar
0 votes
0 answers
18 views

python grpc module has a process issue use with subprocess.getstatusoutput

Project introduction: run in python env, grpc 1.38; use flask frame and etcd3, flask frame use to accept the request, and use etcd3 to search the etcd datebase. When the process problem appear: ...
HEtinto's user avatar
1 vote
3 answers
137 views

Error doing a snapshot using etcdctl options in Kubernetes

I have setup a kubernetes cluster with 2 master nodes and 4 worker nodes, I am trying to do an etcd backup as described in the documentation inside my etcd container. ‍ETCDCTL_API=3 etcdctl --...
pwoltschk's user avatar
  • 791
0 votes
0 answers
14 views

etcd --experimental-corrupt-check-time seems to have no effect even if db and 000*.wal files are corrupted on a single node?

I run 3 nodes etcd cluster with additional flag --experimental-corrupt-check-time 1m. Flag itself does work, so I could see log messages from the Leader: {"level":"info","ts&...
armaka's user avatar
  • 191
0 votes
1 answer
56 views

Is it possible to retrieve creation date & time of a key-value pair in etcd?

I would like to know if the etcd database stores the date and time of when a key-value pair were created. Additionally, I would also like to know if etcd stores such information about previous ...
user21819272's user avatar
0 votes
1 answer
101 views

Is it possible to restore etcd v3.5 cluster after quorum lost by just restarting the nodes?

Documentation names that case as disaster recovery, and guides you to use etcdctl snapshot restore for such cases. However, even when quorum of a cluster is lost (1 and 2 nodes went down out of 3), ...
armaka's user avatar
  • 191
0 votes
0 answers
43 views

etcd snapshot save vs copy file from member/snap/db?

I'm using etcd v3.5.7 and documentation says that when you perform a backup of your cluster, then you either: snapshot save file.db cp member/snap/db But I'm not quite sure that these operations are ...
armaka's user avatar
  • 191
0 votes
1 answer
18 views

Can I change any member or cluster runtime reconfiguration in etcd?

etcd documentation for runtime reconfiguration (v3.5) only lists: peer/client URL updates adding members removing members But what if I wish to change: for members --quota-backend-bytes --snapshot-...
armaka's user avatar
  • 191
0 votes
0 answers
16 views

How to install gRPC plugin in on-prem k8s cluster. I am new to this

I have 3 control planes and 2 master modes and wanted to secure etcd using kms. So i wanted to deploy kms plugin but don’t know how to do this. Please help. In K8s docs, installation of plugin is not ...
HBA's user avatar
  • 1
1 vote
1 answer
55 views

How can I properly use etcd Roles to control write permission on specific etcd key?

I start my etcd cluster using Go etcd/clientv3 with following parameters: "--name", "etcd-cluster" "--data-dir", "/var/lib/etcd&...
armaka's user avatar
  • 191
0 votes
1 answer
26 views

Disable write permission for etcd key?

I use etcdctl put /my/branch/1 value123 to insert value into /my/branch/1. I want to remove write access for that /my/branch/1 key using etcdctl, how can I do that? Seems that role grant-permission or ...
armaka's user avatar
  • 191
0 votes
0 answers
159 views

Error renewing cluster certificates: ETCD pods not coming up due to "x509: certificate signed by unknown authority" error

I have a multi-master Kubernetes cluster with three etcd pods running on each node. Recently, the cluster certificates expired, and I used the command kubeadm alpha certs renew all to renew all the ...
user1115980's user avatar
0 votes
0 answers
335 views

How to install an etcd cluster on a single host using docker compose

My host is a Macbook Pro 14 M1 Pro and this is the docker-compose.yml file I wrote, but when I use docker-compose up -d to start it, I always get all kinds of errors. docker version ~ » docker version ...
Jayleonc's user avatar
1 vote
2 answers
126 views

Restoring 5 master node k8s cluster dropping 2 masters

In a scenario where a zone/dc dropped and 2 master nodes out of 5 are now offline, I would like to restore etcd on the remaining 3 master nodes. So far the best I could manage was restoring from etcd ...
Tiriyon's user avatar
  • 65
0 votes
0 answers
21 views

Split Brain Problem in Different Data Center (Logic, Failover)

There is an issue that confuses me about split brain calculation. Case-1: I have 7 nodes in one cluster in two different zones. zone1 has 4 nodes, zone2 has 3 nodes, My current master node in zone2.. ...
Ichigo Kurosaki's user avatar
0 votes
0 answers
92 views

etcd: cluster-health vs endpoint health. When to use which one?

I am a bit confused regarding how do I check an etcd cluster's health. Should I use etcdctl cluster-health or etcdctl --cluster=true endpoint health. Is the former command deprecated now? If yes, then ...
Kalit Inani's user avatar
0 votes
2 answers
48 views

Can raft leader election algorithm run on serverless (lambda)?

Is it possible to run Raft on serverless lambdas instead of a cluster? The main benefit would be not having to maintain a cluster or VMs.
marti H's user avatar
  • 45
-2 votes
1 answer
293 views

Kubernetes: Frequently unable to communicate with kublet api (connection refused) [closed]

I'm deploying a new kubernetes cluster on a single node (Ubuntu 22.04) The problem is I frequently get this error when running any kubectl commands (hostnames changed) The connection to the server ...
Aditya K's user avatar
  • 173
0 votes
0 answers
65 views

What is the purpose of the client key in etcd cluster client auth?

I currently setting up a etcd cluster with three nodes for my Microk8s cluster following this and this guides. I want to enable client and peer auth via TLS using a self-signed CA. The documentation ...
marcel h's user avatar
  • 726
-1 votes
1 answer
106 views

how to implemet a grpc resolver with etcd in C++?

2 problems: i've built and install grpc with guide https://github.com/grpc/grpc/blob/master/BUILDING.md, grpc tag is v1.41.0. but i can't find resolver.h nor balancer.h in /usr/local/include/grpc++/, ...
peng alan's user avatar
0 votes
1 answer
81 views

APISIX Gateway - Transfer settings from Integration to Production

We use an APISIX gateway that gets its configuration via etcd. Is it possible to finish the configuration in one environment (e.g. INT) and then transfer it to the production environment with a click? ...
Martin's user avatar
  • 87
0 votes
0 answers
152 views

Error during etcd cluster initialization due to DNS issues using Minikube

I'm studing k8s operator by practicing the project :https://github.com/kubernetes-operators-book/chapters.git,after runing the following step: cwd: chapter/03 k create -f etcd-operator-crd.yaml k ...
JohnSmith's user avatar
2 votes
1 answer
241 views

Apache apisix : failed to fetch data from etcd

I'm using apisix in container mode in my local machine and I can't get to set routes using the config file, I read the logs and It turned out that the error is fetching data from etcd. logs : 2023-04-...
legwana's user avatar
  • 23
0 votes
1 answer
66 views

What's the performance impact of consuming Kubernetes ConfigMaps mounted as files?

So I know this is possible and using ConfigMaps this way comes with auto update capability, which is great. But when consuming such ConfigMap in a pod, what's exactly happening? Do we read these as ...
user2297996's user avatar
  • 1,394
0 votes
1 answer
51 views

How Raft know previous term log entry committed or not

When I study raft, I have a problem. A Raft cluster has 5 servers. we call them a,b,c,d,e. a is the leader. Now everything is ok. Then, A handle a client request, makes a log entry. scenario 1, b &...
tlb's user avatar
  • 3
0 votes
0 answers
43 views

disable leader election in etcd

I'm running etcd on a single server and wanted to disable leader election. Couldn't find any config parameters to achieve this from config guide, https://etcd.io/docs/v3.4/op-guide/configuration/ Was ...
reynoldpj's user avatar
1 vote
2 answers
460 views

How to return a custom user friendly error message in Kubernetes?

I have a backend with golang that talks to k8s. I want to reformulate the error response that i get from k8s and send it to the frontend. I want to return a meaningful validation error messages for ...
dom1's user avatar
  • 437
0 votes
0 answers
74 views

Why kubernetes use protobuf format in etcd and not spilt up to many key-value pairs?

I noticed that kubernetes apiserver marshals the whole CRD object to protobuf format, and store it to etcd. I have some questions below: May be a CRD can have many fields(such as two millions fields?)...
Harris Ice's user avatar
2 votes
1 answer
149 views

How to change client listening address in etcd

I have installed a product called Apache APisix, on a Centos 8 vm, which uses etcd to store data. When I run a command like etcdctl member list, the listening ip address is 127.0.0.1. This is a ...
Blade5's user avatar
  • 31
2 votes
0 answers
72 views

[Golang]: How can I check if a K8s node is part of an ETCD cluster?

I know I can use client-go to programmatically check metadata about the node such as it's status. But how can I check if it is an active part of an ETCD cluster programmatically? The equivalent action ...
2s875's user avatar
  • 33
1 vote
1 answer
481 views

ETCD export as json and decode from base64 all key/values to human readable

Is there any easy command line option to export my entire ETCD database to json file but also decode the keys and values automatically from base64? What I succeeded to the moment is this(example show ...
R2D2's user avatar
  • 9,478
0 votes
0 answers
132 views

Patroni HA setup Main PID: 3167 (code=exited, status=217/USER)

Here is a screen shot of patroni.service status: enter image description here Following is the configuration of my patroni.yml: scope: pg_cluster namespace: /service/ name: patroni1 restapi: ...
Vishwajit Bhadrashetty's user avatar
1 vote
1 answer
106 views

Etcdctl to GET key that contains bash invalid symbols

I cannot use Go nor Python etcd APIs to perform interaction with etcd. I need to query: env ETCDCTL_API=3 etcdctl --endpoints=server:2379 --cert ca.pem --key ca.key --cacert cacert.pem --command-...
armaka's user avatar
  • 191
0 votes
1 answer
89 views

Why kubernetes namesapce "kube-system" has pods of etcd?

I think etcd is the infrastructure of kubernetes, so it should be outside of kubernetes, instead of being pods inside kubernetes. Why kubernetes list components in namespace "kube-system" ...
Vincent's user avatar
  • 57
0 votes
1 answer
250 views

Get value of a key in etcd if key contains binary value?

I have an etcd key, which contains binary value: /person/��h��1Ðn��;�Fx/timestamp 20230301091005 I query that key-value by: env ETCDCTL_API=3 etcdctl --endpoints=server:2379 --cert ca.pem --key ca....
armaka's user avatar
  • 191
1 vote
1 answer
222 views

Etcdctl cuts JSON quotes after put command

I'm trying to change my whole json object using etcdctl: etcdctl put /var/dir "{"key1" : "value1", "key2": "value2"}" And after this idk how, but ...
dan k's user avatar
  • 41
0 votes
0 answers
211 views

Single node docker Rancher 2.6.8 is restarting with: Failed to get apiserver address from etcd: context deadline exceeded

Single node docker Rancher 2.6.8 is constantly restarting with error in k3s-cluster-reset.log: Failed to get apiserver address from etcd: context deadline exceeded In docker container log is: INFO: ...
sk1me's user avatar
  • 169
0 votes
1 answer
288 views

How etcd cluster data is read and synchronized under k8s clusters?

To build a highly available k8s cluster, you need to build an etcd cluster, which I see in the official k8s documentation. Each control plane node creates a local etcd member and this etcd member ...
山河以无恙's user avatar
0 votes
1 answer
115 views

Accessing etcd metrics a pod

I'm trying to launch a prometheus pod in order to scrape the etcd metrics from within our kubernetes cluster. I was trying to reproduce the solution proposed here: Access etcd metrics for Prometheus ...
E. Jaep's user avatar
  • 2,095
1 vote
0 answers
43 views

GoLand proxy setting intercepts vpn connect after grpc update from 1.31 to 1.41

I was using goland 2022.3 on a windows 10 machine. I have been working on a project related to etcd and just updated from version 3.4 to 3.5 which also introduced a gRPC update from 1.3 to 1.4. ...
Sam35's user avatar
  • 11
0 votes
0 answers
134 views

How to investigate the etcd leader change reason?

v3.5.1 The leader change can be initiated, if some follower hasn't received any heartbeats from the leader within election timeout interval only. Q1: Is the statement above correct? Q2: Is there some ...
Mark Barinstein's user avatar
0 votes
0 answers
80 views

patroni.yml file configuration for psql HA mode

I m setting up an 3 node postgres HA setup with patroni and etcd for high availability. when I define data directory variable in patroni.yml file, same directory on all 3 nodes ( local path ) its ...
rishikanth's user avatar

1
2 3 4 5
11