215
questions
0
votes
1
answer
337
views
How to implement content-based health check for GKE ingress
I want to implement a content-based health check for my GKE ingress. These kinds of health checks are usually specified in the BackendConfig CRD. My current BackendConfig looks like this:
apiVersion: ...
1
vote
1
answer
402
views
HEALTH CHECK not resolving for ClamAV hosted in GKE cluster
Couldn't resolve health check related issue for the clamAV:1.2 deployment hosted in the GKE cluster in the port 3310, 7357.
I'm new to this clamAV concept and hosting in GKE with ingress
Facing some ...
1
vote
2
answers
496
views
k8s, without information about CPU and Memory
I got empty values for CPU and Memory, when I used igztop for check running pods in iguazio/mlrun solution. See the first line in output for this pod *m6vd9:
[ jist @ iguazio-system 07:41:43 ]->(0) ...
1
vote
2
answers
4k
views
Temporarily disable kubernetes liveness probes for a pod
I have a NodeJS app running inside a k8s pod and I want to take a heap dump of it.
In NodeJS taking a heap dump is time-consuming and blocks the main thread, so the pod is not able to respond to k8s ...
2
votes
2
answers
3k
views
Avoiding Azure.Identity.CredentialUnavailableException on the fresh startup
Short summary
When I deploy my application which uses Managed Identity to connect to the Service Bus instance, for a first couple of minutes I see a lot of Azure.Identity....
0
votes
1
answer
214
views
Kubernetes Kibana 8.5.2 Statefulset healthcheck path? Tried /login but "connection refused"
Kibana Statefulset:
readinessProbe:
httpGet:
scheme: HTTPS
path: /login
port: 5601
initialDelaySeconds: 20
...
0
votes
1
answer
153
views
how can I schedule Healthcheck in Kubernetes livenessProbe
since we need to stop a service in the kubernetes pot at night because we need to index something in our app(we also can't stop the pod because we need to index somethin in the pod.). While Index ...
2
votes
1
answer
3k
views
Kubernetes liveness/readiness checks with spring boot application on separate port
I've got a spring-boot application deployed in kubernetes, with actuator on port 8081. The main application is working on port 8080. When I describe the instance, the checks are failing:
$ kubectl ...
2
votes
0
answers
717
views
AspNetCore Health Check UI endpoint resolving
in my .NET5 API I added Health Check UI.
In ConfigureServices:
services.AddHealthChecks();
services.AddHealthChecksUI(opt =>
{
opt.SetEvaluationTimeInSeconds(15); //time in ...
4
votes
1
answer
4k
views
Kubernetes liveness probe fails when the logs show a 200 response
I am using https://pypi.org/project/django-health-check/ for my health checks in a Django app run through kubernetes_wsgi with the following YAML:
livenessProbe:
httpGet:
...
1
vote
2
answers
135
views
Do the # in front of success and failure in Kubectl pod Describe (Kubernetes) mean something?
Does the # in front of success and failure in a Kubectl describe (refer picture) meant to represent something?
All of the elements in each of those probes represent a config element for the probe but ...
0
votes
1
answer
398
views
How kubernetes handles unhealthy coredns pod?
The below snippet is taken from default Corefile of coredns.
data:
Corefile: |
.:53 {
errors
health {
lameduck 5s
}
ready
In this snippet, health ...
3
votes
2
answers
5k
views
NEG is not attached to any BackendService with health checking
I have a downtime on my app running on GKE when I deploy it using rolling update.
rollingUpdate:
maxSurge: 25%
maxUnavailable: 0
type: RollingUpdate
I've checked the events on my pod ...
1
vote
1
answer
694
views
Health checks for service returning 301 after updating deployment
We recently updated the deployment of a dropwizard service deployed using Docker and Kubernetes.
It was working correctly before, the readiness probe was yielding a healthcheck ping to internal ...
3
votes
1
answer
7k
views
Configuring the Health Check of a Kubernetes Ingress with Terraform
We are using an ingress (kubernetes_ingress.db_admin_ingress) to expose the service (kubernetes_service.db_admin) of a deployment (kubernetes_deployment.db_admin) in Google Kubernetes Engine (GKE) ...
0
votes
0
answers
579
views
Pod restart very often after adding resources
Pod restart very often after adding resources.
Before that the resources were not added.
The pod doesn't restart at all, or maybe it only happens once or twice a day.
I'm not sure if resources affect ...
0
votes
1
answer
477
views
How to simulate asp.net web API app to a deadlock or hung state?
I have an asp.net core 3.1 web api app. Can I write an end point by which if I call this the entire application will go into hung or deadlock situation? or a background task where I wrote some code to ...
0
votes
0
answers
483
views
Delay application startup till sidecar (hashicorp Vault) is up in Kubernetes Pods
I am looking for a way where we can start the (NodeJs) app server (i.e. delay it) only after vault agent is up. One way I can think, is to check the availability of the agent (by connecting to 8200) ...
11
votes
2
answers
12k
views
Spring Boot custom Kubernetes readiness probe
I want to implement custom logic to determine readiness for my pod, and I went over this: https://docs.spring.io/spring-boot/docs/current/reference/html/actuator.html#actuator.endpoints.kubernetes-...
0
votes
0
answers
204
views
openshift liveness probe to detect long running process
I have a python data load service. One of the steps in the service is to refresh multiple Oracle materialized views. We have noticed that the service often gets stuck at this step and the issue gets ...
0
votes
1
answer
497
views
Python3 Quart register_blueprint of python-healthz throws exception
I use flask and trying to migrate to quart in order to benefit from HTTP/2. I use flask-healthz for kubernetes readiness and liveness health checks. Is there any quart equivalent of flask-healthz?
I ...
4
votes
1
answer
13k
views
OpenFaaS : Receiving Timeout errors during health check of function Pod
Issue:
We have added health check configuration to our function. However pod becomes Unhealthy due to timeout error in liveness and readiness checks and consequently getting restarted.
However if I ...
0
votes
1
answer
895
views
how implement health check in the grpc-dart implementation?
I am trying to add grpc health check to my dart backend, but it seems that the grpc implementation in dart does not bring the service for the kubernetes health check, as in other grpc implementations, ...
6
votes
3
answers
9k
views
liveness and readiness probe for multiple containers in a pod
I would like to know if there is a possibility to apply liveness and readiness probe check to multiples containers in a pod or just for one container in a pod.
I did try checking with multiple ...
0
votes
1
answer
1k
views
How to avoid starting kubernetes pod liveness checks until all containers are running
I'm having trouble with health checks starting too early on a kubernetes pod with multiple containers. My pod is set up like this:
main-container (nodejs)
sidecar container (http proxy)
Currently ...
1
vote
1
answer
4k
views
Kubernetes liveness probe httpGet schema not working correctly
I am deploying some web app on kubernetes and I want to set liveness probe for this application.
When I configure my deployment with liveness probe, kubelet start health check. I was defined httpGet ...
2
votes
1
answer
3k
views
Kubernetes: Load Balancer vs Readiness health check
I'm running a WebService backend application in Kubernetes (GKE). It is used only by our frontend Web app. Typically there are sequences of tens of requests coming from the same user (ClientIP).
My ...
2
votes
2
answers
2k
views
Micronaut liveness always unknown
I'm currently trying to add liveness and readiness endpoints to my service to deploy it on k8s.
I'm using the latest micronaut release (2.5.4), and having the following setup:
application.yml:
...
1
vote
2
answers
2k
views
What is benefit of readiness probe and healthCheck?
I am working on an application that, as I can see is doing multiple health checks?
DB readiness probe
Another API dependency readiness probe
When I look at cluster logs, I realize that my service, ...
3
votes
1
answer
3k
views
Kubernetes Node healthcheck
I am trying to understand the Node-Controller in Kubernetes. Kubernetes documentation mentions that node heartbeats are done using NodeStatus and LeaseObject updates. Someone, please explain why both ...
2
votes
1
answer
4k
views
Add health check for Nginx in docker file
I have a WebAssmebly Blazor App that runs locally, I deploy it to Azure K8s cluster using Helm,
The app pod keeps restarting when I checked the logs its complaining about health check that are missing
...
8
votes
1
answer
5k
views
Kubernetes Health Check: timeoutSeconds exceeds periodSeconds
In Kubernetes Kubernetes Health Check Probes, what happens if timeoutSeconds exceeds periodSeconds? For example:
initialDelaySeconds: 10
periodSeconds: 5
timeoutSeconds: 10
successThreshold: 1
...
0
votes
2
answers
978
views
Are healthchecks defined per container or per pod in Kubernetes?
In Google Cloud blog they say that if Readiness probe fails, then traffic will not be routed to a pod. And if Liveliness probe fails, a pod will be restarted.
Kubernetes docs they say that the kubelet ...
2
votes
0
answers
1k
views
Istio: Health check / sidecar fails when I enable the JWT RequestAuthentication
OBSOLETE:
I keep this post for further reference, but you can check better diagnose (not solved yet, but workarounded) in
Istio: RequestAuthentication jwksUri does not resolve internal services names
...
1
vote
1
answer
2k
views
spring-boot RabbitHealthIndicator returns healthy on shutdown rabbitmq connections
We are using the default spring boot health checks - also for monitoring rabbitmq.
Unfortunately this doesn't work reliable. For example we have this in the log file:
2021-02-16 06:49:30.142 [AMQP ...
0
votes
1
answer
512
views
GKE ignores readiness probe from pod during high load
I have an app running in kubernetes, on a couple of pods. I'm trying to improve our deployment experience (we're using rolling deployment), which is currently causing pains.
What I want to achieve:
...
1
vote
1
answer
597
views
Expose Google Endpoint API on ingress
I have an API on google Endpoint, the backend is deployed on GKE and I'd like to expose it via an ingress so I can use IAP on it.
I am using ESP2.
I first deploy my service as a LoadBalancer and it ...
0
votes
1
answer
284
views
Cassandra health check in phantom
In our containerised scala application , we are using phantom library for persisting and retrieving data from Cassandra. We have a requirement to do regular health check on Cassandra.
Presently, on ...
1
vote
1
answer
2k
views
GKE RPC Health Check with multiple ports and different protocols under the same backend service
I am trying to spin up a third-party service that accepts connections in 4 different ports:
x-deployment.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: x-deployment
labels:
app: x
.....
2
votes
1
answer
1k
views
GCE health check not working with ingress nginx controller
I am installing nginx ingress controller (k8s.gcr.io/ingress-nginx/controller:v0.40.2) on a GKE cluster v1.17.12-gke.1504 with 3 nodes.
The ingress-nginx-controller is deployed as a Deployment; I don'...
4
votes
2
answers
6k
views
Kubernetes on Azure - liveness and readiness probes failing - Liveness probe failed with connect: connection refused
I'm a noob with Azure deployment, kubernetes and HA implementation. When I implement health probes as part of my app deployment, the health probes fail and I end up with either 503 (internal server ...
2
votes
7
answers
5k
views
Kubernetes liveness probe on a secure mTLS health check endpoint
I would like some help to solve a particular Kubernetes + mTLS problem please.
How to make Kubernetes liveness probe work on a secure https mTLS health check endpoint please?
My application is a web ...
1
vote
1
answer
6k
views
Continuous TLS handshake error logs in vault nodes due to LB health check
I am getting continuous TLS handshake errors every 5 sec due to my load balancer pinging vault nodes in every 5 seconds. Kube load balancer is pinging my vault nodes using
nc -vz podip podPort every 5 ...
1
vote
1
answer
446
views
HealthChecks Setup in Kubernetes
I've setup healthchecks for my app running in kubernetes.
https://github.com/Xabaril/AspNetCore.Diagnostics.HealthChecks/blob/master/doc/k8s-ui-discovery.md
I see the healthchecks working under /...
3
votes
2
answers
5k
views
what is the command to check zookeeper health check for liveness , readiness probes and to start , stop the zookeeper
i have tried the following commands to check the zookeeper health and its corresponding error i am getting
sh -c zookeeper-ready 2181 (error: zookeeper-ready command not found)
i have tried all echo ...
6
votes
1
answer
7k
views
Create JVM heapdump when K8s healthcheck restarts the pod - no OOM occur
I have a situation when all of a sudden a really long GC pause occurs and I need to find out what is the source of the sudden memory allocation. The long GC pause (around 30 seconds) causes the pod to ...
1
vote
1
answer
2k
views
Should I implement a dedicated api endpoint for Kubernetes health checks?
I have deployed a next.js frontend server and an express.js backend server on a Kubernetes cluster, which issues automated health checks, currently on the root path ("/") on the two servers.
My ...
11
votes
3
answers
8k
views
What happens to a Docker Container when HEALTHCHECK fails
The docker docs say what a HEALTHCHECK instruction is and how to check the health of a container. But I am not able to figure out what happens when healthcheck fails. Like will the container be ...
0
votes
1
answer
755
views
An alternative to Consul service TTL health check in Kubernetes
Consul has a TTL health check which status should be updated periodically over the HTTP interface.
From akka.net microservices we were performing the GET request to the registered Consul Service ...
1
vote
1
answer
298
views
Monitor license server for JProfiler
I would need to run EJ technologies license server for serving floating license for JProfiler. Furthermore, I need to monitor the service via monitoring solutions (i.e. prometheus), properly.
So ...