329
questions
0
votes
0
answers
18
views
Sending histogram data to grafana from statsd library of python
We are using statsd library in python to send some metrics to grafana. I am struggling to send histograms to grafana.
We use statsd-exporter and victoria metrics data store for the metrics in grafana.
...
0
votes
2
answers
184
views
Spring boot micrometer ignores management.metrics.export.statsd.host setting
I am trying to add StatsD metrics to a Spring boot application using Micrometer.
It works locally, but fails in production, logging errors saying that its unable to connect to localhost:8125 despite ...
0
votes
0
answers
52
views
gunicorn does not reconnect to statsd exporter automatically
My setup
I have a django app that is served by gunicorn. I use statsd in order to export API's metrics to a prometheus server. My statsd exporter is running on a container whose image is prom/statsd-...
0
votes
0
answers
94
views
apache spark metrics using StatsdSink
I am trying to monitor spark3 metrics using statdsink, prometheus and grafana but it looks like it is not sending driver, executor, stage and task level metrics. My cnfig file looks like below. I want ...
0
votes
0
answers
31
views
Monitor performance of a task in multiple processes
I have a task that starts in one process and ends in another. I like to monitor performance of the task from start to end.
As the processes are running in different machines, I cannot trust their ...
0
votes
0
answers
40
views
Flink StatsD Integration not pushing data to StatsD
We are using Flink 1.15.3 We added the below configuration to the flink-conf.yaml file
metrics.reporters: stsd
metrics.reporter.stsd.factory.class: org.apache.flink.metrics.statsd....
0
votes
0
answers
160
views
Setting a custom statsd stat_name_handler in Airflow 2 (GCP Composer)
I'm trying to set a custom statsd stat_name_handler for Airflow 2.6.3 (part of GCP Composer 2) to prevent the DAGs from failing with airflow.exceptions.InvalidStatsNameException - e.g. due to the ...
0
votes
1
answer
390
views
How to log to StatsD using FastAPI and Gunicorn
I have a FastAPI that I am serving up using gunicorn. I am trying to send statistics to a DataDog agent on localhost that's running StatsD (DogStatsD) using the statsd_host argument described in the ...
1
vote
0
answers
56
views
Druid Datadog integration not displaying any metrics
We are looking into integrating datadog with our druid deployment. I have gone through the datadog document for druid integration and added the following to my druid configuration:
...
0
votes
1
answer
53
views
multiple destination for statsd in object-server.conf of swift open stack
I want to send my statsd metrics from object server module of swift open stack to multiple hosts.
How should I change my object-server.conf in /etc/swift path?
The present version of object-server....
0
votes
0
answers
90
views
Metrics not send to telegraf using python and statsd
I written a python code to create metrics and send them to telegraf and create graphs in grafana.
I use prometheus + telegraf + grafana stack. the problem is that there is no error in my python code ...
1
vote
1
answer
683
views
Could not connect statsd exporter to AirFlow
I'm trying to connect statsd exporter to airflow, but when I set statsd_on = True in airflow.cfg and try to restart airflow-webserver I get
ERROR - Could not configure StatsClient: No module named '...
0
votes
1
answer
285
views
MeterRegistry HealthIndicator how to use Gauge gauge to report data when observed
I am using statsd mertics, right now I am trying to add metric healthIndicator
public class xxxHealthIndicator implements HealthIndicator {
private final xxx xxx;
private final MeterRegistry ...
1
vote
1
answer
257
views
"could not parse dogstatsd metric values: strconv.ParseFloat: parsing "false": invalid syntax" error in flink application
For a flink application, I am publishing flink metrics using StatsdReporter on Datadog.
Getting errors in log:
.isBackPressured:false|g"': could not parse dogstatsd metric values: strconv....
0
votes
0
answers
73
views
I'd like to send a free text String to Grafana via statsD and Prometheus
There are many statsD metrics. Some count slow producer events, slow consumer events and exception events. For these types of metric I'd like to send a text string which is displayed in Grafana next ...
1
vote
0
answers
205
views
SparkSession configuration at the Job level is not getting applied; Spark Cluster configuration is overriding it
I am trying to get the spark default metrics from the application to statsd sink at Job level not cluster level. So I configured the necessary configuration in the Spark session in code. And in a ...
0
votes
2
answers
959
views
What hostname should I use for sending custom metrics to datadog's agent, inside k8s?
I've got a k8s cluster where the datadog's helm is installed.
I want to send custom metrics to the datadog's agent, but I don't know what value to set for the dogstatsd client host.
These agents are ...
0
votes
0
answers
296
views
Got "Servname not supported for ai_socktype" when deploy Karapace Schema Registry
I am trying to deploy Karapace which in a local Kubernetes based on Karapace's docker-compose.yml.
Karapace includes Kafka Schema Registry and Kafka REST.
Here is a copy:
version: '3'
services:
...
0
votes
1
answer
307
views
is there any good way to monitor apache beam dataflow job pipeline state?
We have a dataflow job which we want to monitor using StatsDClient, so we want to send a metrics from Dataflow job to our telegraf through StatsDClient to get heart beat of the dataflow job inorder to ...
0
votes
1
answer
573
views
DogstatsD not sending JVM runtime metrics from Google App Engine flex environment
According to DataDog JVM metrics collection is enabled by default for Java tracer v0.29.0+
https://docs.datadoghq.com/tracing/metrics/runtime_metrics/java/
My agent is running and trace metrics are ...
0
votes
0
answers
366
views
How to push array of objects to grafana with statsd to create gauge dashboard
I want to push with statsd (prometheus) an array of objects containing user_id and other properties specific to said user. The goal is to be able to display on a graph a number of user depending on ...
0
votes
1
answer
566
views
How can I get envoyproxy/ratelimit statistics for descriptors without value?
I am using envoyproxy/ratelimit (along with Istio) to setup a global rate limiting in my k8s cluster for a given service. The rate limit is based on a header (in my case the username) so that each ...
3
votes
0
answers
965
views
Airflow doesn't send all the metrics by statsD
I have enabled the statsD monitoring in airflow.cfg
[metrics]
# StatsD (https://github.com/etsy/statsd) integration settings.
# Enables sending metrics to StatsD.
statsd_on = True
statsd_host = ...
5
votes
2
answers
2k
views
How to sum up a series of Gauges in Prometheus?
I´m converting a statsd metric to Prometheus to be graphed in Grafana.
This is a gauge being reset every 1m, showing requests in the past 1m.
Prometheus is scraping every 15 secs.
I´d like to produce ...
4
votes
1
answer
1k
views
How to get Micrometer to output all custom metrics
I am using Micrometer 1.9.0 and Spring boot 4.2.16 to report metrics to DataDog over StatsD. Some metrics are showing up, but very few. Using the Metrics Explorer in DataDog, it's very hard to find ...
0
votes
1
answer
557
views
Docker wont start, Exited with ': No such file or directory
I am having a problem starting a docker container with statsd sevice with some ruby script. It is a simple container from this github page - https://github.com/morganjbruce/microservices-in-action/...
1
vote
0
answers
420
views
What is `distributionStatisticExpiry` and `distributionStatisticBufferLength` in micrometer java lib?
We use Timer from StatsdMeterRegistry to track the remote API requests duration (p95 percentile). From the JavaDocs not really clear how distributionStatisticExpiry and ...
0
votes
1
answer
662
views
How to calculate apache airflow sensor total execution time
sensor_job = PythonSensor(
task_id='sensor_id',
python_callable=call_jobsensor,
poke_interval=10,
timeout=7 * 60,
mode='reschedule',
...
1
vote
1
answer
820
views
How to use micrometer @Timed in not spring application
I've an app, which implemented in pure java + apache kafka streams (not spring app). I need to add micrometer and custom metrics. How to do that? Can I use @Timed annotation on the methods?
What about ...
2
votes
0
answers
626
views
CPU and Memory metrics in Prometheus format for a Gunicorn application
I am currently working on a CI/CD deployment of an application written in Python which runs on Gunicorn in K8's. I am using HELM chart to do the deployments. Application has already StatsD ...
0
votes
1
answer
1k
views
How to filter metrics based on airflow dags in statsd?
I am looking for a way to filter out airflow metrics for other dags send over through StatsD. There is this document in airflow showing how to setup statsD which is responsible for metric gathering in ...
1
vote
0
answers
1k
views
Datadog unique occurences by one tag and creating pie chart on another tag
I have a counter metric in datadog with tags of id and type. There could be multiple occurrences of a particular id, and a specific id always has the same type. I want to get the unique id occurrences ...
3
votes
0
answers
1k
views
How to enable StatsD in Spring Boot?
I have Spring Boot 2.5.2 and I am trying to send StatsD metrics to Datadog. However, that didn't work for me. So I wrote a single python script to check if my application is sending any data or not.
...
0
votes
1
answer
770
views
Prometheus rate() function for a counter incrementing by 1 per second
I've setup a simple statsd to Prometheus integration to understand how the rate() function works. I have the following script which publishes a counter value of 1 every second to statsd.
import os
...
1
vote
1
answer
1k
views
Prometheus is not scraping stats d exporter
I am extremely new to docker,k6, Prometheus,statds.
Scenario- Create a docker compost file which will run create
K6 load test which has custom metrics. Send the result to Statsd Exporter (The idea is ...
0
votes
1
answer
1k
views
How to add additional statsd mapping config in airflow helm chart
In standalone statsd-exporter we can add statsd config mapping file (yml) to parameter --statsd.mapping-config (reference), so we can mapping metrics that send from airflow. But when I use airflow ...
2
votes
2
answers
839
views
StatsD displaying "go_gc_duration" metrics but not the airflow metrics
We have installed statsD exporter by following steps..
pip install 'apache-airflow[statsd]'
Added below config details
statsd_on = True
statsd_host = localhost
statsd_port = 8125
statsd_prefix = ...
0
votes
0
answers
2k
views
Set Prefix to Spring Micrometer Merics using Statsd and Datadog
I'm trying to Implement Custom Metrics Integration for my App. Using the following setup
// DogStatsd Metrics Integration with MicroMeter
implementation group: 'io.micrometer', name: 'micrometer-...
2
votes
2
answers
610
views
How can I detect stuck Airflow jobs?
My team and I are on Airflow v2.1.0 using the Celery executor with Redis. Recently we’ve noticed some jobs are occasionally running until we kick them (many hours, sometimes days—basically until ...
1
vote
2
answers
6k
views
Not able to see metrics on datadog sent by statsd
I am trying to integrate statsd+datadog.
I have launched the dd-agent container with -e
DD_DOGSTATSD_NON_LOCAL_TRAFFIC="true" , and apiKey is also correct
(container logs confirm this)
I am ...
1
vote
2
answers
846
views
Implement tags in python statsd library?
I am trying to use the tags feature in statsD. But in python statsD there is no feature for tags. But in the documentation they recommended alternatives to implement tags that is statsd-tags.
I have ...
3
votes
0
answers
2k
views
How to send Airflow Metrics to datadog
We have a requirement where we need to send airflow metrics to datadog. I tried to follow the steps mentioned here
https://docs.datadoghq.com/integrations/airflow/?tab=host
Likewise, I included statsD ...
2
votes
0
answers
286
views
What are the benefits of using statsD with cloud-watch-agent over AWS SDK?
We are currently sending metrics to Cloudwatch for every request using AWS SDK(putMetric call).
I was exploring another solution and there is one where we can use statsD with an cloudwatch-agent which ...
0
votes
1
answer
1k
views
What is the best way to represent a chart of distribution of time intervals in Datadog?
I have a server that processes packets from different devices. Devices can report in different intervals.
I would like to make a chart showing the distribution of intervals by the count of devices (...
0
votes
1
answer
467
views
counter and timer with the same pattern do not work (Prometheus)
I've faced with a problem that I'm using counters and timers with the same metric name:
my.controller.action:305|ms
my.controller.action:2|c
Created a mapping like this:
mappings:
- match: "my.*....
0
votes
1
answer
66
views
lever 5 times that you will get your 3rd Green Light on the 5th pull of the lever
Assume P(Red Light) = .40 and P(Green Light) = .60.
2
votes
0
answers
1k
views
How to view statsD events in Datadog?
I am using statsD (hot-shots) to try log events in datadog such as when a new item is created and by who but, when I am calling statsD.event('title', 'description') I do not see any events in datadog ...
2
votes
1
answer
176
views
can graphite or grafana used to monitor pyspark metrics?
In a pyspark project we have pyspark dataframe.foreachPartition(func) and in that func we have some aiohttp call to transfer data. What type of monitor tools can be used to monitor the metrics like ...
0
votes
0
answers
252
views
Visual Studio 2019 .cs file not found when referencing nuget package for Statsd
I installed the StatsdCsharpClient package via NuGet. When I run my code via VS, I get .cs file not found when referencing NuGet package for Statsd.cs Not found and another file and in the details it ...
0
votes
1
answer
58
views
How to Decompose Global System Metrics to a Per Endpoint Basis on a Webserver
I'm implementing a metrics system for a backend API at scale and am running into a dilemma: using statsd, the application itself is logging request metrics on a per endpoint basis, but the CPU metrics ...