Questions tagged [datadog]
Datadog is a monitoring service for IT and DevOps.
1,075
questions
0
votes
0
answers
8
views
Tomcat Jmx Inegration enabling on Datadog Agent
I am trying to add Tomcat-JMX Integration to the Datadog Agent, in order to achieve Remote Monitoring .
I am following the docs https://docs.datadoghq.com/containers/guide/autodiscovery-with-jmx/?tab=...
0
votes
0
answers
7
views
How to display value of a datadog log facet, as a query value widget on a datadog dashboard?
I am currently sending json data from AWS Lambda to Datadog, via AWS Kinesis Firehose. The data has key value pairs, for example { "active_count": 10000, "deleted_count": 100, ...}....
0
votes
0
answers
15
views
How can i add custom tags to my SNS events that gets sent to Datadog Event management
I am trying to add custom tags to SNS messages that are sent to Datadog from an AWS Lambda function written in Python. The Datadog events only have the default tags. How can I add custom tags to the ...
0
votes
0
answers
23
views
Webflux async requests showing up as different traceIds in datadog
We are using datadog in our webflux application, and the spans are showing as expected. However, they're not in 1 specific resource traceId, but rather broken down into different traceIds. I want to ...
0
votes
1
answer
14
views
pulumi yaml file to set config in values.yaml
I´m qite new at pulumi (I´m more a terraform guy).
I´m working in a legacy code which deploys helm charts into kubernetes. (splunk, Datadog, etc).
They are using python for this.
In code I see that ...
0
votes
1
answer
37
views
What would be optimal thresholds for JVM Heap Memory alerts in DataDog?
I'm working on creating Datadog alerts to alert teams when their services are on a certain percentage of JVM Heap Memory. However, I have a hard time figuring out what thresholds would be somewhat ...
0
votes
0
answers
16
views
Datadog: how to trigger a notification when a new DD_VERSION is detected by APM?
I'm using Datadog APM, exporting the version / tag when I'm deploying a new container:
DD_VERSION=x.y.z
Further information on this link
Now, quite simply, is there a way to create an event or "...
0
votes
0
answers
13
views
opentelemetry-collector-contrib to exporter traces on datadog
I am configuring opentelemetry-collector-contrib to export traces on datadog.
I tried this below references :
https://docs.datadoghq.com/opentelemetry/
https://github.com/open-telemetry/...
0
votes
0
answers
11
views
GPU metrics in Datadog
I'm using GPU Operator and DCGM exporter for collecting GPU metrics on AWS EKS cluster.
How can I configure Datadog to scrape custom GPU metrics from DCGM exporter (/metrics path and port 9400) ...
0
votes
0
answers
20
views
How we can delete the logs in DataDog using a search query?
I want to delete a set of logs under a specific Source. In Splunk, there is a delete command that we can use with search queries, as mentioned below:
index=myindex ... | head 100 | delete
Can we do ...
0
votes
0
answers
28
views
How to locate a Checkbox item in Datadog synthetic test with Terraform
I'm building a Datadog's Synthetic Browser test with Terraform, but I'm facing issues to address this HTML element:
<input type="checkbox" name="payrollInstructionIds" value=&...
0
votes
0
answers
18
views
Is it possible to send custom metrics to the DataDog server through the java agent?
We are running our spring boot java app with datadog java agent in kubernetes using this command:
java -javaagent:/dd-java-agent.jar -Ddd.profiling.enabled=false -jar /myapp.jar
We want to send custom ...
1
vote
1
answer
64
views
Understanding Prometheus JVM metrics
I am interested in tracking two metrics within JVM - Number of GCs per minute and Time Spent in GC per minute. I have metrics jvm_gc_collection_seconds.count and jvm_gc_collection_seconds.sum ...
0
votes
0
answers
22
views
Creating a Datadog monitor with exception message
i have created a Datadog Metric monitor for a requirement , if there is any specific error messages thrown( say : value cant be null.) in the stack dump. i need to alert and trigger this monitor and ...
0
votes
0
answers
11
views
Extracting attributes out of json logs in DataDog
Some of our log lines look like:
2023-11-09 13:26:00 [scheduling-1] INFO com.events.debeziumconnectorservice.debezium.Listener - {"MilliSecondsBehindSource":"1000836"}
Can I draw ...
0
votes
0
answers
13
views
Trigger data dog alert when metric is true in consecutive time period - Data Dog
I was trying to configure data dog alerts for my server. I send a value 1 when the server is up and value 0 when the server is down every minute. I set up a simple monitor with the condition min
...
-3
votes
1
answer
32
views
Massive spike in stolen CPU
One of our t2.medium servers suddenly started showing up massive stolen CPU spikes. As far as I can tell, there was no sudden increase in traffic... they just started randomly on a server that has ...
0
votes
0
answers
48
views
How to Send traces to datadog without using installing the agent?
I'm working on a mulesoft project with 3 APIs, I've created traces with spans from each process using mulesoft's dataweave, but I can't figure out if there's an API endpoint to send traces to.
I know ...
0
votes
0
answers
15
views
how to find root spans with lots of children (N+1 queries) in datadog apm traces?
I've noticed a few N+1 queries in our graphql app. The fix in each case is to add a dataloader to the first repeated query, but finding them is hard.
I would like to find all requests that have this ...
1
vote
0
answers
31
views
facing Datadog APM integration Issue with php application
We are getting below issue.
datadog.trace.agent.common.writer.ddagent.DDAgentApi - Error while sending 14 (size=6KB) traces. Total: 14, Received: 14, Sent: 0, Failed: 14. java.io.IOException: No such ...
0
votes
0
answers
54
views
Spring boot/ Datadog- Logs Show Info Status For Warnings Or Errors
I'm working with spring boot 2, java 11 and Datadog. I have this problem:
Logs Show Info Status For Warnings Or Errors.
https://docs.datadoghq.com/logs/guide/logs-show-info-status-for-warnings-or-...
1
vote
1
answer
56
views
Datadog trace in consumer queue
I have script consumer.php(listener queue from rabbit)
<?php
namespace App\Queue\Receivers;
class CronReceiver extends BaseReceiver
{
public function handle(AMQPMessage $msg): void
{
...
0
votes
1
answer
46
views
How to override, by code, sink properties set by appsettings
My ASP.NET Web Api has appsettings.json specifying Serilog with Serilog.Sinks.Datadog.Logs.
This works fine, however, the arg "apiKey" is specified in clear text which breaks our company ...
0
votes
0
answers
73
views
Add an agent to a Quarkus native image
I'm trying to build a Quarkus project native image, and I need to introduce the Datadog agent to it. The Datadog documentation says:
/mvnw package -Dnative
-Dquarkus.native.additional-build-args='-J-...
0
votes
0
answers
43
views
How to alert when specific HPA's desiredReplicas is not equal to currentReplicas
I have kubernets setup where I am implementing KEDA solution for autoscaling. KEDA is creating HPA for autoscaling and I would like monitor this solution to see if only HPA that is spun up by KEDA is ...
0
votes
1
answer
34
views
Combination of @statsd.timed and @swag_from decorators causes FileNotFoundError
I have a working Flask endpoint decorated with flasgger.swag_from decorator:
from flasgger import swag_from
@app.route("/jobs", methods=["GET"])
@swag_from('swagger/get_jobs.yml')
...
0
votes
0
answers
74
views
How to send AWS MWAA cluster metrics to DataDog?
AWS's Managed Workflows for Apache Airflow (MWAA) provides cluster metrics like the CPUUtilization and MemoryUtilization for the BaseWorker, Scheduler and WebServer. I would like to have these in ...
0
votes
1
answer
37
views
How to combine monitors in Terraform which are dynamically generated?
Two monitors get created (MonitorA(service1) , MonitorA(service2)) from an iteration. Example:
services= ["service1", "service2"]
resource "datadog_monitor" "...
0
votes
0
answers
25
views
Cloud function for check monitors status via API and send it to a Bigquery table
I need help creating a Google Cloud function that will retrieve the result of an API request, and integrate it into a BigQuery table.
I don't see any documentation on the internet, if anyone has ...
0
votes
0
answers
18
views
How to send java application metrics (Garbage Collection, JVM) from a Kubernetes pod to DataDog
I am running a java application on a pod in the Kubernetes cluster. this is monitored by DataDog. so far pod logs are appearing in the datadog console. Now I got a new requirement to collect ...
0
votes
0
answers
17
views
Optional attributes - DataDog monitor
I'm programming a DataDog monitor, and I want to include the attributes of the event in the notification message. My query looks like this:
logs("service:<SERVICE NAME> @level:ERROR @...
0
votes
0
answers
44
views
How to reduce execution time of GraphQL data fetching
If I start with a large GraphQL query that has 600+ spans on the dataFetching graphql resource, and I extract part of the query so that there are only 200 spans on that resource, the execution time of ...
0
votes
0
answers
10
views
create Datadog monitor for ordered sequence of logs
i've recently had a bug in which there is a sequence of 3 logs that indicate this bug has occurred:
1.Entered GetCampaignDetailsForEdit for planId: 70138
2. AsyncExecution >> Create >> ...
0
votes
0
answers
41
views
Windows env variable in Datadog Agent Configuration Files
We are using Datadog for processing our application logs. For each application we have a conf.yaml-file for setup:
logs:
- type: file
service: "auditor-service"
path: "C:\\...
0
votes
0
answers
29
views
Best way to filter system logs using Datadog + GKE?
I've recently set up datadog agent on a K8s cluster in GKE. The cluster is ran using GKE autopilot. Logs are being collected from my services, but they are also being collected from internal services ...
0
votes
1
answer
37
views
DataDog Package does not exist
The Problem
I try to import DataDog dependencies with Maven and mvn clean install prints:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.11.0:compile (default-compile) ...
0
votes
1
answer
98
views
Errors when setting up DataDog Database Monitoring for Azure SQL DB
I've been following the instructions here to setup DataDog to monitor one of our Azure SQL DBs. However, when I restart the DataDog agent I see the following error in the logs:
Error running ...
1
vote
0
answers
32
views
Open Telemetry datadog exporter sending duplicate metric
I have otel collector running on each k8s node (EKS) as daemonset and has exporter set as datadog. I noticed when metric is shipped from datadog otel exporter, its duplicated. Because in the host tag ...
0
votes
1
answer
59
views
Get Persistent Volume Source from inside Java Application
I have a java application that is deployed in a kubernetes cluster and logs to DataDog.We want to add a custom attribute to our logs, which is the server host of the PV/PVCs it's reading data from. Is ...
0
votes
0
answers
12
views
Can you nest queries in Datadog?
I'd like to be able to nest one query within another in Datadog. For example, if I have a log of web requests and each request has a x_session_id I'd like to be able to search for a specific set of ...
2
votes
1
answer
551
views
Spring Boot 3.x Observability with Micrometer & Datadog for HTTP services and Kafka Consumer
I am trying to utilise the Observability API from Spring Boot 3.x in my application for tracing and metrics but I'm confused with the necessary setup on how to get proper traceability and metrics ...
0
votes
0
answers
39
views
How to configure Datadog alert when things are stuck in the queue for more then 2 hours?
I want to get notified when any errors or logs are stuck in queue for more then 2 hours. how can I setup Datadog alert for that.
I tried this way. I set "If this monitor stays in Alert or No Data ...
0
votes
1
answer
116
views
How to define individual service name for each type of Opentelemetry auto instrumentation in a python application?
We are currently using Datadog for monitoring and observability in our application, and we have integrated OpenTelemetry for distributed tracing.
We have encountered one main issue
Span Separation: ...
0
votes
0
answers
20
views
Is there a way to use a facet and a plain text in logs search on Datadog?
For some reason unknown to me, when I use a facet and just plain text search on datadog, no logs come up (image below). But when I remove either the facet or the text, I get logs.
I'm trying to ...
0
votes
0
answers
29
views
How to download all Datadog RUM data without facing API limits?
I'm attempting to download all data from Datadog RUM. I've tried using curl along with the official Datadog API, but I constantly hit data limits each time.
Here's what I've tried so far:
curl -X POST ...
0
votes
1
answer
39
views
opentelemetry datadog exporter: how can use a kubernetes secret?
I am trying to configure opentelemetry to export logs to datadog. I am using the opentelemetry operator. I have the following yaml:
apiVersion: opentelemetry.io/v1alpha1
kind: OpenTelemetryCollector
...
0
votes
1
answer
201
views
Datadog python tracing floods with logs and errors
I tried to remove datadog python tracing on my Ubuntu server with pip uninstall ddtrace, but it seems smth went wrong
When I try commands like pip freeze or even supervisorctl status
I receive that ...
0
votes
0
answers
64
views
Datadog Wildfly collection produces error: java.lang.IllegalArgumentException: Parameter 'name' may not be null
I want to configure Wildfly metrics collection using Datadog.
I am able to connect the agent and upload data to Datadog servers.
I am able to collect general information and I also see the info in ...
0
votes
2
answers
75
views
Removing x_datadog_kafka_produced header from Kafka produced message
We are using spring-kafka library to publish messages on to the kafka topic. We also have datadog to monitor kafka queues.
When publishing a message, x_datadog_kafka_produced header gets injected into ...
0
votes
0
answers
48
views
To enable datadog extension, will i have to disable Datadog forwarder?
I have been trying to enable Datadog extension using,
datadog-ci lambda instrument -f -f <another_functionname> -r <aws_region> -v 80 -e 48
which has been provided in Datadog Docs, https:/...