Questions tagged [amazon-cloudwatch]

Amazon CloudWatch provides monitoring for AWS cloud resources and the applications customers run on AWS. Use this tag when asking about CW features such as metrics or alarms. Use amazon-cloudwatchlogs instead when asking about log groups, log streams, and metric filters.

Filter by
Sorted by
Tagged with
0 votes
1 answer
23 views

Why is the SampleCount in CloudWatch plots too low?

I've started a script using Amazon SageMaker that repeatedly prints a log message Finished game X where X is incremented each time. I want to plot the progress of that script using CloudWatch, so I ...
Christopher's user avatar
  • 2,005
0 votes
1 answer
19 views

Is there a more graceful way to ignore the initial event callback when schedule is Rate based

I have a multi-step process that calls back into a single Lambda on different intervals. On paper this seemed very clean, however, I found that rate-based scheduled events are invoked as soon, or soon ...
Ross Bush's user avatar
  • 14.8k
0 votes
0 answers
23 views

Fluent Bit doesn't create log stream in CloudWatch [closed]

Fluent Bit sends only the first logstream and the others not. This is my configuration: config: inputs: | [INPUT] Name tail ...
monstermuffino's user avatar
0 votes
0 answers
13 views

Count of AWS Lambda invocations seems too low

I have an API Gateway with a custom authorizer, which manages rate limiting for my API layer. Therefore, it cannot be cached as it has to calculate if a requester has reached their rate limit on every ...
slatermorgan's user avatar
0 votes
1 answer
10 views

Logstash in ECS with cloudwatch plugin keeps crashing. Why is it throwing this error?

So I added the following inputs to my logstash configuration so we can start ingesting cloud watch metrics input { cloudwatch { namespace => "AWS/Logs" metrics => [ ...
Michael Gutierrez's user avatar
0 votes
0 answers
10 views

How can I get information on EventBridge Pipes errors?

I can see that an EventBridge Pipe is failing (see screenshot), but I can't see a way to get information on the error. I can't see any cloudwatch group. What is the mechanism to see the details of ...
Dr. Thomas C. King's user avatar
0 votes
0 answers
9 views

why does amazon-cloudwatch-agent send prometheus metrics to log groups?

Using the cloudwatch-agent, I can send log files as well as metrics to Amazon cloudwatch. For example I can send metrics for memory usage like this in my config: { (...) "metrics": { ...
Nathan's user avatar
  • 7,129
0 votes
0 answers
13 views

AWS how do I get notified when lambda is disabled | Alert when lambda trigger get enable or disable

Some one disable our lambda trigger(Kinesis event) Need alert or notification if someone enable or disable lambda trigger
Alkesh Mahajan's user avatar
0 votes
0 answers
21 views

AWS CDK Aurora Serverless PostgreSQL - CloudWatch log export issue

I am deploying an AWS Aurora serverless PostgreSQL database using AWS CDK. I've encountered an issue where I'm receiving the following error: Aurora postgres Serverless currently doesn't support ...
Jaynil Savani's user avatar
0 votes
0 answers
13 views

AWS athena dpu usage

How can we caluculate the dpu usage of aws athena in real time.we had gone through all the cloud-metrics but there is no metric to show the dpu usage. to create an alaram that have to shown in real ...
Manu Manu's user avatar
-1 votes
1 answer
20 views

Terraform Error: creating CloudWatch Alarm ValidationError - Invalid metrics list status code 400

I'm attempting to create a CloudWatch anomaly detector alarm for my Kinesis data stream using Terraform. I made the following setup based on the official Terraform xx_anomaly_detection example in ...
mmarion's user avatar
  • 857
0 votes
0 answers
20 views

Aggregate logs message with same timestamp with AWS CloudWatch CLI

I have this query: display @timestamp, @message | sort @timestamp asc | filter @message not like "GET / HTTP/1.1"' But some logs messages are split in several @message field, even if their @...
Howins's user avatar
  • 511
0 votes
1 answer
19 views

How can I exclude the @ptr field from my CloudWatch Logs Insights query?

I have this AWS CloudWatch query, that I've created via the AWS CLI with aws logs start-query: display @timestamp, @message | sort @timestamp asc | filter @message not like "GET / HTTP/1.1"' ...
Howins's user avatar
  • 511
1 vote
0 answers
61 views
+50

Dynamic logs not coming on aws cloudwatch

I am trying to integrate AWS Cloud watch with my application but facing multiple issues. I have tried multiple things but couldn't get success. Also, I don't see any good documentation for the aws ...
Aniket Tiwari's user avatar
0 votes
1 answer
15 views

Parse CloudWatch Insights Logs

I am trying the parse some cloudwatch logs to build visual (pie chart, bar chart) representations. My log data is in JSON format and looks like below: { "feature": "Feature 1", ...
nbe's user avatar
  • 23
0 votes
0 answers
15 views

SQS : ApproximateAgeOfOldestMessage metrics - 5 times than expected

I have a metrics and alarm set on our DLQ's metrics - ApproximateAgeOfOldestMessage. Threshold : ApproximateAgeOfOldestMessage >= 345600 for 1 datapoints within 5 minutes 345600 ~= 4 days. Sharing ...
coderAJ's user avatar
  • 310
0 votes
0 answers
15 views

Airflow Logs Not Showing in CloudWatch for ECS Deployment

Description: I'm encountering an issue with Airflow when deploying it on AWS ECS and using CloudWatch for remote logs. Specifically, for some of our DAGs, the logs are not showing up in CloudWatch. ...
sel-nef's user avatar
  • 59
0 votes
1 answer
18 views

Trigger an AWS CloudWatch alarm on past data points

I have CloudWatch metrics that are published asynchronously and sometimes with data points from the past. For example, today, metrics can be published for data points from last week. The PutMetricData ...
pierre-vr's user avatar
0 votes
0 answers
8 views

Custom Metrics in CloudWatch

I am publishing my automation execution metrics to cloudWatch. The object which is getting logged is this - @input structure request { executionDetails: ExecutionDetails success: Integer ...
Mahima's user avatar
  • 188
0 votes
0 answers
11 views

I can see the metrics using localhost:9106/metrics but NOT in the web console from Prometheus

I have a issue, I can see the metrics using localhost:9106/metrics TYPE aws_applicationelb_new_connection_count_sum gauge aws_applicationelb_new_connection_count_sum{job="aws_applicationelb",...
Eliel Bloemer's user avatar
0 votes
0 answers
19 views

AWS Lambda logging into CloudWatch group logs events twice

for mobile app dev purposes, we introduced AWS Lambda capable of logging into predefined CloudWatch logGroup and logStream Simplified Node.js Lambda: export const handler = async (event: ...
Tomáš Mika's user avatar
0 votes
1 answer
22 views

Seeking Guidance on DynamoDB Triggers with Custom Conditions for Lambda

I have a DynamoDB table in AWS and I'm trying to set up a trigger for a Lambda function based on the following two conditions: If the count of items with the attribute "status" set to "...
Ahsan Qadeer's user avatar
1 vote
0 answers
24 views

Calculate Average transaction per second of aws lambda using cloudwatch metrics

How to derive the average tps of a lambda using cloudwatch invocation metrics ? For a period of 12 hours , there were more than 10000 invocations happened. But when I change statistics to average /...
ani's user avatar
  • 456
0 votes
0 answers
10 views

AWS Metric Filter in Cloudwatch split function

I am having below log trail,from which I am interested in getting the alarm setup for duration going above 10000ms,I am not able to split ms 2023-08-28 11:57:58,204 INFO [server.log.api40] service ...
Unicorn's user avatar
0 votes
0 answers
30 views

Unable to See Redis Logs in AWS CloudWatch for Elasticache Redis Cluster 7.0.7

I'm currently using AWS Elasticache for Redis with the cluster engine version 7.0.7. I've enabled both engine logs and slow logs to be sent to a CloudWatch log group. "Permissions are set ...
gamechanger17's user avatar
0 votes
0 answers
17 views

Sending AWS Glue metrics from aws cloudwatch to prometheus using prometheus cloudwatch exporter

How can we send AWS Glue metrics to prometheus by using cloudwatch_exporter? and Configuration files for aws glue metrics I am trying to retrieve aws cloudwatch metrics to prometheus and I am ...
Archana's user avatar
0 votes
0 answers
9 views

Display AWS CloudWatch query result based on logStream creation time

given the following AWS CloudWatch log query: fields @logStream, @timestamp, @message | filter @message like "- PerformanceTests" | parse @message /PerformanceTests\/(?<testCase>\w+?):\...
Moravas's user avatar
  • 89
0 votes
2 answers
37 views

How to ensure a SNS topic has a subscription?

I have a stack defined in cdk that consists of an SNS topic in one AWS account and a SQS queue subscribed to the topic in another. I am worried that there could be a case where the subscription fails ...
Jgible's user avatar
  • 55
0 votes
0 answers
30 views

How to send an AWS SNS mail, and what are the prerequisites for it's implementation?

I have a glue job which runs from a python script. I want to implement a way such that if any job run fails then a sns mail trigger to the recipents about the job failure along with it should have the ...
RAHUL DHANOLA's user avatar
0 votes
0 answers
13 views

AWS Cloudwatch calling EC2 service restart

I am a total noob in AWS Cloudwatch. We have an existing cloudwatch alarm for app1 and once this alarm is hit... it causes some issues on app2. The reason was, when this alarm from app1 is sent, this ...
Borgy Manotoy's user avatar
0 votes
0 answers
40 views

Does AWS CloudWatch has a limit to log group size?

I am getting billed for 37TB of data written to my log group. However, all I can find is 1.23 TB in my log group. I have some other log groups but they have around 10MB worth of logs, not even close ...
Miloš Milutinov's user avatar
0 votes
0 answers
27 views

AWS Cloudwatch Canary - Nodejs puppeteer - searching for text in XML output

I have built a cloudwatch canary using the gui, it has generated some code for me which I have adapted. The idea is simply to query a web page which returns back some XML that looks like this: <...
Martin W's user avatar
  • 392
0 votes
1 answer
37 views

Terraform error - Extra characters after interpolation expression

I'm trying to pass a terraform variable to templatefile like the following: templatefile("${path.module}/functions/nodejs/node_modules/up.js", { canary_url = var.canary_url }) where ...
Mohammed Salah's user avatar
0 votes
0 answers
13 views

How much time does AWS Cloudtrail to update its logs

After performing multiple console-signin events, the event history log in Cloudtrail has yet to update even after waiting a long time. I tried refreshing after every 10 minutes to no avail. There is ...
Javin's user avatar
  • 124
-1 votes
0 answers
33 views

Log4J logging multiple requests into single event

Field Value @ingestionTime 1694539137688 @log Test/log @logStream Test/logstream @message {"mdc":{"HEADER":"4f58a518-1621-481d-a1d2-497f602f6061"},"message&...
BigGuyVV's user avatar
0 votes
0 answers
20 views

Inactivity Stop Alarm with AWS Cloudwatch | Unexpected behaviour

I have read the following sections of AWS documentation Metric alarm states Evaluating an alarm Alarm actions Configuring how alarms treat missing data I'm still having trouble with the settings to ...
Tomás Pastore's user avatar
0 votes
0 answers
20 views

Manage log stream while forwarding EventBridge logs to Cloudwatch on AWS

I am using an integration between AWS EventBridge and Okta to forward Okta logs to AWS. The integration allows me to push the logs to EventBridge using Okta's official partner event source, but I ...
spotHound's user avatar
  • 308
0 votes
1 answer
15 views

Athena CloudWatch Metrics Connector only returns data from the past trailing 15 days

I have set up an Athena CloudWatch Metrics connector: https://docs.aws.amazon.com/athena/latest/ug/connectors-cwmetrics.html, but when I query the metric_samples table from the Athena UI for data from ...
birds_and_birdies's user avatar
0 votes
0 answers
41 views

AWS Lambda: Why Cloudwatch logs are always synchronous?

My lambda function reads image names from an SQS queue, downloads images from an S3 bucket, processes them (2 different processing), uploads them into an S3 bucket, and then removes the image from the ...
SSM Tariq's user avatar
0 votes
0 answers
28 views

CloudWatch Agent alarms not displayed

I have successfully configered CloudWatch Agent on a EC2 instance and can view the metrics in the "All metrics" section. When creating an alarm from these metrics, the alarm shows "...
MarkWie's user avatar
0 votes
0 answers
42 views

write cloudwatch logs with 'component', 'error' and other fields

In the cdk I can define these filters for the logs: const pattern = logs.FilterPattern.all( logs.FilterPattern.stringValue('$.component', '=', 'HttpServer'), logs.FilterPattern.any( logs....
Rony Tesler's user avatar
  • 1,254
0 votes
0 answers
21 views

AWS Cloudwatch logs are not available

I am trying to fetch AWS cloudwatch logs using aws-sdk. but logs are sometime available and sometimes showing logs not available. 1st run return 0 messages. 2nd run return 0 messages. 3rd run return n ...
Mayur_Bhowad's user avatar
0 votes
0 answers
17 views

Are my AWS CloudWatch Metrics Insights queries limited to 3 hours worth of data in all cases? Is it the same with Prometheus?

I have been working with cloudwatch insights for a while now. I have built some dashboards based around metrics insights queries. It appears I have misunderstood how this works. My Metrics Insights ...
mal's user avatar
  • 3,042
0 votes
1 answer
28 views

AWS SQS Approximate Age Of Oldest Message growing on empty queue

The title says it all. Is it a AWS bug? We have alarm configured for this metrics and probably we will have to reconsider it. UPD:
Gino Pane's user avatar
  • 4,740
0 votes
0 answers
14 views

How to filter using start_query in CloudWatch?

I'm writing a python script to query cloudwatch: This query works fine: query = ''' fields @timestamp, @message ''' But this is not working: query = ''' fields @timestamp, @message | ...
DenCowboy's user avatar
  • 13.9k
1 vote
0 answers
26 views

Track email delivery status in AWS SES

I'm using AWS SES for sending emails and I want to track if a mail has been delivered to the given address. From AWS documentation I can see that SES supports publishing events to kinesis/SNS/...
ArigatoManga's user avatar
-1 votes
1 answer
32 views

Aws cloudwatch logs enable for ECS container in rails application

Am working on Docker based rails application, which is hosted in aws ecs. I wanna enable rails application logs to the cloudwatch. Please help me it. Your help is appreciated.
gowthami's user avatar
  • 161
0 votes
0 answers
19 views

How to publish metrics with aws lambda before lambda exits?

I have java 17 lambda implemented as image. I am using micrometer cloudwatch dependency for publishing metrics. Creating metrics beans as - @Provides @Singleton public CloudWatchAsyncClient ...
SWA PSTG's user avatar
0 votes
1 answer
33 views

Correct setting for finding ERROR in logs filter

in AWS I have a filter which checks if the word 'error' appears in the log. const adminErrorFilter = new logs.MetricFilter(this, 'admin-metric-error-filter', { logGroup: props!.adminLogGroup, ...
whitebear's user avatar
  • 11.3k
0 votes
0 answers
22 views

Set alarm for custom metrics of EC2s in the same Auto Scaling Group

Normally I can set the alarm for autoscaling group , because it returns the memoy utilization or CPU utilization for each autoscalinggroup(or task difinition) as default. It is easy to make alarm, ...
whitebear's user avatar
  • 11.3k

1
2 3 4 5
84