how to create alert per error in stackdriver

Having created log-based metrics in cloud console, I then want to create alerts so that every time there is a new matching log entry, the alert triggers. In trying to create a suitable metric, the...

Google Cloud Platform: how to monitor memory usage of VM instances

I have recently performed a migration to Google Cloud Platform, and I really like it. However I can't find a way to monitor the memory usage of the Dataproc VM intances. As you can see on the...

stackdriver - showing count as percentages

We currently have logging setup with custom metrics that pulls the HttpResponseStatus from our logs using (?:HttpResponseStatus=)(...) When this is put into a dashboard it will show a count of all...

Why does Google Cloud show an error when using ClusterIP

In my gcloud console it shows the following error for my defined ingresses: Error during sync: error while evaluating the ingress spec: service "monitoring/kube-prometheus" is type "ClusterIP",...

Google Cloud MySQL managed Instance using 100 procent CPU for hours. What is using it?

On our Google Cloud managed MySQL instance we have the following problem. [![enter image description here][1]][1] [1]: https://i.stack.imgur.com/EeRmf.png ...as can be seen from the picture CPU...

How to get messages from googles Pub/Sub sytsem by using the current pubsub subsciber

I need to receive published messages from googles Pub/Sub system by using a python based subscriber. For this I did the following steps: On the web console I created a project, a registry, a...

Google decreased youtube api v3 limits for queries per day to 10 000 per day for all accounts and projects

That's not a yet another question on how to increase quota limits. Today Google decreased YouTube Data API v3 quota limits for queries per day from 50 million in my case to 0! Somebody had 1...

I wanted to create an Uptime check for my API which is an internal TCP load balancer under VPC network?

I wanted to create an Uptime check for my API which is an internal TCP load balancer under VPC network . I have a firewall set-up and i have allowed the IP Address for US region to access this...

Stackdriver metrics missing for load balancers created with traffic director

I've created an vpc internal http load balancer - using GCP's new Traffic Director, consisting of a forwarding rule, url map, couple backends pointing to VMs and NEGs. The solution works fine (end...

Stackdriver log-based metrics does not display the values as reported by logging

My goal is to base my metrics directly from log values. The problem is when I display them as graph it looks like they are distributed. How can I change it so that it displays the values from the logs?

Monitoring Google Cloud Platform with Statuspage

I want to integrate my Google Cloud Platform to Statuspage by Atlassian. I've been thinking, how can I monitor my instance without an API setup in my application. I want to create a script for...

Compute engine | Failed to start LSB: data collector for treasure Data

I've set up a new virtual machine with wordpress on google's compute engine. Now I'm facing the following problem: Wordpress has released a new update (5.4) and I want update it. To do that, I...

Google Cloud - What is the difference among Cloud Logging vs Cloud Monitoring vs Stackdriver?

I am exploring logging, monitoring and alerting options on Google Cloud. Where I found Cloud Logging, Monitoring and Stackdriver as few options. Theoretically, these services looks similar. Can...

How can I see the total number of rows of a BigQuery table in a chart?

I want to create a dashboard/chart in Google Cloud Monitoring where I can see the total number of rows of my BigQuery table at all times. With resource type "bigquery_dataset" and metric...

Script to calculate task duration for Cloud Composer (Airflow tasks) using stackdriver logs

I'm new to using Composer service of GCP and wanted to calculate the time duration for which my each tasks run. Is there any script that I can run to get the duration of each tasks of Airflow...

BigQuery - How to see failed scheduled queries in Cloud Logging?

I would like to monitor the state of my BigQuery scheduled queries in a Cloud Monitoring dashboard. I have created several logs-based metrics to track errors in other services/resources, but...

Failed to retrieve token from the Google Compute Engine metadata service. Status: 404

I'm trying to set up Cloud SQL Proxy running as a sidecar in my GKE cluster. The configuration is done via Terraform. I've set up workload identity, required service accounts, and so on. When...

Setup alerting policy for GCP Cloud Functions based on HTTP status codes

I want to setup Cloud Monitoring to alert me each time my Cloud Function responds with 4xx / 5xx HTTP status codes. Please let me know how to implement this from Cloud Console.

How can I get notifications for all stderr logs sent to Google Cloud Logging?

I'd like to get notifications for all standard error logs sent to Google Cloud Logging. Preferably, I'd like to get the notifications through Google Cloud Error Reporting, so I can easily get...

Using apache-airflow-providers-snowflake on airflow (no module named Snowflake)

I have installed package apache-airflow-providers-snowflake on airflow on docker and i am getting error No module named Snowflake Please refer attachment (check the error mentioned for the...

GCP Alert Filters Don't Affect Open Incidents

I have an alert that I have configured to send email when the sum of executions of cloud functions that have finished in status other than 'error' or 'ok' is above 0 (grouped by the function...

GKE: Sending File logs from docker container to Google Cloud Logging

I'm trying to capture some logs that are file-based in an application pod on GKE and view them from Google Cloud Logging. For various reasons, these application logs are not sent to STDOUT or...

Dataproc VM memory and local disk usage metrics

I'm trying to monitor local disk usage (percentage) on Dataproc 2.0 using cloud metrics. This would be useful for monitoring situations where Spark temporary files fill up disk. By default...

Monitoring GCP Projects with Terraform

I have a "Monitor" project in Google Cloud and want it to monitor the metrics of several other projects. On the Cloud Console, I can easily add these projects to the metric scope of my Monitor...

Terraform Google provider, create log-based alerting policy

I need to create a log-based alerting policy via Terraform Google cloud provider : https://cloud.google.com/logging/docs/alerting/monitoring-logs#lba I checked from the Terraform official...

How to create a log-based alert using the Monitoring API?

On the documentation it say's there is a link for an example of creating a log-based alert using the Monitoring API but there's only an example how to create it using the UI. I am having trouble...

GCP log-based metrics error: REQUEST_CONTEXT_READ

Loading log-based metrics suddenly stopped working with this error: An error occurred requesting data. Can not find metric metric_types: "logging.googleapis.com/user/<redacted>"...

update_alert_policy() unexpected argument

I'm building a cloud functions to update alert policies based on an external table I use as a reference. I already have a cloud functions to create alert policies: name =...

Triggering a Cloud Function off GCP Error Reporting Webhook

I'm working on connecting Cloud Error Reporting to an on request Cloud Function (to eventually liaise with the JIRA API). I have been able to successfully receive Monitoring Notification Channels'...

Pylint integration with Jenkins build running on dynamic kubernetes pods as agents

We have a Jenkins setup on Google Kubernetes Engine with dynamic kubernetes pods serving as build agents. I want to integrate Pylint as a build step. Python version running on kubernetes pod is...