Author: Sudheer Valla
Automate GCP BigQuery Table View Creation
In this quick demo, we are going to use a Python Script to automate GCP BigQuery Table View Creation for all tables in a dataset in a different GCP project. Before running the script you need to create Application Default Credentials to let Python script use them to authenticate. The user account or service account…
Terraform Integration/Unit Testing with Tests
In this quick start demo we are going to cover Terraform Integration/Unit Testing with Tests Terraform has introduced testing framework in 1.6.0 version release. Terraform test files should have .tftest.hcl or .tftest.json file extensions. Terraform automatically discover code in these files and execute them. We can have multiple .tftest.hcl or .tftest.json files. Each test file…
Common GCP Auth Types and Troubleshooting Tips
This post describes some of the frequently used Google cloud GCP auth types and troubleshooting tips while authenticating with gcloud CLI and ADC. Following are the two frequently used methods and they both are different: 1. Authenticate to run gcloud commands using user credentials/service account key file. We can use gcloud CLI tool for Google Cloud…
Google Cloud Interview/Certification Sample Questions
Read below Google Cloud interview and certification sample questions to cross check your knowledge. 1.By default, how long PubSub Subscription will retain unacknowledged messages. 2. There is a requirement to do a DML experiment on a table, which modify a large number of rows, but analysts are not sure about the results. What options will…
Trigger Azure DevOps Pipeline with a Python Script
We can use Azure DevOps API to trigger an ADO pipeline. In this quick start demo , we will go through how to trigger an Azure DevOps pipeline with a Python script. I have already created an ADO pipeline called demo-pipeline. we are going to trigger this pipeline by using below Python script. Following parameters…
Monitoring Alerts for GCP IAM Service Account Key Creation
In this quick demo, we are going setup Monitoring Alerts for GCP IAM service account key creation, meaning we will get alerts when some one creates a service account key. To setup alerts for IAM service account key creation, first we need to create log based metric for logs which contains iam.serviceAccountKeys.create IAM permission. I’m…
Monitoring Alerts for GCP IAM Policy Changes
In this quick demo, we are going setup Monitoring Alerts for GCP IAM Policy changes, meaning we will get alerts for GCP IAM Role assignments and removals to users, service accounts and groups. To setup alerts for IAM changes first we need to create log based metric for logs which contains setIamPolicy method. I’m going…
Application Performance Monitoring on Kubernetes
In this quick demo, we are going to setup Application Performance Monitoring on Kubernetes using Elastic APM server and Elasticsearch and Kibana. What is Application Performance Monitoring(APM)? APM focuses on tracking the performance of an application. APM collects errors, traces, requests rates, latency times from applications to identify the source of the performance issues/bottlenecks. How…
Prometheus Blackbox Exporter Setup on Kubernetes
In this quick start demo, we are going to do Prometheus Blackbox Exporter setup on Kubernetes cluster to probe HTTP or HTTPS endpoints. What is Blackbox Exporter? Blackbox exporter allows blackbox probing of endpoints over HTTP, HTTPS, DNS, TCP, ICMP and gRPC. We can use Prometheus to scrap blackbox exporter metrics and create dashboards in…
Alertmanager Setup on Kubernetes for Prometheus Monitoring
In this quick start demo, we are going to do Alertmanager setup on Kubernetes cluster to handle Prometheus alerts. We will use slack as alert receiver. What is Alertmanager? The Alertmanager handles alerts sent by Prometheus server. It takes care of deduplicating, grouping, and routing them to the correct receiver integrations such as email, PagerDuty,…