Does Spark Kubernetes suport the --py-files argument?

I'm trying to run a PySpark Job using Kubernetes. Both the main script and the py-files are hosted on Google Cloud storage. If I launch the Job using the standalone resource manager: spark-submit...

How do I set up a Google Cloud Function (Python) to create a Google Cloud Project?

I have been using the GCP Python client library to automate project creation. I want to go serverless and use Cloud Functions and Pub/Sub. I can't figure out how to set up the dependencies and...

Can't add user for role/editor user via api in Google Cloud Platform

I have been trying to use the api to add user of project editor in Google Cloud Platform. API I use is Resource Manager API setIampolicy. To Add user is using Google Apps Script. PROCEDURE get...

How do I get the organization ID of my current project in Google Cloud Platform?

I would like to know the organization ID of my current project in GCP. gcloud projects describe PROJECT_ID will show the parent which can be the organization, but if the parent is a folder, the...

How to list, find, or search iam policies across services (APIs), resource types, and projects in google cloud platform (GCP)?

In Google Cloud Platform (GCP), you can only get the IAM policy for a specific resource by calling getIamPolicy (get-iam-policy in gcloud). Is there a way to list, search, list, search, or find...

How to find, list, or search resources across services (APIs) and projects in Google Cloud Platform?

In Google Cloud Platform (GCP), you can use list APIs or commands to list resources in a given project for a given type in a given service, like BigQuery datasets or compute instances. But how to...

Cannot deploy Kubeflow on GCP: tells me to enable APIs that are already enabled

I am trying to install Kubeflow on Google Cloud Platform (GCP) and Kubernetes Engine (GKE), following the GCP deployment guide. I created a GCP project of which I am the owner, I enabled billing,...

Frequent Error when deploying Helm to GKE with Terraform

Components GKE Helm v3 Terraform Note: The below error is raised, BUT IF i keep doing terraform apply/delete multiple times, it would somehow auto-resolve. I am making use of Google Cloud...

How to list all projects inside GCP organization using Resource Manager API?

I am trying to list all projects I have in GCP by using the projects.list method from the Resource Manager API but I cannot figure out what access token to be used. Let's say I have three...

Can't access secret stored in Secrets Manager from Google Cloud Function

While testing a Google Cloud Function I wrote that attempts to access a secret stored in the Secret Manager, I get this error: Error: 7 PERMISSION_DENIED: Permission...

Google Cloud Platform project quotas - By organization or by user in the organization or both

I have a G Suite account that had only 1 user. Then I added a new user, so now the G Suite account has 2 users. The remaining Cloud Project quota for the new user is 12 projects left, but the...

Getting the respsonse: "INVALID_ARGUMENT: Project id 'X' , is malformed

I'm trying to connect to google firestore and for some reason my process.env.FIREBASE_PROJECT_ID keeps spitting out the error: @firebase/firestore: Firestore (7.17.1): Connection GRPC stream...

How to resolve ResourceErrorCode: 400 when deploying a firewall resource with Google Cloud Deployment Manager

I am trying to deploy a single firewall resource with Google Cloud Deployment Manager. I want the firewall to block just my own ip address from accessing my App Engine app that is already deployed...

google cloud secret manager nodejs getsecret problem

I need to get a password from Google Secret Manager in my Cloudrun application. My code: const {SecretManagerServiceClient} = require('@google-cloud/secret-manager'); const smClient = new...

How to create project in Google Console Cloud platform using PHP Lib programmatically?

I am trying to create a project in the Google console cloud using the PHP client library. I copied this sample code from...

Istio Gateway Fail To Connect Via HTTPS

Deployments in a GKE cluster with Istio is working correctly via HTTP. But when i tried to secure it with cert-manager with following resources, HTTPS request fails state like so on...

"server doesn't have a resource type "pods"" while installing NVIDIA Clara Deploy

I am trying to install the latest version of NVIDIA Clara Deploy Bootstrap following the official documentations (this & this). At one step of the installation, these is a shellscript named...

Google Cloud Platform: How to fetch permissions assigned for particular Identity across all GCP resources via REST call

GCP IAM: In IAM, permission to access a resource isn't granted directly to the end-user. Instead, permissions are grouped into roles, and roles are granted to authenticated members. An IAM policy...

SecretManagerServiceClient in Google Cloud Run and authentication via service account

I can create a SecretManagerServiceClient without using a key file successfully in Google Cloud Shell: from google.cloud import secretmanager from google.oauth2 import service_account from...

Composer 2.0.8 issue package-versions-deprecated

Using php 7.2 - Installing composer/package-versions-deprecated (1.8.0): Extracting archive ...

How can I load an Android asset pack on-demand using Java from the Google Play app bundle?

How can I load an Android asset pack on-demand using Java from the Google Play app bundle? I have tried passing the parameter and hard coding it in AssetPackManager. I think my problem is...

How do I use the Google Cloud APIs (directly or using the GCP PHP Client SDK) to List, Add, and Remove Users from a GCP project programmatically?

A brief summary: I have a PHP web application which uses the Google Cloud PHP Client SDK to integrate with Dialogflow. That's working no problem. I have a need now to let my users access the GCP...

kubernetes external secrets on GKE , Permission error

I install kubernetes external secrets with helm, on GKE. GKE: 1.16.15-gke.6000 on asia-northeast1 helm app version 6.2.0 using Workload Identity as document written For workload identity,the...

Permission denied creating project with GCP resource manager API

I am trying to create projects programatically through the resource manager API from a google cloud function like so: exports.createProjectAsync = async (projectId, projectName) => { const...

How to set pubsub message filter while creating cloud-function with triggerTopic

I was trying to create a google cloud function which can be triggered by a pubsub topic. I used the google deployment manager template for creating it. But I couldn't find any way to set the...

Using apache-airflow-providers-snowflake on airflow (no module named Snowflake)

I have installed package apache-airflow-providers-snowflake on airflow on docker and i am getting error No module named Snowflake Please refer attachment (check the error mentioned for the...

How to list folders and projects inside the folders in GCP

In my GCP organization which has following hierarchy Org--> folder--> folder--> folder--> projects--> Resources. I have a global view service account using which has necessary permission to list...

How do I access an IBM Cloud Object Storage instance to use in Watson Studio?

I am working on a course and the project had me create an account in IBM Cloud (all are in the Lite/Free account), then create an instance of IBM Watson Studio, then try to create a new, empty...

Create Cloud Run service with Deployment Manager

I'm trying to create a Cloud Run service using the Deployment Manager, as there's no native support for Cloud Run resource type, I created a type provider for the Cloud Run API by providing it's...

Cannot install google-api-core package in our python app (Google Cloud Platform) due to conflicting dependencies (Python 3)

When I tried to install the Google Core API package, it always gets errors for every different version of this package. The app is run in Python 3, and I got the following logs: The user requested...