1,010
questions
0
votes
1
answer
570
views
How to Add new data to an existing Index in Vector Search vertex AI using python library
I am familiar with vectordbs like weaviate and pinecone, and trying to migrate my vectors to gcp.
I have uploaded data to a bucket, created index with it and deployed an endpoint using python and ...
0
votes
0
answers
84
views
Is there a solution to the error that WidgetConfig already exists when creating a website search in Vertex AI Search?
When creating an application to search a website in Vertex AI Search and Conversation, I get an error that WidgetConfig already exists and cannot create the application.
The specific error message is
...
1
vote
0
answers
1k
views
google.api_core.exceptions.PermissionDenied: 403 Permission denied on resource project YOUR_PROJECT_ID. reason: "CONSUMER_INVALID"
I am trying to use the PredictionServiceClient from aiplatform package. But I am getting this error:
google.api_core.exceptions.PermissionDenied: 403 Permission denied on resource project ...
3
votes
0
answers
154
views
Get indexed Vector in Vertex AI Vector Search
Simple question : How to get the ids of the indexed vectors in Vertex AI Vector Search ?
I curretly keep all of this data in a separate table when I manually enrich the index. But at the end, this ...
1
vote
0
answers
64
views
Vertex AI training pipeline fails for unknown reasons
I tried to create a model using a dataset, image object detection, but it fails for an unknown reason.
Number constraints such as number of labels, number of images, etc.
Also, are there any ...
0
votes
0
answers
16
views
Push button not able to trigger "event in dialgoflow cx"
I'm new to Dialogflow CX, and I'm currently working on creating a chatbot that will operate within Slack, integrated with Dialogflow CX.
I've successfully integrated Slack with Dialogflow, and I can ...
0
votes
1
answer
435
views
Google AutoML in VertexAI Forecasting took a long time for batch prediction and it drop error log
I created the model in AutoML(Google Cloud) with VertexAI Forecasting below the page.
Then I performed batch prediction, it took about 25 minutes. The data for batch prediction is only 7 records in a ...
1
vote
1
answer
825
views
502/Timeout in vertex AI custom fastapi/uvicorn prediction container
I am receiving a 'Error: 14 UNAVAILABLE: 502:Bad Gateway' timeout when calling my custom container from both the node and python client for predictions in vertex AI. The vertex prediction endpoint ...
1
vote
1
answer
1k
views
Vertex AI Workbench not running under specified service account for schedule-based recurring executions
I have a Workbench notebook that uses service account. It works when directly running through Workbench.
There are 2 ways to schedule an execution for async runs:
One-time execution
Schedule-based ...
2
votes
1
answer
566
views
Scheduling execution of a Vertex AI notebook returns error: "2: Unknown Error.: Unable to submit schedule"
I'm using GCP's Vertex AI Workbench to develop ML code in a Managed Notebook. The notebook execution works just fine both when run interactively, and when run by an Executor with Type: "One-time ...
1
vote
0
answers
366
views
Feature Store Vertex AI for Online Predictions
It is necessary to mantain an online attribute on a Feature Store of Vertex AI to serve an endpoint model to provide real-time predictions??
1
vote
2
answers
302
views
Why is the model variable not found when uploading the model to the Gcloud AI Platform?
I trained a model and uploaded it to Google AI Platform. When I test the model from the command line I expect to get predictions back from my uploaded model, instead I get an error message. Here are ...
2
votes
2
answers
407
views
PlatformException when trying to detect objects on a custom tflite model
I used Cloud AutoML to train a custom model that suppose to detect marks on a piece of paper. I have the dataset exported as a TFLite file, and i have it hosted on firebase.
I managed to download the ...
2
votes
0
answers
371
views
Batch Prediction with scikit-learn using jsonl in Vertex AI
I have a scikit-learn model successfully trained and loaded onto Vertex AI, but I can't seem to do batch prediction with jsonl. I've tried using these formats with jsonl:
{"dense_input": [1, ...
1
vote
0
answers
259
views
images not labeled after import vertexAI image object detection
I'm using this example to import my images and annotation data (JSONL file) into my vertexAI dataset:
https://cloud.google.com/vertex-ai/docs/samples/aiplatform-import-data-image-object-detection-...
2
votes
3
answers
5k
views
Error call Google Vertex AI endpoint from a python backend
I am trying to send an http post request to my google vertex ai endpoint for prediction. Though I do set the Bearer Token in the request header, the request still fails with the below error:
{
"...
5
votes
0
answers
4k
views
Vertex AI Workbench notebooks unresponsive
Having various problems accessing with GCP Vertex AI Workbench managed notebooks. Could really use some suggestions about recovering, and avoiding further failure.
The original behavior (two days ago)...
3
votes
0
answers
531
views
524 Error and Jupyterlab api status - Unhealthy
How can we solve below error on GCP JupyterLab? tried already available solutions on stackoverflow + google cloud but none of them working. Please help.
[1]: https://i.sstatic.net/IfVWt.png
27
votes
6
answers
41k
views
Permission "artifactregistry.repositories.downloadArtifacts" denied on resource
While the artifact repository was successfully creating, running a docker push to push the image to the google artifact registry fails with a permissions error even after granting all artifact ...
1
vote
1
answer
663
views
Response time on Google Vision API (text detection - OCR)
I'm having troubles with the text detection on Google Vision API, it's taking too long to get a response. When I run my code on Google Colab I get the answer between 1-2 seconds but when I run on my ...
0
votes
1
answer
951
views
400 Invalid image "us-docker.pkg.dev/vertex-ai/training/pytorch-gpu.1-11:latest" for deployment. Please use a Model with a valid image
What could be the point I am missing here. All datasets and training is done on gcp and my setup is basic.
Training, validation and test done on JupyterLab
Model pushed to a gcp storage bucket
Create ...
0
votes
0
answers
662
views
Trying to get a Vertex AI prediction in BigQuery using Python
I've built a model in VertexAI and have deployed it to an endpoint. I'm trying to use tabular data stored in GBQ as input for this model. I've found this function -- create a batch prediction in GBQ ...
1
vote
1
answer
736
views
Can `pip_index_urls` be used with Vertex pipelines?
In kfp-1.8.12 there is a pretty useful new feature whereby we can specify custom indices for python dependencies in the component decorator (see this PR).
I've got a component that uses a python ...
1
vote
0
answers
562
views
Training Pipeline fails after uploading model artifacts to Google Cloud Storage
Here's a snippet of my training code:
param_grid = {
"max_tokens" : [100],
"max_len" : [10],
"dropout" : [0.1],
}
gs_model = GridSearchCV(KerasClassifier(build_model), ...
4
votes
1
answer
2k
views
Constructing a Vertex AI Pipeline with a custom training container and a model serving container
I'd like to be able to train a model with a training app container that I've made and saved to my artifact registry. I want to be able to deploy a model with a flask app and with a /predict route that ...
2
votes
3
answers
532
views
Exported VertexAI TabularModel model_warm_up fails when running docker
Good Evening,
I have followed the instructions found here.
https://cloud.google.com/vertex-ai/docs/export/export-model-tabular
I trained the model on the Google Cloud Platform console
Then exported ...
2
votes
0
answers
520
views
Cannot use tensorboard with Vertex AI Custom job
I'm trying to launch a custom training job using Vertex AI through XManager. When running Custom jobs with tensorboard enabled I get a tensorboard instance in experiments -> tensorboard instances ...
0
votes
2
answers
1k
views
Reading csv file in R from Google Storage Bucket with cloudml or googleCloudStorageR
I want to read csv file from a Google Storage bucket.
With googleCloudStorageR library :
bucket_name <- "xxxxx"
gfs_tmp_file <- "xxx.csv"
# Set bucket default
...
0
votes
1
answer
208
views
Any way to make use of ImageClassificationInstance in C#?
I keep getting Grpc.Core.RpcException: Status(StatusCode="Unimplemented" ... exception when I try to use the ImageClassificationInstance objects to classify using a model I have created in ...
-1
votes
1
answer
561
views
Training Custom Model on Vertex AI
I have couple of of questions regarding training custom model:
I am using prebuilt Google image and everything is running fine, but I am not able to get the artifacts in "local-package-path"...
1
vote
1
answer
1k
views
quotas are exceeded error while deploying Vertex AI Matching Engine Index
I am following this example notebook and used custom word embeddings of my own.
i am getting the following error while deploying the index at this step
r = index_endpoint_client.deploy_index(
...
1
vote
1
answer
792
views
Vertex AI forecasting AutoML datatype mismatch
I could train the vertex AI AutoML forecating model but when I do batch prediction I get following error
Batch prediction job batch_prediction encountered the following
errors:
Column "sales&...
0
votes
1
answer
809
views
ModelUploadOp step failing with custom prediction container
I am currenlty trying to deploy a Vertex pipeline to achieve the following:
Train a custom model (from a custom training python package) and dump model artifacts (trained model and data preprocessor ...
0
votes
1
answer
450
views
AlphaFold on VertexAI - Stuck in setting up notebook for 2 hours
I am trying to run AlphaFold on VertexAI as explained here. However, my instance creation is stuck in this state for roughly two hours now. There is no error message either. I am wondering if ...
2
votes
0
answers
1k
views
Vertex AI Custom Container Training Job python SDK - InvalidArgument 400 error
I'm attempting to run a Vertex AI custom training job using the python SDK, following the general instructions laid out in this readme. My code is as follows (sensitive data removed):
job = aiplatform....
3
votes
0
answers
154
views
How to specify document language while importing a dataset in Google Cloud AutoML?
I am trying to train a model for text classification in VertexAI AutoML (Google Cloud) using documents in Spanish. I imported the documents as JSON lines and tried specifying the language of each ...
0
votes
1
answer
1k
views
How to view Vertex AI Matching Engine Deployed Index logs
I have deployed an index in Vertex AI IndexEndpoint. According to the docs for DeployedIndex, I have set the attribute enable_access_logging to True to enable private endpoints access logs.
...
2
votes
1
answer
2k
views
GCP - issues with connecting Vertex.AI to shared VPC
We are trying to create training job in Vertex AI and we need to connect with resources in our shared VPC. Project in which we are creating this job is service project. We have VPC with private ...
2
votes
1
answer
2k
views
_InactiveRpcError while querying Vertex AI Matching Engine Index
I am following the example notebook as per GCP docs to test Vertex Matching Engine. I have deployed an index but while trying to query the index I am getting _InactiveRpcError. The VPC network is in ...
1
vote
1
answer
668
views
Can you import data from parquet or delta file format data sets into Vertex AI feature store
Just wondering if it is possible to not just import from CSV-based data sets for the Vertex AI feature store, but from parquet or delta file formats as well. When trying to import a dataset from ...
1
vote
2
answers
1k
views
VertexAI Pipeline: How to use an output from a custom kfp component as input for google_cloud_pipeline_components?
I'm trying to write the Python code for a pipeline in VertexAI using kfp components. I have a step where i create a system.Dataset object that is the following:
@component(base_image="python:3....
1
vote
1
answer
368
views
Vertex AI returns a different result from the local tflite model
I uploaded my tflite model on Vertex AI and made an endpoint, and I requested inference with some input value, but it returns a different result from my local tflite model's inference result.
The ...
0
votes
1
answer
1k
views
How to use kfp Artifact with sklearn?
I'm trying to develop a custom pipeline with kubeflow pipeline (kfp) components inside Vertex AI (Google Cloud Platform). The steps of the pipeline are:
read data from a big query table
create a ...
0
votes
1
answer
707
views
Upload tensorboard logs from cloud storage to vertex ai - tensorboard
I created a pipeline with vertex ai and added the code for creating and storing my tensorboard logs in cloud storage. The next step in the instructions here https://cloud.google.com/vertex-ai/docs/...
2
votes
1
answer
3k
views
Vertex AI model batch prediction failed with internal error
I have trained the AutoMl classification model on Vertex AI, unfortunately model does not work with batch predictions, whenever I try to score training dataset (same which was used for the successful ...
0
votes
2
answers
1k
views
Error: "serving_default not found in signature def" when testing prediction
I followed this tutorial and came to the point where I can test a prediction using the following code:
{
"instances": [
{"csv_row": "44, Private, 160323, Some-college, ...
1
vote
0
answers
418
views
Vertex AI Tensorboard trough user interface
I have been using the Vertex AI training service with a custom container for my own machine learning pipeline. I would like to get tensorboard logs into the experiments tab to see in real-time the ...
1
vote
1
answer
872
views
GoogleAPICallError: None Unexpected state: Long-running operation had neither response nor error set
I'm new to Google Cloud Platform and I'm trying to create a Feature Store to fill with values from a csv file from Google Cloud Storage. The aim is to do that from a local notebook in Python.
I'm ...
0
votes
1
answer
708
views
Jobs-Cloud Scheduler (Google Cloud) fails to run scheduled pipelines
I'm here because I'm facing a problem with scheduled jobs in Google Cloud.
In Vertex AI Workbench, I created a notebook in Python 3 that creates a pipeline that trains AutoML with data from the public ...
1
vote
1
answer
2k
views
GCP Notebook Instance: Error 524 unable to open Jupyter lab
I am currently new to the GCP ecosystem. Over the past week, I have successfully created a notebook instance and have been using it. However, recently I encounter an issue whereby I am unable to open ...