Questions tagged [azure-machine-learning-service]
For questions about Microsoft's cloud-based service for machine learning. Be sure to include in your question the version of azureml-sdk or azureml CLI that you're using and code snippets you may be using.
1,876
questions
0
votes
0
answers
28
views
Azure ML: DeploymentIdentityError: Failed to create Kubernetes deployment identity, Reason:RefreshExtensionIdentityNotSet
I'm using Azure Machine Learning v2 SDK to create a model deployment on a kubernetes compute attached to an AML workspace. I'm able to deploy it locally as part of testing before deploying online. ...
0
votes
1
answer
43
views
Azure ML Cluster: changing folders during job
I am working with Azure ML to train and test an ML model. I have a main script which calls different functions (.py files in different subfolders) to load data, preprocess, train and test model. While ...
0
votes
0
answers
45
views
Unable to deploy a model with Azure endpoints in Azure ML studio
Task: To create a model and deploy it using Azure ML Endpoints
Please do not focus on what the model does, rather the goal here is to deploy it.
Steps that I took in the Azure ML workspace
In the ...
0
votes
1
answer
49
views
Read data from Azure Synpase to Azure Machine Learning by ManagedIdentityCredential
I am trying to read data from Azure Synpase to Azure Machine Learning by ManagedIdentityCredential, But when I run the code, the kernel of notebook was restarted and can not run!
Do you know the ...
0
votes
1
answer
57
views
how to automate retraining/deployment for azure machine learning designer
I am currently developing a machine learning solution on azure machine learning designer :
then i have created the real time inference pipeline :
the inference job is executed from ADF, the only ...
-2
votes
0
answers
36
views
Deploy a hugging face model for free [closed]
I need to deploy a machine learning model and get its API key to use in my web project. This is the link to the model https://huggingface.co/stabilityai/stable-diffusion-2-1
How can I deploy this ...
0
votes
1
answer
39
views
How can I automatically retrain the model created by the Azure Automated ML
Scenario: I've used Automated ML to pick the best model for me. Great!
But my dataset will grow over time as we collect more data. Now I'd like to auto-schedule a job to retrain that model once a ...
0
votes
1
answer
205
views
AttributeError: module ‘openai’ has no attribute ‘error’
I'm running a Python summarizer in Azure ML that queries my gpt4 deployment for information. Everything was working fine until two days ago, when I decided to switch the output directory of the ...
0
votes
1
answer
52
views
GPU runs out of memory on AzureML Studio when uing YOLOv8
I am using Notebooks on Azure AI Machine Learning Studio to train a classification model using Yolov8 (pip install ultralytics).
On training, I get an error that suggests my compute is out of memory:
...
0
votes
0
answers
78
views
The resource type 'locations/operationResults' could not be found in the namespace 'Microsoft.CognitiveServices' for api version '2023-08-01-preview'
I'm trying to deploy a finetuned model in Azure Machine Learning Studio and I got this error:
Failed to create deployment
InvalidResourceType: The resource type 'locations/operationResults' could not ...
0
votes
1
answer
38
views
How to set up environment variables on a personal compute instance in Azure Machine Learning Studio using a start up script
I would like to remove any hard coded keys from my files in Azure Machine Learning Studio and would like to store them as environment variables on my Compute Instance. To do this I attempted to create ...
-1
votes
0
answers
41
views
Where to find Azure Automl Timeseries forecasting best model training predictions file? [closed]
I've trained ML algorithms using Azure Automl. Specifically timeseries forecasting algorithms.
Goal: I would like to test the best model on the training data itself (i know it's not best practice), ...
0
votes
1
answer
80
views
Register dataset in AzureML Python SDK v2 from a dataframe
I am looking to upgrade to the new Azure AML Python SDK v2.
However, I can't replicate registering a dataset (now called data assets) directly from a dataframe. it seems that now the only option is to ...
0
votes
1
answer
95
views
How to add tuple in argparse for the pipeline in AzureML?
I want to argparse tuple for the function which I execute in the pipeline. For simplicity I will just skip steps with reading data and other which are not that much related to the topic. This looks ...
0
votes
1
answer
72
views
mltable client insists on using interactive authentication
I can't get the mltable client to stop using interactive authentication to load or save data. The folowing code:
registered_data_asset = ml_client.data.get(
'Dataset',
label='latest')
...
0
votes
1
answer
46
views
Download particular source file from AzureML snapshot directly
The Azure Machine Learning SDK for Python provides the restore_snapshot() method to download a zip file with the source code of an AzureML run. Assume that I am interested in inspecting a certain ...
0
votes
1
answer
74
views
Prompt Flow Extension in VS Code Not Recognizing Libraries Installed in Virtual Environment
I'm currently learning how to use Prompt Flow in Azure AI Studio and have encountered an issue with the Prompt Flow extension in Visual Studio Code. I've set up a virtual environment using venv and ...
0
votes
0
answers
69
views
Setting job-/display/experiment-name for Azure ML sdk2 batch endpoint invokations via REST [closed]
I have a Azure ML pipeline which is deployed as an batch endpoint in Azure ML via the SDK version 2.
The endpoint gets called via REST from our data factory, but the experiment names of the resulting ...
0
votes
0
answers
55
views
Synapse SQL pool and Azure ML [closed]
I'm about to link Synapse and Azure ML, in which I want to use Spark clusters to compute. Some of the data will be coming from a lake (ADLS Gen2) in stored in parquet/csv, which is fine for Spark. ...
1
vote
0
answers
99
views
How can I request access to Azure Machine Learning resources via OAuth? [closed]
Many APIs in Azure allow an App Registration to request "API Permissions." With a multi-tenant app, a user or admin is presented with a consent screen allowing the user to grant permission ...
0
votes
2
answers
96
views
Azure container registry detail using Azure SDK for Python
As we know that to create a environment in Azure Machine Learning Workspace we need Conda dependencies file and base image. In my case you can see.
Build process using this conda file and base image ...
2
votes
1
answer
140
views
how to load a registered model in azureml to a azure function app?
I am migrating to Azure function app for model inference from using Azure container instance deployment. The code below shows how I was loading the model in score.py
import json
import pandas as pd
...
0
votes
0
answers
80
views
Compute 'not ready' when deploying custom environment in promptflow
I'm trying to create a runtime to use for the new prompt flow feature. I'm trying to use a custom environment for the runtime because I need additional python packages.The environment builds without ...
0
votes
0
answers
42
views
Cluster encounters unknown issues after launching AzureML job
I am encountering this error on different GPU clusters after launching the job.
Run requested 1 node(s). 'cluster_name' cluster has encountered unknown issue. Please check the cluster status or try ...
1
vote
1
answer
49
views
How to access private blob container inside pipeline job - Azure SDKv2?
I have this example taken from the official documentation (the one you see below).
from azure.ai.ml import command, Input, MLClient, UserIdentityConfiguration, ManagedIdentityConfiguration
from azure....
0
votes
1
answer
47
views
How to generate with python a service endpoint in azureml for getting probabilities from a classification model? My code fails
I'm trying to publish a model in AzureML Studio in a endpoint for getting probabilities results and not binary classes, but I can't publish my model - I'm getting an error and I do not know what I'm ...
0
votes
1
answer
43
views
¿How to obtain an endpoint from an autoML that gives me the test result in probabilities instead of in binary classes in AzureMLStudio?
I created a model in Azure ML through AutoML.
Then I selected the "best model":
image
, then I selected the job that created that model:
image
, and I finally deployed the model to a real-...
0
votes
0
answers
51
views
How to train a model on a cluster with multiple GPUs (single node)
I wish to train a model on a multiple-GPUs, 1-Node cluster on AML (Azure ML).
I have my cluster (STANDARD_ND40RS_V2, which has 8 V100)
I have my Dataset, my Environment (docker), and my script.
When ...
0
votes
1
answer
84
views
Azure ML - Install GitHub package in environment
I am new to Azure ML and creating my own Python environment.
I am trying to use Azure ML to run my detectron2 (instance segmentation) code. For this, I need to install their detectron2 package from ...
0
votes
0
answers
66
views
Pipeline job parameters not passed from pipeline yaml
I'm running a pipeline job with a sweep step in AzureML.
I'm using the CLI syntax to create the components. I have a pipeline.yaml file that refers to train.yaml as the trial. train.yaml in turn ...
0
votes
0
answers
53
views
Azure ML Pipelines user_identity on parallel job
I'm using a user_identity to read data from Azure Data Lake. I'm saving the data to a datastore. Then I want to use the datastore for my parallel job, but I keep running into this error:
Please ...
0
votes
2
answers
248
views
Azure Machine Learning SDK V1 migration to V2 Pipeline Steps
I am trying to migrate Pipelines from Azure Machine Learning SDK V1 to V2, but sometimes I don't understand the logic behind the V2 and I get stuck.
In V1, I just had to create PythonScriptStep and ...
1
vote
1
answer
552
views
Nvidia driver too old error when loading bart model onto CUDA, works on other models
I'm getting an error loading a HuggingFace model on an AzureML GPU compute. Loading other models works, such as the first one in the example below:
from transformers import AutoModelForCausalLM
...
0
votes
1
answer
74
views
Azure ML: sweep job completes but status doesn't change from "Running"
Using azureml Python SDK from my local machine, I am able to configure a Hyperdrive sweep job and submit to a compute cluster in Azure Machine Learning Studio. Here is a sample of my code, based on ...
1
vote
1
answer
92
views
Error in converting Azure AutoML model to ONNX format
I am working with Azure AutoML and have created a trial using different models. In the pipeline, the final step is a PipelineWithYTransformations.
Now, I am attempting to convert the generated .pkl ...
0
votes
1
answer
72
views
Azure Machine Learning - Online Endpoint Schedule/Cost management
We're experimenting with MLOps on Azure Machine Learning, and as such, want to manage an Online Endpoint for inference. However, we also want to save costs, and since the software is only running in a ...
0
votes
0
answers
100
views
Register Dataset to Azure ML using Axure Devops pipeline
datastore = Datastore.register_azure_blob_container(
workspace=workspace,
datastore_name=datastore_name,
account_name=datastore_account_name, # Storage account name
...
1
vote
0
answers
32
views
Why is ground_truth_key in AzureML text generation component required
I'm not following why the ground_truth_key in AzureML's text generation pipeline component is a required argument. I understand it makes sense in summarization, translation, question_answering ...
2
votes
1
answer
197
views
How to resolve "disk full" error on Azure ML?
I am having an issue where the disk of my compute instance gets full after running some number of ML jobs on it. I have scoured the internet but been unable to find much information on how to resolve ...
0
votes
2
answers
79
views
Using custom container registy in azure ml api v2
I have a working azure container registry. I am able to do git pull, push, etc. using service principal authentication.
However, when I send it to a compute cluster, there is no way that the cluster ...
0
votes
1
answer
103
views
How to save a finetuned model on AzureML?
I'm running a HuggingFace fine-tuning in a notebook in AzureML. When I run the following locally, I get various files (model bin file, a bunch of jsons) saved in the appropriate directory.
trainer....
4
votes
1
answer
170
views
Azure Machine Learning Vector Index - Why does deployment validation fail?
I'm trying to create a FAISS vector index using Azure Machine Learning's web-based UI. I go through the required steps as per the documentation, and I choose a running compute instance for processing.
...
0
votes
1
answer
63
views
Problens printing Logs in a pipeline step on Azure AI - Machine Learning Studio
I am ussing the azure AI - Machine Learning Studio to adapt and run a pipeline. I am executing the code in the jupyter notebook at my workspace but when I run the STEP 1 I can't see the print or ...
0
votes
0
answers
307
views
How do I resolve an azure connection error - Failed to establish a new connection: [Errno 11001] getaddrinfo failed
I am trying to follow a tutorial on building a langchain chatbot on azure:
LangChain on Microsoft Azure - ChatBot with Azure Web Service & Azure Cognitive Search
https://www.youtube.com/watch?app=...
0
votes
1
answer
138
views
How to register a model to AzureML using MLflow from Databricks
I'm trying to train the model on Azure Databricks platform and register the model on Azure Machine learning studio to register the model. I have created a service principle to authenticate. Below is ...
1
vote
1
answer
131
views
Azure SDK v2 - unable to download job output using mlclient
I was using functionality from last few months, but recently started facing some issue with the below code. I'm running the code using JupyterLab and unable to download the predictions result. However,...
1
vote
1
answer
139
views
Azure ml Studio Object Detection jupyter: Error to access the mltable for training the model
I am new with azure machine learning and I am still learnning. There is a file named annotations.jsonl saved in the subfolder "image-frames/dados_treinamento" inside the container "...
1
vote
1
answer
158
views
Deploy Prompt (Chat) Flow with Chat UI?
I have created a Chat Flow using Azure Machine Learning Prompt Flows. For testing, it has a very neat chat window, where I can use the chat UI to test my deployment.
However, the only way I can access ...
0
votes
1
answer
77
views
Using Raspberry Pi Pico W to inference Azure ML using REST endpoint
I can't get a response when trying to inference an Azure ML model deployment on a Raspberry Pi Pico W. I've successfully gotten responses using Python 3.10, but can't get it to work in MicroPython. ...
0
votes
0
answers
60
views
Use Azure ML Environment from Share ML Registry with Python SDK
We have created an environment in azure ML shared registry. The environment was built into the registry. Here is what it looks like:
A DevOps pipeline creates this environment:
az ml environment ...