Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Creating a Custom Environment in Azure ML using my compute-cluster instead of Serverless #35636

Open
anaarmas-sys opened this issue May 15, 2024 · 2 comments
Assignees
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. Machine Learning needs-team-attention This issue needs attention from Azure service team or SDK team question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team.

Comments

@anaarmas-sys
Copy link

anaarmas-sys commented May 15, 2024

I need to know how to create my custom environment forcing it to use my compute-cluster that already has "No public IP" on true.

I have tried create the custom environment by code:

my_env = Environment(name=env_name,
image="mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest",
conda_file=path,
description="I'm using azure sdk version 2.0")
my_env = ml_client.environments.create_or_update(my_env)

I have trying forcing it through running the code with a pipeline using

@dsl.pipeline(
compute = my_cluster
)
and didn´t work because the default job name "prepare image" is using the Serverless which in this moment has the parameter ServerlessComputeNoPublicIP=False (by default), my Azure ML is under a networking, then using my compute-cluster i thing won't be problems when creating the custom environment (what do you think?).

I have trying change ServerlessComputeNoPublicIP to True but i got the error:
image

Another option for my case, is if i have to use serverless as it is to "prepare image" job, how to avoid job download the snapshot (set it in disabled, something like that) into the Storge Account because i have the next error:
image
There are blocks from virtual networks, etc.

Another question: ServerlessComputeNoPublicIP parameter could be handle from the AML template when is deploy it?

Thanks for your help in advanced!

@github-actions github-actions bot added Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. Machine Learning needs-team-attention This issue needs attention from Azure service team or SDK team question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team. labels May 15, 2024
Copy link

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @Azure/azure-ml-sdk @azureml-github.

@anaarmas-sys
Copy link
Author

Hello @eniac871, Do you have any idea/feedback for me? Thanks in advanced!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. Machine Learning needs-team-attention This issue needs attention from Azure service team or SDK team question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team.
Projects
None yet
Development

No branches or pull requests

2 participants