0

Recently, while using a known-good endpoint configuration, I keep on receiving a: "The model data archive is too large. Please reduce the size of the model data archive or move to an instance type with more memory." error. The tar.gz file is 7.7G but is not loaded in memory (only a small part of it is). I am wondering if anything changes recently that may be causing this issue.

Thanks for any insights

Emmanuel

1 Answer 1

1

When an Endpoint is created with SageMaker, the model data artifact is downloaded and uncompressed onto the associated disk/EBS volume on the instance. This volume size is proportional[1] to the instance type that you chose.

Please make sure that the instance type that you picked has enough disk space to accommodate the uncompressed .tar.gz file. (It does not matter if it is fully or partially loaded onto memory later on, it has to fit in the disk uncompressed).

[1] Volume size for instance types - https://docs.aws.amazon.com/sagemaker/latest/dg/host-instance-storage.html

1
  • Is there any way to deploy models with huge size(around 60gb compressed)? Or should I go for multi-model endpoint in that case?
    – Bhavya
    May 5, 2020 at 12:22

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.