2

In machine learning, we are constantly updating the models. But we still want a way to use our old trained model checkpoints. These checkpoints will not load if the model class has been changed with different keyword arguments etc.

What's the best way to manage "model creep" or models gradually changing?

One way is, we can associated each pytorch checkpoint with a github commit. Then load that commit to run our model again.

Another way is, every time we change the model, we implement backwards compatibility (could get messy).

3
  • Aside: Nice read about the lack of "picks and shovels" in AI: forbes.com/sites/robtoews/2020/03/22/…. Model creep would be on of the them for sure. Jul 15, 2020 at 22:19
  • What do you mean by "using" (I assume the question is strictly about PyTorch's models)? Only inference, training, changing model on the fly after loading, something else? Jul 15, 2020 at 22:30
  • 1
    @SzymonMaszke Ultimately all of the above. See OpenAI's work where they discuss continually training a model for months.
    – user3180
    Jul 15, 2020 at 23:12

0

Browse other questions tagged or ask your own question.