In machine learning, we are constantly updating the models. But we still want a way to use our old trained model checkpoints. These checkpoints will not load if the model class has been changed with different keyword arguments etc.
What's the best way to manage "model creep" or models gradually changing?
One way is, we can associated each pytorch checkpoint with a github commit. Then load that commit to run our model again.
Another way is, every time we change the model, we implement backwards compatibility (could get messy).