The error message is generated when there is not enough memory in GPU when training usually caused by the batch size.
The simplest solution is to restart the kernel in your jupyter Lab and reduce the batch size to an optimal amount.
What you can do further is to monitor memory usage during runs and log run metadata, which then can be used to determine the optimal batch size. For this you can use Tensorboard. Additionally, by default Tensorflow will try to allocate as much GPU memory as possible. You can change this using the GPUConfig options, so that Tensorflow will only allocate as much memory as needed. Check this GitHub issue out.
Note that repeatedly running your models can create overhead and it is best if you can restart your runtime from time to time to just clear everything out if you conducting very intensive experiments.