0

Here I asked how to solve overhead problem by using while_loop for training (which allow to evaluate train_op several time by call only one run). After that I create 4 thread and run one while_loop per thread for optimization in parallel. Is there native mechanism in TensorFlow for such parallel optimization?

I use Ftrl optimizer.

Thanks!

EDITED:

In my situation I have big data set, which I read gradually in main thread and enqueue to FIFOQueue. I use batch optimization and one optimization step on small batch (ideal only one element) takes little time (I use linear model), since that I want to do all optimization step in one run call, without returning to python interpreter on each step (because overhead problem). Now I call run as many times as number of threads.

2
  • That's what queue runners do -- they create several Python threads and do while(True): sess.run in parallel Oct 20, 2016 at 20:36
  • But QueueRunner is for enqueue data, isn't it ? Is there example, where queue runners using for training model? Nevertheless, it dose exactly what I do, am I right? I add more details to my question Oct 21, 2016 at 8:46

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.