When I put an object in Queue, Is it necessary to create deep copy of object and then put in Queue?
1 Answer
If you can ensure that the Object is only processed in one Thread, this is not a problem. But if you can't, it is recommended to use a deep copy.
The Queue object doesn't do this autmatically if you put the object into it.
See Refs
- Multithreading, Python and passed arguments
- Python in Practice: Create Better Programs Using Concurrency... p.154
Keep in mind that the object need to be able to be pickled (Multiprocessing Basics)
It usually more useful to be able to spawn a process with arguments to tell it what work to do. Unlike with threading, to pass arguments to a multiprocessing Process the argument must be able to be serialized using pickle. This example passes each worker a number so the output is a little more interesting.
-
1
-
What do you mean? The blog article and the book page refer to the question of deep copy, not only multiprocessing in common.– ppaslerJan 16, 2017 at 10:08
-
1Sorry, I got confused by the first link's interchangeable use of multi threading and processing..– thebjornJan 16, 2017 at 10:15
-
Thread
isn't directly relevant tomultiprocessing
.multiprocessing.Queue
(at least in python2) makes a copy of the object, as it serializes it, though beware race conditions (see link in other answer). Finally, the book link is broken, as it doesn't contain the referenced page. Apr 18, 2018 at 15:12 -