Metadata-Version: 1.1
Name: multiprocessing-generator
Version: 0.3
Summary: Prefetch elements from a Python generator in the background, from a separate process
Home-page: https://github.com/wetneb/multiprocessing_generator
Author: Antonin Delpeuch
Author-email: firstname@lastname.eu
License: MIT
Description: multiprocessing\_generator
        ==========================
        
        A library to prefetch items from a Python generator in the background,
        using a separate process.
        
        Install (no dependencies):
        
        ::
        
            pip install multiprocessing_generator
        
        Example:
        
        ::
        
            from multiprocessing_generator import ParallelGenerator
        
            def my_generator():
                while True:
                    # ... download something long ...
                    yield result
        
            with ParallelGenerator(
               my_generator(),
               max_lookahead=100) as g:
                 for elem in g:
                      # ... do some heavy processing on that element ...
                
        
        Up to 100 elements ahead of what is consumed will be fetched by the
        generator in the background, which is useful when the producer and the
        consumer do not use the same resources (for instance network vs. CPU).
        
        The generator handles exceptions and more serious failures
        transparently.
        
        Released under the MIT license.
        
        See also: https://github.com/justheuristic/prefetch\_generator
        
        
Keywords: multiprocessing generator prefetch
Platform: UNKNOWN
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3.3
Classifier: Programming Language :: Python :: 3.4
