Metadata-Version: 1.1
Name: gallerycrawler
Version: 0.1.0
Summary: Generic crawling for web galleries
Home-page: https://github.com/idlesign/gallerycrawler
Author: Igor `idle sign` Starikov
Author-email: idlesign@yandex.ru
License: BSD 3-Clause License
Description: gallerycrawler
        ==============
        https://github.com/idlesign/gallerycrawler
        
        |release| |lic|
        
        .. |release| image:: https://img.shields.io/pypi/v/gallerycrawler.svg
            :target: https://pypi.python.org/pypi/gallerycrawler
        
        .. |lic| image:: https://img.shields.io/pypi/l/gallerycrawler.svg
            :target: https://pypi.python.org/pypi/gallerycrawler
        
        Description
        -----------
        
        *Generic crawling for galleries*
        
        1. Crawler starts from gallery listing URL;
        2. It visits every details page mentioned on current listing page;
        3. It gathers information from each details page;
        4. It moves to the next listing URL.
        5. Etc.
        
        .. code-block:: python
        
            from galerycrawler.toolbox import Crawler, dump
        
            # Define crawler.
            class MyCrawler(Crawler):
        
                selector_listing_next: str = '.page-next a'
                selector_listing_thumbnails: str = '.thumbnail img'
                selector_details: str = '.page-details a'
                selector_details_title: str = '.page-title'
                selector_details_img: str = '.image img'
                selector_details_author: str = '.image-author'
        
            # Run dumping.
            dump(
                crawler=MyCrawler,
                url='https://mysite.some/gallery/',
                fpath='dumped.html',
                probe=True,  # Use this to quick test your crawler
            )
        
Platform: UNKNOWN
Classifier: Development Status :: 4 - Beta
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.6
Classifier: License :: OSI Approved :: BSD License
