Metadata-Version: 2.1
Name: bol-crawler
Version: 0.0.1
Summary: A simple package for crawling bol.com
Home-page: https://github.com/stanvanrooy/bol-crawler
Author: Stan van Rooy
Author-email: stan@rooy.works
License: UNKNOWN
Description: # bolcom_crawler
        This is a really simple crawler that makes use of Scrapy to crawl [bol.com](https://bol.com). 
        
        ## Usage
        The `Crawler` instance has two functions you can use, `crawl_products` and `crawl_category`. See an example below.
        ````
        from bol_crawler.crawler import Crawler
        crawler = Crawler()
        
        # to crawl products
        products = crawler.crawl_products(
            [
                'https://www.bol.com/nl/p/lg-34gl750-b-ultragear-gaming-monitor/9200000115819731',
            ]
        )
        
        # to crawl a category
        products = crawler.crawl_category(
            [
                'https://www.bol.com/nl/l/gaming-toetsenborden/N/18214/', 0  # the 0 value is how often you want to go to the next page. 0 is just crawling the first page
            ]
        )
        ````
        
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
