Generates production-ready Scrapy spiders with middleware configuration and item pipeline setup. Uses the Scrapy Framework API, Selector (XPath/CSS), and Twisted reactor for concurrent crawling.
--- name: scrapy-spider-generator-f752914398e3 slug: "scrapy-spider-generator" description: "Generates production-ready Scrapy spiders with middleware configuration and item pipeline setup. Uses the Scrapy Framework API, Selector (XPath/CSS), and Twisted reactor for concurrent crawling." github_stars: 61314 verification: "security_reviewed" source: "https://github.com/scrapy/scrapy" author: "scrapy" category: "Research & Scraping" framework: "ChatGPT Agents" tool_ecosystem: github_repo: "scrapy/scrapy" github_stars: 61314 --- # Scrapy Spider Generator Generates production-ready Scrapy spiders with middleware configuration and item pipeline setup. Uses the Scrapy Framework API, Selector (XPath/CSS), and Twisted reactor for concurrent crawling. ## Installation Use the upstream install or setup path that matches your environment: - pip install scrapy Requirements and caveats from upstream: - :alt: Supported Python Versions - It is cross-platform, and requires Python 3.10+. It is maintained by Zyte_ Basic usage or getting-started notes: - .. code:: bash - And follow the documentation_ to learn how to use it. - .. _documentation: https://docs.scrapy.org/en/latest/ - Source: https://github.com/scrapy/scrapy - Extracted from upstream docs: https://raw.githubusercontent.com/scrapy/scrapy/HEAD/README.rst ## Source - [Agent Skill Exchange](https://agentskillexchange.com/skills/scrapy-spider-generator/)--- name: scrapy-spider-generator-f752914398e3 slug: "scrapy-spider-generator" description: "Generates production-ready Scrapy spiders with middleware configuration and item pipeline setup. Uses the Scrapy Framework API, Selector (XPath/CSS), and Twisted reactor for concurrent crawling." github_stars: 61314 verification: "security_reviewed" source: "https://github.com/scrapy/scrapy" author: "scrapy" category: "Research & Scraping" framework: "ChatGPT Agents" tool_ecosystem: github_repo: "scrapy/scrapy" github_stars: 61314 --- # Scrapy Spider Generator Generates production-ready Scrapy spiders with middleware configuration and item pipeline setup. Uses the Scrapy Framework API, Selector (XPath/CSS), and Twisted reactor for concurrent crawling. ## Installation Use the upstream install or setup path that matches your environment: - pip install scrapy Requirements and caveats from upstream: - :alt: Supported Python Versions - It is cross-platform, and requires Python 3.10+. It is maintained by Zyte_ Basic usage or getting-started notes: - .. code:: bash - And follow the documentation_ to learn how to use it. - .. _documentation: https://docs.scrapy.org/en/latest/ - Source: https://github.com/scrapy/scrapy - Extracted from upstream docs: https://raw.githubusercontent.com/scrapy/scrapy/HEAD/README.rst ## Source - [Agent Skill Exchange](https://agentskillexchange.com/skills/scrapy-spider-generator/)
Imported from the listed AgentSkill.sh category. Complete supplied package files and notices are retained. Required external tools and credentials are not installed. No bundled code was executed during import. Individual agent task behavior has not been tested.