Prompt
Check a dataset before analysis
Find missing values, inconsistent formats, duplicates, and questions that could invalidate results.
ClaudeChatGPTGeminiData & Analytics
Dave AI
Scrapy Pipeline Data Extractor
Builds production Scrapy spiders with custom Item Pipelines for data cleaning and storage. Uses scrapy.linkextractors.LinkExtractor for crawl scoping and ItemLoader with MapCompose processors for field normalization.
instructions.md
--- name: scrapy-pipeline-data-extractor-38e2e3588e09 slug: "scrapy-pipeline-data-extractor" description: "Builds production Scrapy spiders with custom Item Pipelines for data cleaning and storage. Uses scrapy.linkextractors.LinkExtractor for crawl scoping and ItemLoader with MapCompose processors for field normalization." github_stars: 61314 verification: "security_reviewed" source: "https://github.com/scrapy/scrapy" author: "scrapy" category: "Research & Scraping" framework: "Gemini" tool_ecosystem: github_repo: "scrapy/scrapy" github_stars: 61314 --- # Scrapy Pipeline Data Extractor Builds production Scrapy spiders with custom Item Pipelines for data cleaning and storage. Uses scrapy.linkextractors.LinkExtractor for crawl scoping and ItemLoader with MapCompose processors for field normalization. ## Installation Use the upstream install or setup path that matches your environment: - pip install scrapy Requirements and caveats from upstream: - :alt: Supported Python Versions - It is cross-platform, and requires Python 3.10+. It is maintained by Zyte_ Basic usage or getting-started notes: - .. code:: bash - And follow the documentation_ to learn how to use it. - .. _documentation: https://docs.scrapy.org/en/latest/ - Source: https://github.com/scrapy/scrapy - Extracted from upstream docs: https://raw.githubusercontent.com/scrapy/scrapy/HEAD/README.rst ## Source - [Agent Skill Exchange](https://agentskillexchange.com/skills/scrapy-pipeline-data-extractor/)--- name: scrapy-pipeline-data-extractor-38e2e3588e09 slug: "scrapy-pipeline-data-extractor" description: "Builds production Scrapy spiders with custom Item Pipelines for data cleaning and storage. Uses scrapy.linkextractors.LinkExtractor for crawl scoping and ItemLoader with MapCompose processors for field normalization." github_stars: 61314 verification: "security_reviewed" source: "https://github.com/scrapy/scrapy" author: "scrapy" category: "Research & Scraping" framework: "Gemini" tool_ecosystem: github_repo: "scrapy/scrapy" github_stars: 61314 --- # Scrapy Pipeline Data Extractor Builds production Scrapy spiders with custom Item Pipelines for data cleaning and storage. Uses scrapy.linkextractors.LinkExtractor for crawl scoping and ItemLoader with MapCompose processors for field normalization. ## Installation Use the upstream install or setup path that matches your environment: - pip install scrapy Requirements and caveats from upstream: - :alt: Supported Python Versions - It is cross-platform, and requires Python 3.10+. It is maintained by Zyte_ Basic usage or getting-started notes: - .. code:: bash - And follow the documentation_ to learn how to use it. - .. _documentation: https://docs.scrapy.org/en/latest/ - Source: https://github.com/scrapy/scrapy - Extracted from upstream docs: https://raw.githubusercontent.com/scrapy/scrapy/HEAD/README.rst ## Source - [Agent Skill Exchange](https://agentskillexchange.com/skills/scrapy-pipeline-data-extractor/)
Platform guidance
Imported from the listed AgentSkill.sh category. Complete supplied package files and notices are retained. Required external tools and credentials are not installed. No bundled code was executed during import. Individual agent task behavior has not been tested.