Apache Airflow DAG Patterns
Build production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs.
4,653,104 AI resources indexedWorking toward the world’s largest AI resource index.
Write PySpark and Spark SQL jobs — RDDs, DataFrames, streaming, MLlib, and cluster configuration.
--- name: spark-builder-c8b3f819a986 display_name: Spark Builder description: Write PySpark and Spark SQL jobs — RDDs, DataFrames, streaming, MLlib, and cluster configuration. category: Data & Analytics platforms: [claude-code, api] version: 1.0.0 author: Claude Code tags: [spark-builder] --- # Spark Builder ## Overview Write PySpark and Spark SQL jobs — RDDs, DataFrames, streaming, MLlib, and cluster configuration. ## When to Use This Skill Use **Spark Builder** when you need to: - Work with spark builder tasks in your project or workflow - Automate spark builder operations at scale - Generate production-quality spark builder output quickly ## Instructions When this skill is active, Claude will: 1. Understand the full context of your spark builder request 2. Apply best practices and conventions for Data & Analytics 3. Produce clean, well-structured, production-ready output 4. Explain key decisions and offer alternatives where relevant ## Examples ### Example 1 — Basic Usage **User:** Help me get started with spark builder. **Claude:** I'll walk you through the essential steps for spark builder in your context... ### Example 2 — Advanced Usage **User:** I need a production-ready spark builder setup with full error handling. **Claude:** Here's a complete, production-hardened spark builder implementation... ## Guidelines - Always validate inputs before processing - Follow the conventions of the target platform or language - Prefer explicit over implicit — clarity beats cleverness - Include comments for non-obvious logic - Suggest tests or validation steps where appropriate ## Dependencies Required: python, pyspark ## Platforms Available on: claude-code, api --- *Part of the [claude-skills](https://github.com/inbharatai/claude-skills) collection — 183+ skills for Claude.*--- name: spark-builder-c8b3f819a986 display_name: Spark Builder description: Write PySpark and Spark SQL jobs — RDDs, DataFrames, streaming, MLlib, and cluster configuration. category: Data & Analytics platforms: [claude-code, api] version: 1.0.0 author: Claude Code tags: [spark-builder] --- # Spark Builder ## Overview Write PySpark and Spark SQL jobs — RDDs, DataFrames, streaming, MLlib, and cluster configuration. ## When to Use This Skill Use **Spark Builder** when you need to: - Work with spark builder tasks in your project or workflow - Automate spark builder operations at scale - Generate production-quality spark builder output quickly ## Instructions When this skill is active, Claude will: 1. Understand the full context of your spark builder request 2. Apply best practices and conventions for Data & Analytics 3. Produce clean, well-structured, production-ready output 4. Explain key decisions and offer alternatives where relevant ## Examples ### Example 1 — Basic Usage **User:** Help me get started with spark builder. **Claude:** I'll walk you through the essential steps for spark builder in your context... ### Example 2 — Advanced Usage **User:** I need a production-ready spark builder setup with full error handling. **Claude:** Here's a complete, production-hardened spark builder implementation... ## Guidelines - Always validate inputs before processing - Follow the conventions of the target platform or language - Prefer explicit over implicit — clarity beats cleverness - Include comments for non-obvious logic - Suggest tests or validation steps where appropriate ## Dependencies Required: python, pyspark ## Platforms Available on: claude-code, api --- *Part of the [claude-skills](https://github.com/inbharatai/claude-skills) collection — 183+ skills for Claude.*
Imported from the listed AgentSkill.sh category. Complete supplied package files and notices are retained. Required external tools and credentials are not installed. No bundled code was executed during import. Individual agent task behavior has not been tested.