Start
batch-processing-optimizer
batch-processing-optimizer - Skill Dossier
batch-processing-optimizer

batch-processing-optimizer

Optimize Spark, Polars, DuckDB, and pandas batch workloads with disciplined engine choice, shuffle control, and memory-aware execution planning. Use when the bottleneck is batch compute shape, partitioning, or spill behavior. NOT for streaming pipelines, warehouse-only SQL tuning, or scheduler design.

Uncategorized

Allowed Tools

ReadWriteEditBash(python *python3 *spark-submit *duckdb *sh *)

Share this skill

Skills use the open SKILL.md standard — the same file works across all platforms.

Install all 544 skills as a plugin
claude plugin marketplace add curiositech/windags-skills claude plugin install windags-skills

Claude activates batch-processing-optimizer automatically when your task matches its description.

View on GitHub
"Use batch-processing-optimizer to help me build a feature system"
"I need expert help with optimize spark, polars, duckdb, and pandas batch w..."