home/categories/data-engineering/wshobson-agents-plugins-data-engineering-skills-spark-optimization-skill-md
data-engineeringdata-ai
spark-optimization
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
maintainer
wshobson
Atualizado 3/7/2026
Estrelas
33377
Forks
3622
quick start
Installation and usage
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
Instalação
$ install --globalskills.sh
Uso
Depois de instalar, você pode usar esta skill executando o seguinte comando no terminal:
skills use spark-optimization