home/categories/data-engineering/wshobson-agents-plugins-data-engineering-skills-spark-optimization-skill-md
data-engineeringdata-ai
spark-optimization
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
maintainer
wshobson
更新於 3/7/2026
星標
33377
分支
3622
quick start
Installation and usage
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
安裝
$ install --globalskills.sh
使用
安裝後，您可以透過在終端機執行以下指令來使用此技能：
skills use spark-optimization