home/categories/data-engineering/wshobson-agents-plugins-data-engineering-skills-spark-optimization-skill-md
data-engineeringdata-ai
spark-optimization
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
maintainer
wshobson
更新於 3/7/2026
星標
33377
分支
3622
quick start
Installation and usage
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
安裝
$ install --globalskills.sh
使用
安裝後，您可以通過在終端運行以下命令來使用此技能：
skills use spark-optimization