home/categories/data-engineering/wshobson-agents-plugins-data-engineering-skills-spark-optimization-skill-md
data-engineeringdata-ai
spark-optimization
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
maintainer
wshobson
更新于 3/7/2026
星标
33377
分支
3622
quick start
Installation and usage
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
安装
$ install --globalskills.sh
使用
安装后，您可以通过在终端运行以下命令来使用此技能：
skills use spark-optimization