home/categories/data-engineering/rmyndharis-antigravity-skills-skills-spark-optimization-skill-md
data-engineeringdata-ai

spark-optimization

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

rmyndharis
maintainer
rmyndharis
更新于 1/18/2026
星标
634
分支
118
quick start

Installation and usage

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

安装
$ install --globalskills.sh
使用

安装后,您可以通过在终端运行以下命令来使用此技能:

skills use spark-optimization