home/categories/data-engineering/sickn33-antigravity-awesome-skills-skills-spark-optimization-skill-md
data-engineeringdata-ai

spark-optimization

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

sickn33
maintainer
sickn33
업데이트됨 2/27/2026
스타
32093
포크
5340
quick start

Installation and usage

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

설치
$ install --globalskills.sh
사용법

설치 후 터미널에서 다음 명령을 실행하여 이 스킬을 사용할 수 있습니다:

skills use spark-optimization