home/categories/data-engineering/dokhacgiakhoa-antigravity-ide-agent-skills-spark-optimization-skill-md
data-engineeringdata-ai

spark-optimization

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

Dokhacgiakhoa
maintainer
Dokhacgiakhoa
Mis à jour 2/11/2026
Étoiles
414
Forks
115
quick start

Installation and usage

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

Installation
$ install --globalskills.sh
Utilisation

Après l'installation, vous pouvez utiliser ce skill en exécutant la commande suivante dans votre terminal :

skills use spark-optimization