home/categories/data-engineering/wshobson-agents-plugins-data-engineering-skills-spark-optimization-skill-md
data-engineeringdata-ai
spark-optimization
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
maintainer
wshobson
آخر تحديث 3/7/2026
النجوم
33377
التفرعات
3622
quick start
Installation and usage
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
التثبيت
$ install --globalskills.sh
الاستخدام
بعد التثبيت، يمكنك استخدام هذه المهارة بتشغيل الأمر التالي في الطرفية:
skills use spark-optimization