skills.homes logoskills.homescapability registry
home/categories/data-engineering/b3-competition-claude-skills-python-data-engineering-skill-md
cd ..
data-engineeringdata-ai

python-data-engineering

Comprehensive Python data engineering patterns for AWS Data Lake, including PySpark, Pandas, Apache Airflow, AWS Glue, ETL pipelines, data quality, schema management, performance optimization, FastAPI services, streaming with Kafka/Kinesis, data validation with Great Expectations, testing strategies, error handling, logging, and production deployment on AWS EMR and Glue.

查看源码data-engineering
b3-competition
maintainer
b3-competition
更新于 11/4/2025
星标
1
分支
0
quick start

Installation and usage

Comprehensive Python data engineering patterns for AWS Data Lake, including PySpark, Pandas, Apache Airflow, AWS Glue, ETL pipelines, data quality, schema management, performance optimization, FastAPI services, streaming with Kafka/Kinesis, data validation with Great Expectations, testing strategies, error handling, logging, and production deployment on AWS EMR and Glue.

安装
$ install --globalskills.sh
使用

安装后，您可以通过在终端运行以下命令来使用此技能：

skills use python-data-engineering