home/categories/data-engineering
category focus

Data Eng.

ETL pipelines and big data infrastructure.

1541টি স্কিলall categories
sorting
stars
current ordering strategy
query
all entries
refine the visible subset
data-engineering
1

openspec-sync-specs

Sync delta specs from a change to main specs. Use when the user wants to update main specs with changes from a delta spec, without archiving the change.

pproenca
pproenca
data-ai
open
data-engineering
1

db-migration

Generate Firestore data migration scripts for schema changes, field additions, and data transformations. Use when migrating data, adding fields, or restructuring collections.

JanSzewczyk
JanSzewczyk
data-ai
open
data-engineering
1

etl-tools

Apache Airflow, dbt, Prefect, Dagster, and modern data orchestration for production data pipelines

pluginagentmarketplace
pluginagentmarketplace
data-ai
open
data-engineering
1

domino-distributed-computing

Work with distributed computing frameworks in Domino including Apache Spark, Ray, and Dask clusters. Covers cluster configuration, on-demand clusters, choosing between frameworks, PySpark usage, and scaling workloads. Use when processing large datasets, parallel ML training, or running distributed compute jobs.

jvdomino
jvdomino
data-ai
open
data-engineering
1

zarr-python

Chunked N-D arrays for cloud storage. Compressed arrays, parallel I/O, S3/GCS integration, NumPy/Dask/Xarray compatible, for large-scale scientific computing pipelines.

hxk622
hxk622
data-ai
open
data-engineering
1

replay-dead-letters

Replay failed observations after bug fixes or database issues. Shows which observations succeed and fail, helping recover from failures and validate fixes work on real data.

harehimself
harehimself
data-ai
open
data-engineering
1

workflow-logging

工作流过程日志格式规范和写入模式。定义 JSONL 和文本两种格式的日志结构、事件类型、级别定义和写入方法。

penkzhou
penkzhou
data-ai
open
data-engineering
1

new-scanner

Use this skill ONLY when creating a new data scanner (e.g., Twitter scanner, Bloomberg scanner). Do not use for agents or strategies.

kimrejstrom
kimrejstrom
data-ai
open
data-engineering
1

gcp-bq-data-export

Use when exporting BigQuery data to Cloud Storage, extracting tables to CSV, JSON, Avro, or Parquet formats, or using EXPORT DATA statements. Covers bq extract command, format options, compression, and wildcard exports.

FunnelEnvy
FunnelEnvy
data-ai
open
data-engineering
1

zrl-bundle-creator

This skill should be used when creating custom Zipline data bundles from CSV, API, or database sources. It provides deterministic patterns for ingesting OHLCV data, registering bundles, and validating data integrity for backtesting.

JeanBaissari
JeanBaissari
data-ai
open
data-engineering
1

linking-hms-to-hecras

Links HEC-HMS watershed models to HEC-RAS river models by extracting HMS DSS results and preparing them for RAS boundary condition import. Handles flow hydrograph export, spatial referencing (HMS outlets to RAS cross sections), DSS pathname formatting, quality validation, and time series alignment. Use when setting up HMS→RAS workflows, exporting HMS results for RAS, preparing upstream boundary conditions, or coordinating watershed-to-river integrated modeling. Leverages shared RasDss infrastructure for consistent DSS operations across both tools. Trigger keywords: HMS to RAS, link HMS RAS, boundary condition, upstream BC, watershed to river, integrated model, export HMS, DSS pathname, spatial matching, hydrograph.

gpt-cmdr
gpt-cmdr
data-ai
open
data-engineering
1

read-avro-files

Extracts and displays JSON data from Apache Avro files. Use this when the user wants to read, convert, or view the contents of an .avro file. Automatically deserializes nested JSON fields for better readability.

ranjanpoudel1234
ranjanpoudel1234
data-ai
open
data-engineering
1

continuity-ledger

Create or update continuity ledger for state preservation across clears

tfunk1030
tfunk1030
data-ai
open
data-engineering
1

big-data

Apache Spark, Hadoop, distributed computing, and large-scale data processing for petabyte-scale workloads

pluginagentmarketplace
pluginagentmarketplace
data-ai
open
data-engineering
1

snowflake-semantic-views

Create, alter, and validate Snowflake semantic views using the Snowflake CLI (`snow`). Use when asked to build or troubleshoot semantic views or semantic layer definitions with CREATE/ALTER SEMANTIC VIEW, to validate semantic view DDL against Snowflake via the CLI, or to guide Snowflake CLI installation and connection setup.

MiguelElGallo
MiguelElGallo
data-ai
open
data-engineering
1

processing-data

Processes CSV files and pandas DataFrames. Use when working with CSV files, tabular data, spreadsheets, or when the user asks to query, analyze, or manipulate structured data.

binome-dev
binome-dev
data-ai
open
data-engineering
1

queue-worker

Bull queue setup, worker processes, job lifecycle, error handling, retries, progress reporting, Redis connection management, and queue patterns for OCR and knowledge processing

Intellifill
Intellifill
data-ai
open
data-engineering
1

containerization

Docker, Kubernetes, container orchestration, and cloud-native deployment for data applications

pluginagentmarketplace
pluginagentmarketplace
data-ai
open
data-engineering
1

oracle-consultation

Use before invoking Oracle to ensure appropriate usage of this expensive reasoning resource

trash-panda-v91-beta
trash-panda-v91-beta
data-ai
open
data-engineering
1

schema-validator

校验页面实例与Schema定义的一致性(类型/约束/安全),并给出可发布结论。保存页面、预发布检查或批量体检时调用。

AIYAZONE
AIYAZONE
data-ai
open
data-engineering
1

snowflake-semanticview

Create, alter, and validate Snowflake semantic views using Snowflake CLI (snow). Use when asked to build or troubleshoot semantic views/semantic layer definitions with CREATE/ALTER SEMANTIC VIEW, to validate semantic-view DDL against Snowflake via CLI, or to guide Snowflake CLI installation and connection setup.

webmaxru
webmaxru
data-ai
open
data-engineering
1

bsee-data-extractor

Extract and process BSEE (Bureau of Safety and Environmental Enforcement) data including production, WAR (Well Activity Reports), and APD (Application for Permit to Drill) data. Use for querying production data, well activities, drilling permits, completions, and workovers by API number, block, lease, or field with automatic data normalization and caching.

vamseeachanta
vamseeachanta
data-ai
open
data-engineering
1

workspace-isolation-audit

Use when asked to audit or fix Supabase queries to ensure every query filters by workspace_id and workspace access is validated.

CleanExpo
CleanExpo
data-ai
open
data-engineering
1

virtualization-and-large-data

Implement high-performance virtualization strategies for massive datasets without sacrificing UX.

harborgrid-justin
harborgrid-justin
data-ai
open
Previous
Page 56 / 65
Next