home/categories/data-engineering
category focus

Data Eng.

ETL pipelines and big data infrastructure.

1541 اسکلزall categories
sorting
stars
current ordering strategy
query
all entries
refine the visible subset
data-engineering
913

moai-formats-data

Data format specialist covering TOON encoding, JSON/YAML optimization, serialization patterns, and data validation. Use when optimizing data for LLM transmission or implementing serialization.

modu-ai
modu-ai
data-ai
open
data-engineering
908

turbo-db-route

Scaffold Zig-native database routes using pg.zig + TurboPG. Use when adding database-backed CRUD endpoints, custom SQL queries (pgvector, JSONB, full-text search, JOINs, CTEs), or standalone TurboPG usage.

justrach
justrach
data-ai
open
data-engineering
898

parse-table

Parse table definition to extract module name, model name, table name, and field definitions. First step of CRUD generation.

JaguarJack
JaguarJack
data-ai
open
data-engineering
888

ccxt

CCXT unified crypto exchange library (100+ exchanges). Free public market data. Fallback when OKX is unavailable.

HKUDS
HKUDS
data-ai
open
data-engineering
888

data-routing

Data source selection decision tree. Load this skill BEFORE any backtest or data-fetching task to choose the best available data source.

HKUDS
HKUDS
data-ai
open
data-engineering
807

axiom-avfoundation-ref

Reference — AVFoundation audio APIs, AVAudioSession categories/modes, AVAudioEngine pipelines, bit-perfect DAC output, iOS 26+ spatial audio capture, ASAF/APAC, Audio Mix with Cinematic framework

CharlesWiltgen
CharlesWiltgen
data-ai
open
data-engineering
807

axiom-core-data-diag

Use when debugging schema migration crashes, concurrency thread-confinement errors, N+1 query performance, SwiftData to Core Data bridging, or testing migrations without data loss - systematic Core Data diagnostics with safety-first migration patterns

CharlesWiltgen
CharlesWiltgen
data-ai
open
data-engineering
807

axiom-realm-migration-ref

Use when migrating from Realm to SwiftData - comprehensive migration guide covering pattern equivalents, threading model conversion, schema migration strategies, CloudKit sync transition, and real-world scenarios

CharlesWiltgen
CharlesWiltgen
data-ai
open
data-engineering
807

axiom-sqlitedata-migration

Use when migrating from SwiftData to SQLiteData — decision guide, pattern equivalents, code examples, CloudKit sharing (SwiftData can't), performance benchmarks, gradual migration strategy

CharlesWiltgen
CharlesWiltgen
data-ai
open
data-engineering
807

axiom-sqlitedata

Use when working with SQLiteData @Table models, CRUD operations, query patterns, CloudKit SyncEngine setup, or batch imports. Covers model definitions, @FetchAll/@FetchOne, upsert patterns, database setup with Dependencies.

CharlesWiltgen
CharlesWiltgen
data-ai
open
data-engineering
807

axiom-swift-performance

Use when optimizing Swift code performance, reducing memory usage, improving runtime efficiency, dealing with COW, ARC overhead, generics specialization, or collection optimization

CharlesWiltgen
CharlesWiltgen
data-ai
open
data-engineering
807

axiom-swiftdata-migration-diag

Use when SwiftData migrations crash, fail to preserve relationships, lose data, or work in simulator but fail on device - systematic diagnostics for schema version mismatches, relationship errors, and migration testing gaps

CharlesWiltgen
CharlesWiltgen
data-ai
open
data-engineering
807

axiom-swiftdata-migration

Use when creating SwiftData custom schema migrations with VersionedSchema and SchemaMigrationPlan - property type changes, relationship preservation (one-to-many, many-to-many), the willMigrate/didMigrate limitation, two-stage migration patterns, and testing migrations on real devices

CharlesWiltgen
CharlesWiltgen
data-ai
open
data-engineering
805

extract-test-set

Extract raw price dataframe for a test case

tradingstrategy-ai
tradingstrategy-ai
data-ai
open
data-engineering
788

kaizenanalyse

Auto-selects best Kaizen method (Gemba Walk, Value Stream, or Muda) for target

NeoLabHQ
NeoLabHQ
data-ai
open
data-engineering
785

aiml-phishing-benchmark

ISC template for Cybersecurity. Anchor strength: STRONG. Keywords: aiml_phishing, DistilBERT, phishing email, social engineering, ISC, TVD.

wuyoscar
wuyoscar
data-ai
open
data-engineering
785

pharmtox-kegg-pathways

ISC template for Pharmacology & Toxicology. Anchor strength: STRONG. Keywords: pharmtox_kegg, requests, json, ISC, TVD.

wuyoscar
wuyoscar
data-ai
open
data-engineering
770

backpressure

Manage data flow when producers outpace consumers. Bounded buffers, adaptive flushing, and graceful degradation prevent OOM crashes and data loss.

dadbodgeoff
dadbodgeoff
data-ai
open
data-engineering
770

batch-processing

Collect-then-batch pattern for database operations achieving 30-40% throughput improvement. Includes graceful fallback to sequential processing when batch operations fail.

dadbodgeoff
dadbodgeoff
data-ai
open
data-engineering
770

checkpoint-resume

Exactly-once processing semantics with distributed coordination for file-based data pipelines. Atomic file claiming, status tracking, and automatic retry with in-memory fallback.

dadbodgeoff
dadbodgeoff
data-ai
open
data-engineering
770

community-feed

Social feed with batch queries, cursor pagination, trending algorithms, and engagement tracking. Efficient database queries for infinite scroll feeds.

dadbodgeoff
dadbodgeoff
data-ai
open
data-engineering
770

data-transformers

Centralized transformation logic for consistent data shaping across API routes. Includes aggregators, rankers, trend calculators, and data sanitizers.

dadbodgeoff
dadbodgeoff
data-ai
open
data-engineering
770

deduplication

Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.

dadbodgeoff
dadbodgeoff
data-ai
open
data-engineering
770

fuzzy-matching

Multi-stage fuzzy matching pipeline for entity reconciliation. PostgreSQL trigram pre-filter, salient overlap check, and multi-factor similarity scoring.

dadbodgeoff
dadbodgeoff
data-ai
open
Previous
Page 16 / 65
Next