data-migrations-backfill
Zero-downtime patterns for production schema changes and large backfills, including expand/contract, batching, verification, and rollback strategies
আপনার এজেন্টের জন্য উপযুক্ত সক্ষমতা খুঁজে নিন।
Zero-downtime patterns for production schema changes and large backfills, including expand/contract, batching, verification, and rollback strategies
Evaluate conformance of the event log to discovered models and generate deviation artefacts.
This skill should be used when the user asks to "analyze DBF files", "read DBF data", "query DBF database", "convert DBF to Parquet", "analyze Thai accounting data", "explore legacy database", "run DuckDB queries on DBF", or mentions DBF, Parquet conversion, or Thai legacy accounting systems. Provides comprehensive guidance for reading, converting, and analyzing Thai legacy DBF accounting databases.
Execute chunked historical blockchain data backfills using canonical 1-year pattern. Use when loading multi-year historical data, filling gaps in ClickHouse, or preventing OOM failures on Cloud Run. Keywords chunked_backfill.sh, BigQuery historical, gap filling, memory-safe backfill.
Create and manage Databricks notebooks programmatically. Use when generating ingestion code, creating ETL notebooks, executing Databricks workflows, or when user mentions notebook creation, job automation, or data pipeline implementation in Databricks. Handles notebook generation, execution, and results retrieval.
Fetch ClickHouse Cloud service details from API (organization ID, service endpoints, configuration). Use when setting up new ClickHouse Cloud services, discovering endpoints, or validating service metadata for gapless-crypto-clickhouse project.
Phase 3 of Ontology Builder Pipeline. Synthesizes analysis results into complete Domain Requirement Document (DRD). Use after Phase 2 analysis is complete to generate structured DRD.
Create, alter, and validate Snowflake semantic views using Snowflake CLI (snow). Use when asked to build or troubleshoot semantic views/semantic layer definitions with CREATE/ALTER SEMANTIC VIEW, to validate semantic-view DDL against Snowflake via CLI, or to guide Snowflake CLI installation and connection setup.
Neon serverless PostgreSQL specialist covering auto-scaling, database branching, PITR, and connection pooling. Use when building serverless apps needing PostgreSQL, implementing preview environments, or optimizing database costs.
Ingest the event log, normalise schema, and generate an initial data profile with notebook and manifest updates.
Implement data I/O with immediate DTO conversion using ILoader/ISaver protocols. Use when: building data loaders, result savers, file handlers, model persistence, or any external I/O operations. Triggers: "loader", "saver", "I/O", "file", "parquet", "json", "csv", "persistence", "データ読込", "保存", "永続化", "読み書き". NOT for: data transformation (use processor-impl), business logic (use domain-impl).
Production-ready database schema patterns for AI applications including chat/conversation schemas, RAG document storage with pgvector, multi-tenant organization models, user management, and AI usage tracking. Use when building AI applications, creating database schemas, setting up chat systems, implementing RAG, designing multi-tenant databases, or when user mentions supabase schemas, chat database, RAG storage, pgvector, embeddings, conversation history, or AI application database.
See the main Schema Drift Detection skill for comprehensive coverage of schema drift detection and management.
Writes database schema specifications using Mermaid ER diagrams and defines table structures for multi-tenant entities. Use when designing database schemas, creating entity-relationship diagrams, or specifying database constraints for GloboTicket features.
Run AWS Athena queries against telemetry data. Use when executing SQL against telemetry-parser-db (raw Parquet from telemetry-parser-service) or telemetry_alerts (DBT-transformed tables). Also for Glue catalog exploration, partition debugging, or filtering by $path pseudo-column.
Create and manage database migrations with reversible up/down methods, zero-downtime deployment strategies, and proper schema versioning. Use this skill when creating database migration files, altering table schemas, adding or modifying database indexes, or implementing data migrations. Use when working with migration tools like TypeORM migrations, Sequelize migrations, Alembic (Python), Rails migrations, Flyway, or Liquibase. Use when writing migration files (e.g., YYYYMMDDHHMMSS_migration_name.ts, 001_create_table.sql, versions/*.py) or when modifying database schema in a version-controlled manner. Use when handling backwards compatibility for high-availability deployments or when separating schema changes from data migrations.
Create and manage database migrations following best practices for reversibility, zero-downtime deployments, and safe schema changes. Use this skill when creating new database migrations, writing migration up/down methods, implementing schema changes (adding/removing tables, columns, indexes, constraints), performing data migrations or transformations, refactoring database structure, implementing backwards-compatible migrations, creating indexes on large tables, renaming database objects, or working with migration files in directories like migrations/, db/migrate/, alembic/versions/, or similar. Use when working with ORMs like Sequelize, TypeORM, Prisma, SQLAlchemy, ActiveRecord, Django ORM, or raw SQL migration files.
CODE PHASE (Database): Data layer implementation patterns and best practices. Provides schema design patterns, query optimization strategies, indexing guidelines, data integrity constraints, migration patterns, and database security practices. Use when: designing schemas, writing queries, optimizing performance, planning migrations, implementing data validation, ensuring data integrity.
FiftyOne dataset visualization and curation tool via Podman Quadlet. Multi-container architecture with MongoDB sidecar for dataset persistence. GPU-accelerated for ML workflows. Use when users need to configure, start, or manage FiftyOne for dataset analysis.