home/categories/data-engineering/dadbodgeoff-drift-drift-v1-depreciated-skills-deduplication-skill-md
data-engineeringdata-ai

deduplication

Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.

dadbodgeoff
maintainer
dadbodgeoff
Mis à jour 2/12/2026
Étoiles
770
Forks
63
quick start

Installation and usage

Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.

Installation
$ install --globalskills.sh
Utilisation

Après l'installation, vous pouvez utiliser ce skill en exécutant la commande suivante dans votre terminal :

skills use deduplication