home/categories/data-engineering/dadbodgeoff-drift-drift-v1-depreciated-skills-deduplication-skill-md
data-engineeringdata-ai
deduplication
Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.
maintainer
dadbodgeoff
Updated 2/12/2026
Stars
770
Forks
63
quick start
Installation and usage
Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.
Installation
$ install --globalskills.sh
Usage
Once installed, you can use this skill by running the following command in your terminal:
skills use deduplication