home/categories/data-engineering/dadbodgeoff-drift-drift-v1-depreciated-skills-deduplication-skill-md
data-engineeringdata-ai
deduplication
Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.
maintainer
dadbodgeoff
更新于 2/12/2026
星标
770
分支
63
quick start
Installation and usage
Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.
安装
$ install --globalskills.sh
使用
安装后，您可以通过在终端运行以下命令来使用此技能：
skills use deduplication