home/categories/data-engineering/dadbodgeoff-drift-drift-v1-depreciated-skills-deduplication-skill-md
data-engineeringdata-ai

deduplication

Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.

dadbodgeoff
maintainer
dadbodgeoff
آخر تحديث 2/12/2026
النجوم
770
التفرعات
63
quick start

Installation and usage

Event deduplication with canonical selection, reputation scoring, and hash-based grouping for multi-source data aggregation. Handles both ID-based and content-based deduplication.

التثبيت
$ install --globalskills.sh
الاستخدام

بعد التثبيت، يمكنك استخدام هذه المهارة بتشغيل الأمر التالي في الطرفية:

skills use deduplication