24h Creative IngestionProcessed from Apify Meta & TikTok actors
268,410
+14.8% vs yesterday
Deduplication InterceptsAtomic Redis SHA-256 fingerprint matches
49,120
18.3% duplicate rate blocked
pgvector Query p95 LatencySemantic similarity over 1.4M ad embeddings
38.4 ms
-64ms with HNSW index
HMAC Verified Partner CallsZero unauthenticated requests passed to DB
1,842,910
99.98% auth validity
Ingestion Throughput vs Deduplication Drops
Real-time creative volume processed across BullMQ ingestion queues (Last 7 Days)Indexed Creatives
Duplicates Intercepted
Period: SunIndexed Creatives: 261,800 creativesDuplicates Intercepted: 47,300 creatives
Hover data points to inspect period valuesKey Finding
Peak scraping runs between 02:00-06:00 UTC yielded a 22.4% duplicate webhook frequency, neutralized instantly by the Redis key ring without database write locking.Creative Ingestion & Vector Index Stream
6 records