AdSpy Engine & Ingestion Console
B2B Marketing Tech & Ad Intelligence SaaS
High-Throughput Apify Pipeline, pgvector Semantic Index & HMAC Security Manager
24h Creative Ingestion

268,410

+14.8% vs yesterday
Processed from Apify Meta & TikTok actors
Deduplication Intercepts

49,120

18.3% duplicate rate blocked
Atomic Redis SHA-256 fingerprint matches
pgvector Query p95 Latency

38.4 ms

-64ms with HNSW index
Semantic similarity over 1.4M ad embeddings
HMAC Verified Partner Calls

1,842,910

99.98% auth validity
Zero unauthenticated requests passed to DB
Ingestion Throughput vs Deduplication Drops
Real-time creative volume processed across BullMQ ingestion queues (Last 7 Days)
Indexed Creatives
Duplicates Intercepted
Period: SunIndexed Creatives: 261,800 creativesDuplicates Intercepted: 47,300 creatives
Hover data points to inspect period values
078,229156,458234,687312,916MonTueWedThuFriSatSun
Key Finding
Peak scraping runs between 02:00-06:00 UTC yielded a 22.4% duplicate webhook frequency, neutralized instantly by the Redis key ring without database write locking.
Creative Ingestion & Vector Index Stream
6 records
Inspect real-time payloads, dedup validation hashes, and pgvector embedding status