AdSpy Engine & Webhook Telemetry
AdTech & Marketing Intelligence SaaS
High-Throughput Apify Pipeline, Vector Creative Search & Partner Ingestion Gateway
Daily Ingestion Throughput

264,810

+14.2% vs yesterday
Normalized Meta & TikTok Apify webhook payloads
Deduplication Efficiency

99.98%

38,412 duplicates purged
Redis TTL idempotency keys (fingerprint:sha256)
pgvector Query Latency

34.2 ms

-68% vs baseline GIN
HNSW index cosine distance across 1.8M ad embeddings
HMAC Partner Rejections

412

0 replay breaches
Invalid signatures & timestamp drift > 300s blocked
Webhook Ingestion vs. Vector Embedding Pipeline
Hourly throughput comparison between raw Apify webhooks and pgvector indexed creatives
Ingested Webhooks (BullMQ)
Vector Indexed (pgvector)
Period: 22:00Ingested Webhooks (BullMQ): 8,900 creatives/hrVector Indexed (pgvector): 8,890 creatives/hr
Hover data points to inspect period values
05,29010,58015,87021,16000:0004:0008:0012:0014:0018:0022:00
Key Finding
Peak webhook burst at 14:00 UTC (18,400 payloads) was ingested and indexed with sub-40ms queue latency without backpressure.
Real-Time Creative Ingestion & Partner API Stream
6 records
Live tracking of scraped ad assets, SHA-256 deduplication state, and pgvector embeddings