✨ New Features

Public Launch

We're officially out of beta! Zipf AI is now available to everyone. Sign up at zipf.ai to get started with 100 free credits.

Workflow API

Set up automated monitoring workflows that run on a schedule until conditions are met. Perfect for:

Monitoring competitors for product launches
Tracking price changes
Watching for news mentions

curl -X POST https://www.zipf.ai/api/v1/workflows \
  -H "Authorization: Bearer wvr_TOKEN" \
  -d '{
    "name": "Monitor NVIDIA H100 availability",
    "workflow_type": "search",
    "operation_config": {
      "query": "NVIDIA H100 in stock",
      "max_results": 20
    },
    "stop_condition": {
      "type": "natural_language",
      "description": "Stop when H100 GPUs are available for purchase"
    },
    "interval_minutes": 60
  }'

Schema Suggestion

Not sure what fields to extract? Use our new /api/v1/crawls/suggest-schema endpoint to get AI-powered extraction schema suggestions for any URL.

curl -X POST https://www.zipf.ai/api/v1/crawls/suggest-schema \
  -H "Authorization: Bearer wvr_TOKEN" \
  -d '{"url": "https://example.com/product"}'

Returns detected page type (e-commerce, blog, etc.) and suggested extraction fields with confidence scores.

⚡ Improvements

Sync Mode for Crawls

Added processing_mode: "sync" option to crawl API. Get results immediately without polling—perfect for small crawls.

Rate Limit Headers

All API responses now include rate limit headers (X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Reset) for proactive throttling.

Better Error Messages

Error responses now include an suggestions array with actionable steps to resolve the issue.

🐛 Bug Fixes

Fixed session URL deduplication not working correctly with URL fragments
Fixed crawl cancellation not releasing reserved credits immediately
Fixed rare race condition in credit reservation during high concurrency

🔒 Security

Implemented webhook signature verification with HMAC-SHA256
Added support for webhook secret rotation
Enhanced API token validation with timing-safe comparison