Send Crawler Logs from Vercel, Fastly or Your Server
See AI crawler visits on any host, with each visit checked against the crawler’s published IP addresses so fake bots are counted apart.
About 5 minutes
What You Need
- A Website Project
- Access to Vercel or Fastly settings, or to your server’s access log
- 1
Create the Endpoint in Searvia
Project › AI Crawlers
Open the website project › AI crawlers › Log sources and choose Vercel or Fastly. Searvia shows a private address for this site.
- 2
Vercel
vercel.com
In Vercel open Team Settings › Drains (Log Drains), add a drain with the Searvia address, choose JSON and the proxy (edge) logs. Paste the verification code and signature secret Vercel shows into Searvia so requests are signed.
- 3
Fastly
manage.fastly.com
In Fastly open your service › Logging › HTTPS, paste the Searvia address as URL, set the method to POST and the format shown in Searvia (one JSON line per request).
- 4
Or Upload a Log File
From any server, upload an nginx or Apache access log (combined format) or a CloudFront standard log, plain or .gz, up to 50 MB.
- 5
Read the Report
Verified visits, fake visits, the status codes crawlers got and the pages where they hit 404 or 5xx errors. Pages with errors also appear in Autopilot.
What You Get
Proof of which AI crawlers really read your site and which pages fail them, on any host.
- Only requests from known search and AI crawlers are kept; other visitors are dropped right away.
Also via MCP:manage_site_health action=add_log_sourcemanage_site_health action=upload_crawler_log