AppNod

Free tool

Which AI crawlers visit your app's website?

Drop in your web server's access log. See whether ChatGPT, Claude, Perplexity and Google crawl your site, which pages they read, and whether a firewall turns them away.

Runs in your browser. The log is never uploaded, and nothing is stored. Handles nginx and Apache logs, .gz files, and JSON log lines.

Where to find your log

  • nginx or Apache on your own server: /var/log/nginx/access.log or /var/log/apache2/access.log (older days are in the .gz files next to it).
  • Cloudflare in front of your site: Cloudflare's AI Crawl Control shows the same thing in its dashboard, or export logs with Logpush.
  • Vercel or Netlify: export request logs from the project's logs page or a log drain.
  • Webflow, Framer or Wix: these do not give you raw logs. Use the AI-readiness check to see what crawlers are allowed to read instead.

A week of logs is plenty. User agents can be faked; OpenAI, Anthropic, Perplexity and Google publish their crawler IP ranges if you need to verify a visit.