googlebot(2)

/ Date/ Name
2026.02.13 Bot traffic and AI crawlers: what server logs show

Summary:

Your analytics hides most bots. Your server logs show them all. How to read a log line, spot AI crawlers, tell real Googlebot from fakes, and decide what to do.

Topics:

How the internet works 5 min read

Read
2024.04.19 Log files for SEO: what a small site can learn from them

Summary:

Log file analysis sounds like an enterprise job. On a small site it's a quick way to see what Googlebot actually requests, where it wastes time and which pages it never visits. How to get the logs, what to look for, and when Search Console's crawl stats are enough.

Topics:

Technical SEO 4 min read

Read