Twitxy Saved

Arnout Hellemans

@hellemans

Online Strategy Consultant with a focus on #SEO, #SEA, #CRO, furthermore into #gadgets, #Android mobile phones and (offline) cooking. Online since 1992...
Amsterdam onlinemarkethink.com Joined May 2008
6.7K Following 8.3K Followers 49K Posts

Latest posts 5

Arnout Hellemans @hellemans
Building their own search engine is my take from this. But that's quite the job. Interesting times!
Carl Hendy Verified account @carlhendy Oct 23
We've been reviewing around 1.5 billion server requests, so I thought I'd share a few observations.

There's been some interesting discussion recently about how much traffic AI assistants actually send to websites.

Worth checking out the research and perspectives from @Marie_Haynes , Kevin Indig, The SEO Works, @randfish and Michael King. Different datasets, methodologies and opinions, all worth reading.

Firstly, AI referral traffic remains small compared with Google organic. Our findings broadly agree with the other studies. However, server logs reveal another layer of activity that traditional analytics doesn't capture.

Some interesting changes we've observed since mid-August:

✳️ ChatGPT live reads: Verified ChatGPT-User requests have fallen by approximately 80%.

✳️ OpenAI crawling: Verified OAI-SearchBot requests have more than doubled over the same period.

✳️ Claude Code: We recorded approximately 26x growth in distinct sources accessing websites between June and September, predominantly technical documentation.

The change in ChatGPT's behaviour is particularly interesting. It's consistent with a shift towards crawling and indexing content in advance, rather than fetching pages during individual conversations.

Of course, an AI agent fetching a page doesn't mean someone saw a recommendation, let alone made a purchase. But that doesn't make the activity irrelevant either.

It highlights why referral traffic, agent activity and indexing need to be considered separately.

Interested to hear whether others analysing server logs are seeing similar patterns.
View quoted post on X