Twitxy
Saved
@maxxeight's profile picture
View on X

Max Prin

@maxxeight

Technical #SEO Director @CondeNast • Developer of TechnicalSEO.com • 🇫🇷 🇺🇸
Bend, OR maxprin.com Joined April 2011
438 Following 7.1K Followers 1.6K Posts

Latest posts 5

Max Prin @maxxeight
But many websites block CCbot support.anthropic.com/en/articles/88…
Jason Koebler @jason_koebler Jul 29, 2024
Many websites think they're blocking Anthropic's scrapers but are actually blocking two old bots and NOT the real one

New and renamed AI scraper bots are coming out constantly, and keeping track of all of them is very difficult

404media.co/websites-are-b…
View quoted post on X
Max Prin @maxxeight
With the Search Console API supporting Regex you can get data for multiple specific URLs (e.g. url-1|url-2|...). However, the expression seems to be limited to exactly 4096 characters, so pro tip: remove the domain from each URL and only include the path to include more URLs.