Agentic Web Today

Letter from the Editor

“The internet is owned by robots.”

This week, two related agentic web headlines caught my eye. First, Cloudlfare did a deepdive on the nuances of AI crawler behavior and how it changes how the internet caches content. Next, I read that bots are now the the internet's primary traffic (first top story today). Taken together, we see this new, volatile and unpredictable entrant to the internet that is crawling in odd and inefficient ways now owning the lionshare of global traffic. Read both of these.

— Jake