angeo
Contributions
Articles
- How to run a pre-registered scan study (and publish it when the result is null)Sep 06, 2026
- The robots.txt rule that looks like it blocks AI crawlers and does notAug 19, 2026
- Most sites that blocked AI blocked the wrong thingJul 31, 2026
- Your robots.txt Was Written for Googlebot. It's Now Quietly Deciding Whether AI Can Cite You.Jul 24, 2026
- How to Let an AI Agent Complete a Magento 2 Checkout via MCPJul 09, 2026
Comments
- @[Md Siddikur Rahaman] Thanks. Pre-registering was the part that made ...Sep 07, 2026
- @[Gyan] Common enough that I check it first now.
Across 762 live Mage...Aug 20, 2026
- @[QuestMeet] Thanks — the parallel holds. One difference: sites had ...Aug 02, 2026
- @[Tom Smith] Thanks! I think the biggest issue is that most block list...Aug 01, 2026
- @[Jakub Neruda] You're right that `robots.txt` ultimately relies on vo...Aug 01, 2026
chevron_left