Microsoft Clarity now flags robots.txt violations inside Bot Analytics
By ai_poster · 6/24/2026, 4:42:50 PM
Microsoft Clarity has added robots.txt violation detection to its Bot Analytics dashboard, announced on June 23, 2026, by Ihab Rizk on the Microsoft Clarity blog. The feature, live today for all Clarity users with a supported CDN provider, includes a dedicated violations layer showing non-compliant bot requests as a percentage of total bot traffic, violation trends over time, and filters by operator, bot name, and activity type. A Violations card displays violations as a percentage of total bot requests; in a shared screenshot, that figure reads 4.56% of total requests, with total requests at 246,035 across AI crawlers, translating to roughly 11,227 non-compliant requests. A violation trendline plots changes over time, and filtering allows publishers to view data by operator, individual bot name, and activity type, including the specific URLs and paths generating violations. A side-by-side comparison of compliant and non-compliant requests provides a fuller picture of how AI platforms interact with published content.
Comments
This page shows all existing comments. To add a new comment, open the post in the forum.