static.ahrefs.com
robots.txt
Robots Exclusion Standard data for static.ahrefs.com
Resource Scan
Scan Details
| Site Domain | static.ahrefs.com |
| Base Domain | ahrefs.com |
| Scan Status | Ok |
| Last Scan | 2025-04-26T07:45:45+00:00 |
| Next Scan | 2025-05-26T07:45:45+00:00 |
Last Scan
| Scanned | 2025-04-26T07:45:45+00:00 |
| URL | https://static.ahrefs.com/robots.txt |
| Domain IPs | 104.18.39.141, 172.64.148.115, 2606:4700:4400::6812:278d, 2606:4700:4400::ac40:9473 |
| Response IP | 172.64.148.115 |
| Found | Yes |
| Hash | a515963caa6aa20f8376b5d39dc9a6c54596ce5540c93c6834faf096164290eb |
| SimHash | ad3001467926 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /article |
| Disallow | /site-explorer/ajax/ |
| Allow | /site-explorer/$ |
| Disallow | /site-explorer/* |
| Allow | /link-intersect/$ |
| Disallow | /link-intersect/* |
| Disallow | /v4* |
| Disallow | /blog/*?s=* |
| Disallow | /blog/*?archive* |
| Disallow | /seo/for/*?*draft |
| Disallow | /academy/*?*draft |
| Disallow | /seo-toolbar/welcome |
| Disallow | /*?input |
| Disallow | /draft/* |
| Allow | /agencies/*?services%5B%5D=* |
| Allow | /agencies/*%26services%5B%5D%3D* |
| Disallow | /agencies/*?*languages%5B%5D=* |
| Disallow | /agencies/*%26*languages%5B%5D%3D* |
| Disallow | /agencies/*?*industries%5B%5D=* |
| Disallow | /agencies/*%26*industries%5B%5D%3D* |
| Disallow | /agencies/*?*budget=* |
| Disallow | /agencies/*%26*budget%3D* |
| Disallow | /agencies/*?*businessSize=* |
| Disallow | /agencies/*%26*businessSize%3D* |
| Disallow | /cdn-cgi/ |