surf-report.com
robots.txt
Robots Exclusion Standard data for surf-report.com
Resource Scan
Scan Details
Site Domain | surf-report.com |
Base Domain | surf-report.com |
Scan Status | Ok |
Last Scan | 2024-11-16T19:57:07+00:00 |
Next Scan | 2024-11-23T19:57:07+00:00 |
Last Scan
Scanned | 2024-11-16T19:57:07+00:00 |
URL | https://surf-report.com/robots.txt |
Redirect | https://www.surf-report.com/robots.txt |
Redirect Domain | www.surf-report.com |
Redirect Base | surf-report.com |
Domain IPs | 137.74.196.30, 2001:41d0:401:3000::299d |
Redirect IPs | 137.74.196.30, 2001:41d0:401:3000::299d |
Response IP | 137.74.196.30 |
Found | Yes |
Hash | 068c572bdfb006f87560a93617e9abc3aa2c1a00d26d76c7a362549e476b5847 |
SimHash | b118cc646393 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /cache/ |
Disallow | /includes/ |
Disallow | /procs/ |
Disallow | /rubriques/ |