radio-one.com
robots.txt
Robots Exclusion Standard data for radio-one.com
Resource Scan
Scan Details
Site Domain | radio-one.com |
Base Domain | radio-one.com |
Scan Status | Ok |
Last Scan | 2024-11-09T16:53:14+00:00 |
Next Scan | 2024-11-16T16:53:14+00:00 |
Last Scan
Scanned | 2024-11-09T16:53:14+00:00 |
URL | http://radio-one.com/robots.txt |
Redirect | https://urban1.com/robots.txt |
Redirect Domain | urban1.com |
Redirect Base | urban1.com |
Domain IPs | 151.101.194.159 |
Redirect IPs | 151.101.130.159 |
Response IP | 151.101.130.159 |
Found | Yes |
Hash | 1cc8a95231d326baa66dc217b5735673d68b6750d55aa892bb33af1d8677ad09 |
SimHash | a4c4cd482dca |
Groups
*
Rule | Path |
---|---|
Disallow | /calendar/action%3Aposterboard/ |
Disallow | /calendar/action%3Aagenda/ |
Disallow | /calendar/action%3Aoneday/ |
Disallow | /calendar/action%3Amonth/ |
Disallow | /calendar/action%3Aweek/ |
Disallow | /calendar/action%3Amap/ |
Disallow | /calendar/action~posterboard/ |
Disallow | /calendar/action~agenda/ |
Disallow | /calendar/action~oneday/ |
Disallow | /calendar/action~month/ |
Disallow | /calendar/action~week/ |
Disallow | /calendar/action~stream/ |
Disallow | /events/action~posterboard/ |
Disallow | /events/action~agenda/ |
Disallow | /events/action~oneday/ |
Disallow | /events/action~month/ |
Disallow | /events/action~week/ |
Disallow | /events/action~stream/ |
Comments