global.go.com
robots.txt
Robots Exclusion Standard data for global.go.com
Resource Scan
Scan Details
| Site Domain | global.go.com |
| Base Domain | go.com |
| Scan Status | Ok |
| Last Scan | 2024-06-09T04:03:30+00:00 |
| Next Scan | 2024-07-09T04:03:30+00:00 |
Last Scan
| Scanned | 2024-06-09T04:03:30+00:00 |
| URL | https://global.go.com/robots.txt |
| Domain IPs | 125.56.219.2, 23.32.29.106 |
| Response IP | 23.52.40.106 |
| Found | Yes |
| Hash | 7212164bf1e3c0df248d14e679be57f337b33a2996192c98574952a75f1b4443 |
| SimHash | 5b1c725ec59b |
Groups
dcom fast enterprise crawler
| Rule | Path |
|---|---|
| Disallow | /create/art/ |
| Disallow | /create/artists/ |
| Disallow | /search/ |
| Disallow | /johncarter/ |
| Disallow | /radiodisneybeta/ |
| Allow | /johncarter/?t=0 |
*
| Rule | Path |
|---|---|
| Disallow | /7046/ |
| Disallow | /_global/ |
| Disallow | /_lib/ |
| Disallow | /_modules/ |
| Disallow | /*Adserver? |
| Disallow | /*mediakit%3D |
| Disallow | /ad_test_overpage |
| Disallow | /ad_test_overpage_wp |
| Disallow | /ads/ |
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | /cgi-bin/ |
| Disallow | /compoodle/ |
| Disallow | /crossdomain/ |
| Disallow | /disneyjunior/data/ |
| Disallow | /disneyvideos/holidays/easter/*redirect.html |
| Disallow | /*?filter_active= |
| Disallow | /survey*/ |
| Disallow | /error/ |
| Disallow | /qa/ |
| Disallow | /radiodisneybeta/ |
| Disallow | /rss/ |
| Disallow | /search/*? |
| Disallow | /search/exec/*? |
| Disallow | /system/ |
| Disallow | /webservices/ |