global.go.com
robots.txt
Robots Exclusion Standard data for global.go.com
Resource Scan
Scan Details
Site Domain | global.go.com |
Base Domain | go.com |
Scan Status | Ok |
Last Scan | 2024-09-07T10:57:00+00:00 |
Next Scan | 2024-10-07T10:57:00+00:00 |
Last Scan
Scanned | 2024-09-07T10:57:00+00:00 |
URL | https://global.go.com/robots.txt |
Domain IPs | 184.51.6.196, 184.51.6.202 |
Response IP | 23.52.40.98 |
Found | Yes |
Hash | 7212164bf1e3c0df248d14e679be57f337b33a2996192c98574952a75f1b4443 |
SimHash | 5b1c725ec59b |
Groups
dcom fast enterprise crawler
Rule | Path |
---|---|
Disallow | /create/art/ |
Disallow | /create/artists/ |
Disallow | /search/ |
Disallow | /johncarter/ |
Disallow | /radiodisneybeta/ |
Allow | /johncarter/?t=0 |
*
Rule | Path |
---|---|
Disallow | /7046/ |
Disallow | /_global/ |
Disallow | /_lib/ |
Disallow | /_modules/ |
Disallow | /*Adserver? |
Disallow | /*mediakit%3D |
Disallow | /ad_test_overpage |
Disallow | /ad_test_overpage_wp |
Disallow | /ads/ |
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /cgi-bin/ |
Disallow | /compoodle/ |
Disallow | /crossdomain/ |
Disallow | /disneyjunior/data/ |
Disallow | /disneyvideos/holidays/easter/*redirect.html |
Disallow | /*?filter_active= |
Disallow | /survey*/ |
Disallow | /error/ |
Disallow | /qa/ |
Disallow | /radiodisneybeta/ |
Disallow | /rss/ |
Disallow | /search/*? |
Disallow | /search/exec/*? |
Disallow | /system/ |
Disallow | /webservices/ |