yahoo.dev
robots.txt

Robots Exclusion Standard data for yahoo.dev

Resource Scan

Scan Details

Site Domain yahoo.dev
Base Domain yahoo.dev
Scan Status Ok
Last Scan2024-05-17T07:17:28+00:00
Next Scan 2024-05-31T07:17:28+00:00

Last Scan

Scanned2024-05-17T07:17:28+00:00
URL https://yahoo.dev/robots.txt
Redirect https://developer.yahoo.com/robots.txt
Redirect Domain developer.yahoo.com
Redirect Base yahoo.com
Domain IPs 13.248.158.7, 76.223.84.192
Redirect IPs 180.222.116.11, 180.222.116.12, 2406:2000:98:800::e5, 2406:2000:98:800::e6, 2406:2000:e4:1604::1000, 2406:2000:e4:1604::1001
Response IP 180.222.116.12
Found Yes
Hash 37b9833cb4a5b7e14acb8969120c1c39e786e0a1ff0553ce8296b29dc693a37d
SimHash 4d0958054ff2

Groups

*

Rule Path
Disallow /register/
Disallow /test/
Disallow /contact/
Disallow /mailapplications/
Disallow /mobile/content_api/guide/
Disallow /yap/preview/
Disallow /admanager/
Disallow /datax/
Disallow /prestobots/docs/
Disallow /gemini/guide/YAP_analytics.html
Disallow /gemini/guide/YAP_best_practices.html
Disallow /gemini/guide/YAP_canvas_tutorial.html
Disallow /gemini/guide/YAP_examples.html
Disallow /gemini/guide/YAP_faq.html
Disallow /gemini/guide/YAP_getting_started.html
Disallow /gemini/guide/YAP_guide.html
Disallow /gemini/guide/YAP_social_tutorial.html
Disallow /gemini/guide/YAP_troubleshooting.html
Disallow /gemini/guide/advertisers.html
Disallow /gemini/guide/dynamic-parameters.html
Disallow /gemini/guide/error-responses.html
Disallow /gemini/guide/genindex.html
Disallow /gemini/guide/gsg.html
Disallow /gemini/guide/report.html
Disallow /gemini/guide/resources.html
Disallow /f/s/flurry/
Disallow /v/s/vmdn/

Other Records

Field Value
sitemap https://developer.yahoo.com/sitemap.xml