yahoo.dev
robots.txt
Robots Exclusion Standard data for yahoo.dev
Resource Scan
Scan Details
Site Domain | yahoo.dev |
Base Domain | yahoo.dev |
Scan Status | Ok |
Last Scan | 2024-05-17T07:17:28+00:00 |
Next Scan | 2024-05-31T07:17:28+00:00 |
Last Scan
Scanned | 2024-05-17T07:17:28+00:00 |
URL | https://yahoo.dev/robots.txt |
Redirect | https://developer.yahoo.com/robots.txt |
Redirect Domain | developer.yahoo.com |
Redirect Base | yahoo.com |
Domain IPs | 13.248.158.7, 76.223.84.192 |
Redirect IPs | 180.222.116.11, 180.222.116.12, 2406:2000:98:800::e5, 2406:2000:98:800::e6, 2406:2000:e4:1604::1000, 2406:2000:e4:1604::1001 |
Response IP | 180.222.116.12 |
Found | Yes |
Hash | 37b9833cb4a5b7e14acb8969120c1c39e786e0a1ff0553ce8296b29dc693a37d |
SimHash | 4d0958054ff2 |
Groups
*
Rule | Path |
---|---|
Disallow | /register/ |
Disallow | /test/ |
Disallow | /contact/ |
Disallow | /mailapplications/ |
Disallow | /mobile/content_api/guide/ |
Disallow | /yap/preview/ |
Disallow | /admanager/ |
Disallow | /datax/ |
Disallow | /prestobots/docs/ |
Disallow | /gemini/guide/YAP_analytics.html |
Disallow | /gemini/guide/YAP_best_practices.html |
Disallow | /gemini/guide/YAP_canvas_tutorial.html |
Disallow | /gemini/guide/YAP_examples.html |
Disallow | /gemini/guide/YAP_faq.html |
Disallow | /gemini/guide/YAP_getting_started.html |
Disallow | /gemini/guide/YAP_guide.html |
Disallow | /gemini/guide/YAP_social_tutorial.html |
Disallow | /gemini/guide/YAP_troubleshooting.html |
Disallow | /gemini/guide/advertisers.html |
Disallow | /gemini/guide/dynamic-parameters.html |
Disallow | /gemini/guide/error-responses.html |
Disallow | /gemini/guide/genindex.html |
Disallow | /gemini/guide/gsg.html |
Disallow | /gemini/guide/report.html |
Disallow | /gemini/guide/resources.html |
Disallow | /f/s/flurry/ |
Disallow | /v/s/vmdn/ |
Other Records
Field | Value |
---|---|
sitemap | https://developer.yahoo.com/sitemap.xml |