Log In Sign Up

y1y.org
robots.txt

Robots Exclusion Standard data for y1y.org

Resource Scan

Scan Details

Site Domain y1y.org
Base Domain y1y.org
Scan Status Ok
Last Scan2024-10-02T03:35:19+00:00
Next Scan 2024-10-09T03:35:19+00:00

Last Scan

Scanned2024-10-02T03:35:19+00:00
URL https://y1y.org/robots.txt
Domain IPs 104.21.44.106, 172.67.198.187, 2606:4700:3030::6815:2c6a, 2606:4700:3031::ac43:c6bb
Response IP 172.67.198.187
Found Yes
Hash 60ab9f451404b65a0c907e3a7e2d0cdd3979edecf1656279a5822bf3ccc6695b
SimHash 6b45da736791

Groups

mediapartners-google

Rule Path
Disallow
Disallow /searchgames/*?q*

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Allow /
Disallow /topfiles/
Disallow /ajax/
Disallow /searchgames/*?q*

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap http://y1y.org/sitemap.xml
Back to top

Comments

  • Crawl-delay: 1
Back to top

Warnings

  • `host` is not a known field.
Back to top