go.mail.ru
robots.txt

Robots Exclusion Standard data for go.mail.ru

Resource Scan

Scan Details

Site Domain go.mail.ru
Base Domain mail.ru
Scan Status Ok
Last Scan2024-05-14T22:29:08+00:00
Next Scan 2024-06-13T22:29:08+00:00

Last Scan

Scanned2024-05-14T22:29:08+00:00
URL https://go.mail.ru/robots.txt
Domain IPs 5.61.236.243
Response IP 5.61.236.243
Found Yes
Hash 813314281de0e380121494dbcfffd16a6a9a651273d798757e00ea1948b10483
SimHash 2d54928043a1

Groups

*

Rule Path
Allow /$
Allow /m$
Allow /search_images$
Allow /images$
Allow /search_video$
Allow /video$
Allow /news$
Allow /help$
Allow /help.html$
Allow /addurl$
Allow /blog
Allow /*mb%3Drecommender
Allow /*mb%3Dae
Allow /*mb%3Dstorage
Disallow /