Log In Sign Up

rusdoc.site
robots.txt

Robots Exclusion Standard data for rusdoc.site

Resource Scan

Scan Details

Site Domain rusdoc.site
Base Domain rusdoc.site
Scan Status Ok
Last Scan2024-05-18T09:34:17+00:00
Next Scan 2024-06-17T09:34:17+00:00

Last Scan

Scanned2024-05-18T09:34:17+00:00
URL https://rusdoc.site/robots.txt
Redirect http://www.rusdoc.site/robots.txt
Redirect Domain www.rusdoc.site
Redirect Base rusdoc.site
Domain IPs 104.21.45.161, 172.67.216.163, 2606:4700:3030::ac43:d8a3, 2606:4700:3034::6815:2da1
Redirect IPs 104.21.45.161, 172.67.216.163, 2606:4700:3030::ac43:d8a3, 2606:4700:3034::6815:2da1
Response IP 104.21.45.161
Found Yes
Hash 822c100c648f27505596f42f047649e1c25eb6e0f7f7372d73ad93eaac13a682
SimHash 6c0118440735

Groups

yandex

Rule Path
Disallow /admin
Disallow */embed
Disallow */feed
Disallow /cgi-bin
Disallow *?s=
Disallow *?product=

*

Rule Path
Disallow /admin
Disallow */embed
Disallow */feed
Disallow /cgi-bin
Disallow *?s=
Disallow *?product=
Back to top

Other Records

Field Value
sitemap http://www.rusdoc.site/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top