gofarma.vip
robots.txt

Robots Exclusion Standard data for gofarma.vip

Resource Scan

Scan Details

Site Domain gofarma.vip
Base Domain gofarma.vip
Scan Status Ok
Last Scan2024-05-09T19:33:41+00:00
Next Scan 2024-06-08T19:33:41+00:00

Last Scan

Scanned2024-05-09T19:33:41+00:00
URL https://gofarma.vip/robots.txt
Redirect https://s8.gofarma8.top/robots.txt
Redirect Domain s8.gofarma8.top
Redirect Base gofarma8.top
Domain IPs 104.21.17.244, 172.67.178.226, 2606:4700:3030::6815:11f4, 2606:4700:3032::ac43:b2e2
Redirect IPs 104.21.76.14, 172.67.185.13, 2606:4700:3035::6815:4c0e, 2606:4700:3036::ac43:b90d
Response IP 172.67.185.13
Found Yes
Hash 8cc3b447799595606c5ff3eabffdcf961f626d45cb624d7ed29dcaad8d12ca28
SimHash cd70dc0a66ae

Groups

*

Rule Path
Disallow /yupe/backend*
Disallow /*/default*
Disallow /author
Disallow /vote
Disallow /vote/
Disallow /navigator
Disallow /navigator/
Disallow */page/
Disallow /xmlrpc.php
Disallow /xmlrpc.php?rsd
Disallow /trackback/
Disallow /tag/
Disallow /feed/
Disallow */*/feed/*/
Disallow */feed
Disallow */*/feed
Disallow /*?*
Disallow /?feed=
Disallow /?s=
Disallow /users*
Disallow /cart
Disallow /login

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /author
Disallow /vote
Disallow /vote/
Disallow /navigator
Disallow /navigator/
Disallow */page/
Disallow /xmlrpc.php
Disallow /xmlrpc.php?rsd
Disallow /trackback/
Disallow /tag/
Disallow /feed/
Disallow */*/feed/*/
Disallow */feed
Disallow */*/feed
Disallow /?feed=
Disallow /*?*
Disallow /?s=
Disallow /users*
Disallow /cart
Disallow /login

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://s8.gofarma8.top/sitemap.xml
sitemap https://s8.gofarma8.top/sitemap.xml

Warnings

  • `host` is not a known field.