zabbixtest.graintrack.com
robots.txt

Robots Exclusion Standard data for zabbixtest.graintrack.com

Resource Scan

Scan Details

Site Domain zabbixtest.graintrack.com
Base Domain graintrack.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-31T16:09:58+00:00
Next Scan 2024-10-29T16:09:58+00:00

Last Successful Scan

Scanned2022-06-10T09:45:35+00:00
URL http://zabbixtest.graintrack.com/robots.txt
Response IP 165.227.154.118
Found Yes
Hash 5c269a09ecdce1598460e5c5653249a7b344f93f0bb5f5b04c5460802d77bbd5
SimHash 8811c3d67831

Groups

yandex

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bleriot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

*

Rule Path
Allow /