virtualyard.com.au
robots.txt

Robots Exclusion Standard data for virtualyard.com.au

Resource Scan

Scan Details

Site Domain virtualyard.com.au
Base Domain virtualyard.com.au
Scan Status Ok
Last Scan2025-08-08T00:21:54+00:00
Next Scan 2025-09-07T00:21:54+00:00

Last Scan

Scanned2025-08-08T00:21:54+00:00
URL https://virtualyard.com.au/robots.txt
Domain IPs 35.201.5.87
Response IP 35.201.5.87
Found Yes
Hash a9db7a75942b494679065e8bc84b95d032aeb30f2b26e088bc96ac553e056179
SimHash 0357d272f311

Groups

googlebot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

bing

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

nutch

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

admantx

Rule Path
Disallow /

grapeshot

Rule Path
Allow /

carsnipbot

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2