villaokay.com
robots.txt

Robots Exclusion Standard data for villaokay.com

Resource Scan

Scan Details

Site Domain villaokay.com
Base Domain villaokay.com
Scan Status Ok
Last Scan2026-02-15T05:36:55+00:00
Next Scan 2026-02-22T05:36:55+00:00

Last Scan

Scanned2026-02-15T05:36:55+00:00
URL https://villaokay.com/robots.txt
Redirect https://www.villaokay.com/robots.txt
Redirect Domain www.villaokay.com
Redirect Base villaokay.com
Domain IPs 2a01:5140:131::141, 80.73.131.141
Redirect IPs 2a01:5140:131::141, 80.73.131.141
Response IP 80.73.131.141
Found Yes
Hash 743197b17894ca5cd8752f70d72eae0da2127a98f3c8565d25f9442a174e2584
SimHash 5217cc506698

Groups

twiceler

Rule Path
Disallow /

*

Rule Path
Disallow /*.swf$

*

Rule Path
Disallow /trckr

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seokicks

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

grapeshotcrawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

linguee

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

adsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.villaokay.com/sitemap-index.xml