stays.io
robots.txt

Robots Exclusion Standard data for stays.io

Resource Scan

Scan Details

Site Domain stays.io
Base Domain stays.io
Scan Status Ok
Last Scan2025-10-13T06:35:19+00:00
Next Scan 2025-11-12T06:35:19+00:00

Last Scan

Scanned2025-10-13T06:35:19+00:00
URL https://stays.io/robots.txt
Redirect https://www.rentbyowner.com/robots.txt
Redirect Domain www.rentbyowner.com
Redirect Base rentbyowner.com
Domain IPs 3.165.75.108, 3.165.75.26, 3.165.75.38, 3.165.75.89
Redirect IPs 13.35.37.13, 13.35.37.77, 13.35.37.89, 13.35.37.94
Response IP 13.35.37.89
Found Yes
Hash 83512f3b3b3124a89676f3d1d814acb90e1cb0428a6e0d23b0524225a8878886
SimHash 771a295de0d3

Groups

*

Rule Path
Disallow /api
Disallow /redirect-partner
Disallow /placeholder-partner
Disallow /partner-reservation
Disallow /listing
Disallow /refine
Disallow /bookmark

google-extended
gptbot
oai-searchbot
chatgpt-user
chatgpt-user/2.0
anthropic-ai
claudebot
claude-user
claudebot-searchbot
claude-web
cohere-ai
applebot
applebot-extended
amazonbot
perplexitybot
perplexity-user
facebookbot
meta-externalagent
linkedinbot
bytespider
duckassistbot
ai2bot
ccbot
diffbot
omgili
timpibot
youbot
mistralai-user

Rule Path
Disallow /api
Disallow /redirect-partner
Disallow /placeholder-partner
Disallow /partner-reservation
Disallow /listing
Disallow /refine
Disallow /bookmark

Other Records

Field Value
crawl-delay 20

bubing
genieo
grapeshot
jamesbot
ltx71
mj12bot
seznambot
dotbot
tineye-bot
pubmatic crawler bot
mappydata
jooblebot
domainstatsbot
pubmaticcrawlerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cdn.rentbyowner.com/sitemap/gz/site-map-all.xml
sitemap https://www.rentbyowner.com/journal/sitemap_index.xml
sitemap https://www.rentbyowner.com/resources/sitemap_index.xml