floathomes.com
robots.txt

Robots Exclusion Standard data for floathomes.com

Resource Scan

Scan Details

Site Domain floathomes.com
Base Domain floathomes.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-28T10:46:04+00:00
Next Scan 2025-12-12T10:46:04+00:00

Last Successful Scan

Scanned2025-10-20T02:01:13+00:00
URL https://floathomes.com/robots.txt
Redirect https://www.floathomes.com/robots.txt
Redirect Domain www.floathomes.com
Redirect Base floathomes.com
Domain IPs 13.33.183.35, 13.33.183.40, 13.33.183.56, 13.33.183.68
Redirect IPs 13.35.37.16, 13.35.37.68, 13.35.37.76, 13.35.37.84
Response IP 13.35.37.76
Found Yes
Hash acfbdbedd41d5f0b9bb5c40f4e57f7523b3c458ad06838d095d88ef2d5dcd7bc
SimHash 771a615de0c3

Groups

*

Rule Path
Disallow /api
Disallow /redirect-partner
Disallow /placeholder-partner
Disallow /partner-reservation
Disallow /listing
Disallow /refine
Disallow /bookmark

google-extended
gptbot
oai-searchbot
chatgpt-user
chatgpt-user/2.0
anthropic-ai
claudebot
claude-user
claudebot-searchbot
claude-web
cohere-ai
applebot
applebot-extended
amazonbot
perplexitybot
perplexity-user
facebookbot
meta-externalagent
linkedinbot
bytespider
duckassistbot
ai2bot
ccbot
diffbot
omgili
timpibot
youbot
mistralai-user

Rule Path
Disallow /api
Disallow /redirect-partner
Disallow /placeholder-partner
Disallow /partner-reservation
Disallow /listing
Disallow /refine
Disallow /bookmark

Other Records

Field Value
crawl-delay 20

bubing
genieo
grapeshot
jamesbot
ltx71
mj12bot
seznambot
dotbot
tineye-bot
pubmatic crawler bot
mappydata
jooblebot
domainstatsbot
pubmaticcrawlerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cdn.floathomes.com/sitemap/gz/site-map-all.xml