allstay.com
robots.txt

Robots Exclusion Standard data for allstay.com

Resource Scan

Scan Details

Site Domain allstay.com
Base Domain allstay.com
Scan Status Ok
Last Scan2024-09-21T22:46:42+00:00
Next Scan 2024-09-28T22:46:42+00:00

Last Scan

Scanned2024-09-21T22:46:42+00:00
URL https://allstay.com/robots.txt
Domain IPs 13.33.30.100, 13.33.30.19, 13.33.30.32, 13.33.30.66
Response IP 13.33.30.32
Found Yes
Hash 1d3367b56e7a6653e140f54256dc13c30e2979b4cf4ba90c88f60ff875500190
SimHash 6818d9a0c782

Groups

*

Rule Path
Disallow /search/
Disallow /my-profile/
Disallow /auth/
Disallow /favorites/
Disallow /recently-viewed/

googlebot
yeti
aolbuild
baidu
bingbot
duckduckgo
yandex
slurp
teoma

Rule Path
Disallow /hotel/

Other Records

Field Value
sitemap https://allstay.com/sitemap.xml

Comments

  • https://www.robotstxt.org/robotstxt.html
  • search engine user-agents' disallowed (but SNS preview user-agents)