roomcrush.com
robots.txt

Robots Exclusion Standard data for roomcrush.com

Resource Scan

Scan Details

Site Domain roomcrush.com
Base Domain roomcrush.com
Scan Status Ok
Last Scan2024-11-13T23:38:21+00:00
Next Scan 2024-11-20T23:38:21+00:00

Last Scan

Scanned2024-11-13T23:38:21+00:00
URL https://roomcrush.com/robots.txt
Domain IPs 23.29.145.206
Response IP 23.29.145.206
Found Yes
Hash 4505e36f5d47dfec3e91f1d42bdac79ae4b215c70da18a0ebc0b050b37aed392
SimHash 0c15d100c151

Groups

msnbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Allow /

twitterbot

Rule Path
Allow /images

facebookexternalhit

Rule Path
Allow /images

duckduckbot

Rule Path
Allow /

pinterestbot

Rule Path
Disallow

rogerbot

Rule Path
Disallow

ahrefssiteaudit

Rule Path
Disallow

bingbot

Rule Path
Disallow

yandex

Rule Path
Disallow

yandexbot

Rule Path
Disallow

gptbot

Rule Path
Disallow /