directimoveis.com
robots.txt

Robots Exclusion Standard data for directimoveis.com

Resource Scan

Scan Details

Site Domain directimoveis.com
Base Domain directimoveis.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan4/5/2025, 2:07:09 AM
Next Scan 7/4/2025, 2:07:09 AM

Last Successful Scan

Scanned5/18/2024, 1:13:17 AM
URL https://directimoveis.com/robots.txt
Domain IPs 104.21.78.111, 172.67.220.100, 2606:4700:3032::ac43:dc64, 2606:4700:3036::6815:4e6f
Response IP 172.67.220.100
Found Yes
Hash ca3fbfe79f009b6d2873bebe59a8f852c2782286a65ddc7de7677b48435f316b
SimHash 6a54dc9550d3

Groups

facebookexternalhit

Rule Path
Disallow

whatsapp

Rule Path
Disallow

googlebot

Rule Path
Disallow

twitterbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

chatgpt-user

Rule Path
Disallow

webpilot

Rule Path
Disallow

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://directimoveis.com/sitemap.xml