omegahome.com
robots.txt

Robots Exclusion Standard data for omegahome.com

Resource Scan

Scan Details

Site Domain omegahome.com
Base Domain omegahome.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-28T00:42:51+00:00
Next Scan 2025-10-26T00:42:51+00:00

Last Successful Scan

Scanned2024-06-10T14:10:55+00:00
URL https://omegahome.com/robots.txt
Redirect https://www.omegahome.com/robots.txt
Redirect Domain www.omegahome.com
Redirect Base omegahome.com
Domain IPs 104.21.11.63, 172.67.165.80, 2606:4700:3034::ac43:a550, 2606:4700:3037::6815:b3f
Redirect IPs 104.21.11.63, 172.67.165.80, 2606:4700:3034::ac43:a550, 2606:4700:3037::6815:b3f
Response IP 104.21.11.63
Found Yes
Hash 30065a7431f2ee7c4049c2fd0b51a57df0d1aae3b636fbaddab11987adaf14d3
SimHash 251cd470e582

Groups

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path Comment
Disallow / disallow this directory

petalbot

Product Comment
petalbot Huawei Petal Search
Rule Path
Disallow /

barkrowler

Product Comment
barkrowler Babbar SEO
Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Allow /res/includes/*.js
Allow /res/includes/*.css
Disallow /res/includes/
Disallow /sist/
Disallow /property-search/sist_ajax/

Other Records

Field Value
crawl-delay 85

ahrefsbot

Rule Path
Allow /res/includes/*.js
Allow /res/includes/*.css
Disallow /res/includes/
Disallow /sist/
Disallow /property-search/sist_ajax/

Other Records

Field Value
crawl-delay 85

*

Rule Path
Allow /res/includes/*.js
Allow /res/includes/*.css
Disallow /res/includes/
Disallow /sist/
Disallow /property-search/sist_ajax/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.omegahome.com/sitemap.xml