regoproducts.com
robots.txt

Robots Exclusion Standard data for regoproducts.com

Resource Scan

Scan Details

Site Domain regoproducts.com
Base Domain regoproducts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-15T04:34:51+00:00
Next Scan 2025-05-15T04:34:51+00:00

Last Successful Scan

Scanned2025-02-22T03:58:53+00:00
URL https://regoproducts.com/robots.txt
Redirect https://www.regoproducts.com/robots.txt
Redirect Domain www.regoproducts.com
Redirect Base regoproducts.com
Domain IPs 151.101.131.10, 151.101.195.10, 151.101.3.10, 151.101.67.10
Redirect IPs 23.52.171.136, 23.52.171.152, 2600:1413:b000:13::b857:c192, 2600:1413:b000:13::b857:c195
Response IP 42.99.140.184
Found Yes
Hash 209ad28fc11f0c25db40a03c3ad94850b8760982fb5d6ff193f3864d01593936
SimHash d0088922c3f3

Groups

algolia crawler

Rule Path
Allow /

siteauditbot

Rule Path
Allow /

*

Rule Path
Disallow /

Comments

  • Algolia-Crawler-Verif: EECF9C8E1A054772AAA