heliumdoc.com
robots.txt

Robots Exclusion Standard data for heliumdoc.com

Resource Scan

Scan Details

Site Domain heliumdoc.com
Base Domain heliumdoc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-17T16:32:10+00:00
Next Scan 2024-06-15T16:32:10+00:00

Last Successful Scan

Scanned2023-02-17T02:40:41+00:00
URL https://heliumdoc.com/robots.txt
Domain IPs 2600:9000:2003:1600:a:99ef:ca00:93a1, 2600:9000:2003:4000:a:99ef:ca00:93a1, 2600:9000:2003:4800:a:99ef:ca00:93a1, 2600:9000:2003:7000:a:99ef:ca00:93a1, 2600:9000:2003:800:a:99ef:ca00:93a1, 2600:9000:2003:8c00:a:99ef:ca00:93a1, 2600:9000:2003:a200:a:99ef:ca00:93a1, 2600:9000:2003:c600:a:99ef:ca00:93a1, 54.192.150.28, 54.192.150.36, 54.192.150.45, 54.192.150.84
Response IP 54.192.150.84
Found Yes
Hash 6cefd9e857971ec1b1909a89e24b517f98b2559bb8f1aa1b8d6f6a690b76c6f5
SimHash 6830b8c2c336

Groups

*

Rule Path
Disallow /admin/
Disallow /widget/
Disallow /amp/

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5