meddy.com
robots.txt

Robots Exclusion Standard data for meddy.com

Resource Scan

Scan Details

Site Domain meddy.com
Base Domain meddy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-13T03:39:39+00:00
Next Scan 2024-12-12T03:39:39+00:00

Last Successful Scan

Scanned2023-02-20T00:38:10+00:00
URL https://meddy.com/robots.txt
Redirect https://heliumdoc.com/robots.txt
Redirect Domain heliumdoc.com
Redirect Base heliumdoc.com
Domain IPs 104.26.6.165, 104.26.7.165, 172.67.73.93, 2606:4700:20::681a:6a5, 2606:4700:20::681a:7a5, 2606:4700:20::ac43:495d
Redirect IPs 13.32.110.19, 13.32.110.2, 13.32.110.25, 13.32.110.50, 2600:9000:211a:3c00:a:99ef:ca00:93a1, 2600:9000:211a:4200:a:99ef:ca00:93a1, 2600:9000:211a:6400:a:99ef:ca00:93a1, 2600:9000:211a:7800:a:99ef:ca00:93a1, 2600:9000:211a:8800:a:99ef:ca00:93a1, 2600:9000:211a:c00:a:99ef:ca00:93a1, 2600:9000:211a:c800:a:99ef:ca00:93a1, 2600:9000:211a:f600:a:99ef:ca00:93a1
Response IP 13.33.88.52
Found Yes
Hash 6cefd9e857971ec1b1909a89e24b517f98b2559bb8f1aa1b8d6f6a690b76c6f5
SimHash 6830b8c2c336

Groups

*

Rule Path
Disallow /admin/
Disallow /widget/
Disallow /amp/

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5