huffmag.com
robots.txt

Robots Exclusion Standard data for huffmag.com

Resource Scan

Scan Details

Site Domain huffmag.com
Base Domain huffmag.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-14T18:25:07+00:00
Next Scan 2026-01-21T18:25:07+00:00

Last Successful Scan

Scanned2026-01-06T18:24:27+00:00
URL https://huffmag.com/robots.txt
Domain IPs 2a02:4780:84:6a0b:5481:6ce8:3ca3:afd5, 2a02:4780:84:ab06:b01a:f52a:9806:bfa2, 84.32.84.105, 84.32.84.146
Response IP 91.108.100.251
Found Yes
Hash b21120d56956fd65b2475f3111a6cef2dfb23dff9002eca97063258f9003408b
SimHash 4150c1524731

Groups

*

Rule Path
Allow /