swedenherald.com
robots.txt

Robots Exclusion Standard data for swedenherald.com

Resource Scan

Scan Details

Site Domain swedenherald.com
Base Domain swedenherald.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-18T18:55:22+00:00
Next Scan 2026-01-17T18:55:22+00:00

Last Successful Scan

Scanned2025-09-20T10:33:06+00:00
URL https://swedenherald.com/robots.txt
Domain IPs 104.26.6.170, 104.26.7.170, 172.67.74.212, 2606:4700:20::681a:6aa, 2606:4700:20::681a:7aa, 2606:4700:20::ac43:4ad4
Response IP 172.67.74.212
Found Yes
Hash 8e187e42a5ef1021bf7867400861780ab6606e9cd482e2b3a05ba5c8879a12e8
SimHash 6d115e11c593

Groups

*

Rule Path
Disallow
Allow /weather

Other Records

Field Value
sitemap https://swedenherald.com/sitemap.xml
sitemap https://swedenherald.com/api/newssitemap

Comments

  • Allow crawling of weather-related content