herd.works
robots.txt

Robots Exclusion Standard data for herd.works

Resource Scan

Scan Details

Site Domain herd.works
Base Domain herd.works
Scan Status Ok
Last Scan2025-12-06T20:13:21+00:00
Next Scan 2026-01-05T20:13:21+00:00

Last Scan

Scanned2025-12-06T20:13:21+00:00
URL https://herd.works/robots.txt
Domain IPs 104.26.4.162, 104.26.5.162, 172.67.69.74, 2606:4700:20::681a:4a2, 2606:4700:20::681a:5a2, 2606:4700:20::ac43:454a
Response IP 104.26.4.162
Found Yes
Hash a8bb0818befa7c2c732958847c49a1d76d86dd1ff621b65ef3a2e277b78f9e19
SimHash 6d48d5456591

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://herd.works/sitemap.xml