jerkguru.net
robots.txt

Robots Exclusion Standard data for jerkguru.net

Resource Scan

Scan Details

Site Domain jerkguru.net
Base Domain jerkguru.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-01-30T11:01:27+00:00
Next Scan 2026-04-30T11:01:27+00:00

Last Successful Scan

Scanned2025-09-09T21:04:49+00:00
URL https://jerkguru.net/robots.txt
Domain IPs 104.21.59.172, 172.67.181.94, 2606:4700:3030::ac43:b55e, 2606:4700:3033::6815:3bac
Response IP 172.67.181.94
Found Yes
Hash b7d506b4ad15a2eb5de2034306ed6642732f20bc6407d2e64622879ec470e393
SimHash 4d019a41c7b1

Groups

yandex

Rule Path
Disallow /d/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /d/*

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow /d/*

*

Rule Path
Disallow /d/*

Other Records

Field Value
sitemap https://jerkguru.net/sitemap.xml

Warnings

  • `host` is not a known field.