jameshawk.pl
robots.txt

Robots Exclusion Standard data for jameshawk.pl

Resource Scan

Scan Details

Site Domain jameshawk.pl
Base Domain jameshawk.pl
Scan Status Ok
Last Scan2025-12-31T10:46:12+00:00
Next Scan 2026-01-30T10:46:12+00:00

Last Scan

Scanned2025-12-31T10:46:12+00:00
URL https://jameshawk.pl/robots.txt
Domain IPs 104.26.2.234, 104.26.3.234, 172.67.72.19, 2606:4700:20::681a:2ea, 2606:4700:20::681a:3ea, 2606:4700:20::ac43:4813
Response IP 172.67.72.19
Found Yes
Hash 42478ac890136bc77a2e08653ea4065fb21f4479bb83015527637586fb2eca67
SimHash 6d181864c3b1

Groups

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /*?filter_