swebrick.se
robots.txt

Robots Exclusion Standard data for swebrick.se

Resource Scan

Scan Details

Site Domain swebrick.se
Base Domain swebrick.se
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-19T18:48:43+00:00
Next Scan 2025-12-18T18:48:43+00:00

Last Successful Scan

Scanned2025-04-30T03:02:07+00:00
URL https://swebrick.se/robots.txt
Domain IPs 2a02:28f0:302e:a4::, 91.201.60.134
Response IP 91.201.60.134
Found Yes
Hash 3afdbe2dbb2639df024ff8b1bb4e9e2cc12c870e29005ef059af830b9098f9b1
SimHash e21cc672eb9b

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

trendictionbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /