barzellette.net
robots.txt

Robots Exclusion Standard data for barzellette.net

Resource Scan

Scan Details

Site Domain barzellette.net
Base Domain barzellette.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-03T21:19:09+00:00
Next Scan 2024-12-02T21:19:09+00:00

Last Successful Scan

Scanned2023-11-09T10:15:05+00:00
URL https://barzellette.net/robots.txt
Redirect https://www.barzellette.net/robots.txt
Redirect Domain www.barzellette.net
Redirect Base barzellette.net
Domain IPs 104.21.49.153, 172.67.164.188, 2606:4700:3034::ac43:a4bc, 2606:4700:3037::6815:3199
Redirect IPs 104.21.49.153, 172.67.164.188, 2606:4700:3034::ac43:a4bc, 2606:4700:3037::6815:3199
Response IP 172.67.164.188
Found Yes
Hash 022eb98ff2e6f6c34d04fe5dfb79f78beec5b2b90e95ed0de86097e1e0ebb4dc
SimHash 905ec1422fb1

Groups

*

Rule Path
Disallow /engine/

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow