lanternino-genova.blogautore.repubblica.it
robots.txt

Resource Scan

Scan Details

Site Domain lanternino-genova.blogautore.repubblica.it
Base Domain repubblica.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-17T18:59:19+00:00
Next Scan 2024-10-16T18:59:19+00:00

Last Successful Scan

Scanned2024-06-25T17:55:09+00:00
URL https://lanternino-genova.blogautore.repubblica.it/robots.txt
Domain IPs 13.226.2.115, 13.226.2.26, 13.226.2.32, 13.226.2.69
Response IP 18.165.171.45
Found Yes
Hash 2fa97dfc77391aa0ce9c9577cb3cff3945148b44eae7b967d0955b2d06cf9558
SimHash 103449602133

Groups

*

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /