emiliaromagna.miojob.repubblica.it
robots.txt

Robots Exclusion Standard data for emiliaromagna.miojob.repubblica.it

Resource Scan

Scan Details

Site Domain emiliaromagna.miojob.repubblica.it
Base Domain repubblica.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-14T02:59:54+00:00
Next Scan 2024-06-12T02:59:54+00:00

Last Successful Scan

Scanned2023-10-24T01:24:27+00:00
URL http://emiliaromagna.miojob.repubblica.it/robots.txt
Redirect http://www.kataweb.it/robots.txt
Redirect Domain www.kataweb.it
Redirect Base kataweb.it
Domain IPs 213.92.16.101
Redirect IPs 213.92.16.150
Response IP 213.92.16.150
Found Yes
Hash 4ddc6f2801b99d97d974f625da629c44f131f380ea676124c6a4fb529e9bd20f
SimHash a84dcc320c03

Groups

*

Rule Path
Disallow /trovateatri/
Disallow /trovamostre/
Disallow /trovaeventi/week
Disallow /trovaeventi/month
Disallow /trovaeventi/*?
Disallow /trovaconcerti/
Disallow /ricerca
Disallow /agenda

gptbot

Rule Path
Disallow /