laprovinciadivarese.it
robots.txt

Robots Exclusion Standard data for laprovinciadivarese.it

Resource Scan

Scan Details

Site Domain laprovinciadivarese.it
Base Domain laprovinciadivarese.it
Scan Status Ok
Last Scan2024-09-25T23:15:29+00:00
Next Scan 2024-10-02T23:15:29+00:00

Last Scan

Scanned2024-09-25T23:15:29+00:00
URL https://laprovinciadivarese.it/robots.txt
Redirect https://www.laprovinciadivarese.it/robots.txt
Redirect Domain www.laprovinciadivarese.it
Redirect Base laprovinciadivarese.it
Domain IPs 104.21.29.143, 172.67.149.67, 2606:4700:3035::ac43:9543, 2606:4700:3037::6815:1d8f
Redirect IPs 104.21.29.143, 172.67.149.67, 2606:4700:3035::ac43:9543, 2606:4700:3037::6815:1d8f
Response IP 104.21.29.143
Found Yes
Hash 11977f9e583a611ac847c808c08ee01256820e2697240274143857aff30e4f93
SimHash ca28c31a08b0

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /ricerca/

arianna

Rule Path
Disallow /

arianna news

Rule Path
Disallow /

arianna web

Rule Path
Disallow /

arianna robot

Rule Path
Disallow /

webnews arianna

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /
Allow /wp-content/uploads/