auto.it
robots.txt

Robots Exclusion Standard data for auto.it

Resource Scan

Scan Details

Site Domain auto.it
Base Domain auto.it
Scan Status Ok
Last Scan2024-09-24T06:10:36+00:00
Next Scan 2024-10-01T06:10:36+00:00

Last Scan

Scanned2024-09-24T06:10:36+00:00
URL https://auto.it/robots.txt
Redirect https://www.auto.it/robots.txt
Redirect Domain www.auto.it
Redirect Base auto.it
Domain IPs 3.248.203.153
Redirect IPs 96.17.96.21, 96.17.96.28
Response IP 23.44.4.186
Found Yes
Hash f8aa23a3fb4b82274ebfb782725f3d104418a9ad9e3cbaaf61669c987e7b1fb8
SimHash ed1dd8a0ebe6

Groups

psbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

npbot

Rule Path
Disallow /

*

Rule Path
Disallow /account/
Disallow /search
Disallow /annunci/search
Disallow /temp
Disallow /test
Disallow /_next/