targetweb.it
robots.txt

Robots Exclusion Standard data for targetweb.it

Resource Scan

Scan Details

Site Domain targetweb.it
Base Domain targetweb.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-11T01:32:06+00:00
Next Scan 2025-11-25T01:32:06+00:00

Last Successful Scan

Scanned2025-10-26T11:56:55+00:00
URL https://targetweb.it/robots.txt
Domain IPs 86.107.32.164
Response IP 86.107.32.164
Found Yes
Hash a03081e4f4042d7ff3c5cd37d6bd1ddd7640c6e651aff71eb6a11ecc41bdf1f0
SimHash f8cd53310705

Groups

googlebot

Rule Path
Disallow /dealsite/
Disallow /sep/
Disallow /streamsocial/
Disallow /aia/

slurp

Rule Path
Disallow /dealsite/
Disallow /sep/
Disallow /streamsocial/

scooter

Rule Path
Disallow /dealsite/
Disallow /sep/
Disallow /streamsocial/
Disallow /aia/