tarpdata.com
robots.txt

Robots Exclusion Standard data for tarpdata.com

Resource Scan

Scan Details

Site Domain tarpdata.com
Base Domain tarpdata.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-22T08:56:25+00:00
Next Scan 2025-11-21T08:56:25+00:00

Last Successful Scan

Scanned2025-08-31T05:23:03+00:00
URL http://tarpdata.com/robots.txt
Redirect http://www.tarpdata.com/robots.txt
Redirect Domain www.tarpdata.com
Redirect Base tarpdata.com
Domain IPs 173.236.136.114
Redirect IPs 173.236.136.114
Response IP 173.236.136.114
Found Yes
Hash ef0511de64504c274d7591edb29ca4d278ace4474f79b5047a2e88fb2bca1e08
SimHash 2d214260f682

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /images/
Disallow /tmp/
Disallow /private/