retrocollect.com
robots.txt
Robots Exclusion Standard data for retrocollect.com
Resource Scan
Scan Details
| Site Domain | retrocollect.com |
| Base Domain | retrocollect.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-22T17:48:16+00:00 |
| Next Scan | 2025-12-22T17:48:16+00:00 |
Last Successful Scan
| Scanned | 2025-09-29T23:47:13+00:00 |
| URL | https://retrocollect.com/robots.txt |
| Redirect | https://www.retrocollect.com/robots.txt |
| Redirect Domain | www.retrocollect.com |
| Redirect Base | retrocollect.com |
| Domain IPs | 104.21.20.139, 172.67.192.242, 2606:4700:3031::6815:148b, 2606:4700:3037::ac43:c0f2 |
| Redirect IPs | 104.21.20.139, 172.67.192.242, 2606:4700:3031::6815:148b, 2606:4700:3037::ac43:c0f2 |
| Response IP | 104.21.20.139 |
| Found | Yes |
| Hash | 3e5de002728d40251553ada9ab550bb03da97e3e518111711b0d942c940b2b0b |
| SimHash | 813cd5684189 |
Groups
amazonbot
| Product | Comment |
|---|---|
| amazonbot | Amazon's user agent |
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | disallow this directory |
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /b5ck-up/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | /components/ |
| Disallow | /dbtest/ |
| Disallow | /dev/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /retrocollect2013/ |
| Disallow | /routingtest/ |
| Disallow | /search/ |
| Disallow | /searchdev/ |
| Disallow | /sendy/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /uploading/ |
| Disallow | /xmlrpc/ |
Warnings
- 1 invalid line.
Comments