colibribookstore.com
robots.txt
Robots Exclusion Standard data for colibribookstore.com
Resource Scan
Scan Details
Site Domain | colibribookstore.com |
Base Domain | colibribookstore.com |
Scan Status | Ok |
Last Scan | 2024-09-05T11:28:58+00:00 |
Next Scan | 2024-10-05T11:28:58+00:00 |
Last Scan
Scanned | 2024-09-05T11:28:58+00:00 |
URL | https://colibribookstore.com/robots.txt |
Domain IPs | 104.21.79.13, 172.67.168.176, 2606:4700:3030::6815:4f0d, 2606:4700:3033::ac43:a8b0 |
Response IP | 172.67.168.176 |
Found | Yes |
Hash | 14a223361dd9975d4582af63a0b7aeec6b8493c472b20e5bf8d799796800e0e4 |
SimHash | a560837286b9 |
Groups
*
Rule | Path |
---|---|
Disallow | *utm |
Disallow | *openstat |
Disallow | *home |
Disallow | /var/* |
Disallow | /CVS |
Disallow | /*.svn$ |
Disallow | /*.sql$ |
Disallow | /*.tgz$ |
Disallow | /admin/ |
Disallow | /app/ |
Disallow | /downloader/ |
Disallow | /errors/ |
Disallow | /includes/ |
Disallow | /lib/ |
Disallow | /pkginfo/ |
Disallow | /shell/ |
Disallow | /var/ |
Disallow | /api.php |
Disallow | /cron.php |
Disallow | /cron.sh |
Disallow | /error_log |
Disallow | /get.php |
Disallow | /install.php |
Disallow | /LICENSE.html |
Disallow | /LICENSE.txt |
Disallow | /LICENSE_AFL.txt |
Disallow | /README.txt |
Disallow | /RELEASE_NOTES.txt |
Disallow | /customer/ |
Disallow | /*?dir* |
Disallow | /*?mode=list |
Disallow | /*?limit=* |
Disallow | /*?SID= |
Disallow | /*?dir=asc&order=name |
Disallow | /checkout/ |
Disallow | /onestepcheckout/ |
Disallow | /customer/ |
Disallow | /customer/account/ |
Disallow | /customer/account/login/ |
Disallow | /cgi-bin/ |
Disallow | /cleanup.php |
Disallow | /apc.php |
Disallow | /memcache.php |
Disallow | /phpinfo.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.colibribookstore.com/sitemap.xml |
sitemap | https://www.colibribookstore.com/sitemap-images.xml |
Warnings
- `host` is not a known field.
Comments