cosyproject.com
robots.txt
Robots Exclusion Standard data for cosyproject.com
Resource Scan
Scan Details
| Site Domain | cosyproject.com |
| Base Domain | cosyproject.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-21T08:48:18+00:00 |
| Next Scan | 2024-10-05T08:48:18+00:00 |
Last Successful Scan
| Scanned | 2024-08-30T07:04:19+00:00 |
| URL | https://cosyproject.com/robots.txt |
| Redirect | https://www.cosyproject.com/robots.txt |
| Redirect Domain | www.cosyproject.com |
| Redirect Base | cosyproject.com |
| Domain IPs | 52.65.122.191 |
| Redirect IPs | 108.156.133.108, 108.156.133.113, 108.156.133.14, 108.156.133.80 |
| Response IP | 108.156.133.14 |
| Found | Yes |
| Hash | b4bc774c38f9f2a340e101d1ae7e4882de3c02af4b0b8d3473bc718d4a104949 |
| SimHash | 8704f65543f3 |
Groups
googlebot-image
| Rule | Path | Comment |
|---|---|---|
| Disallow | - | |
| Allow | /*?p= | - |
| Disallow | /404/ | - |
| Disallow | /app/ | - |
| Disallow | /cgi-bin/ | - |
| Disallow | /downloader/ | - |
| Disallow | /errors/ | - |
| Disallow | /includes/ | - |
| Disallow | /magento/ | - |
| Disallow | /pkginfo/ | - |
| Disallow | /report/ | - |
| Disallow | /scripts/ | - |
| Disallow | /shell/ | - |
| Disallow | /skin/ | - |
| Disallow | /stats/ | - |
| Disallow | /var/ | - |
| Disallow | /index.php/ | - |
| Disallow | /catalog/product_compare/ | - |
| Disallow | /catalog/category/view/ | - |
| Disallow | /catalog/product/view/ | - |
| Disallow | /catalog/product/gallery/ | - |
| Disallow | /catalogsearch/ | - |
| Disallow | /control/ | - |
| Disallow | /contacts/ | - |
| Disallow | /checkout/ | - |
| Disallow | /customer/ | - |
| Disallow | /customize/ | - |
| Disallow | /newsletter/ | - |
| Disallow | /poll/ | - |
| Disallow | /sendfriend/ | - |
| Disallow | /tag/ | - |
| Disallow | /wishlist/ | - |
| Disallow | /cron.php | - |
| Disallow | /cron.sh | - |
| Disallow | /error_log | - |
| Disallow | /install.php | - |
| Disallow | /LICENSE.html | - |
| Disallow | /LICENSE.txt | - |
| Disallow | /LICENSE_AFL.txt | - |
| Disallow | /STATUS.txt | - |
| Disallow | /get.php | Magento 1.5+ |
| Disallow | /*.php$ | - |
| Disallow | /*?SID= | - |
| Disallow | /rss* | - |
| Disallow | /*PHPSESSID | - |
| Disallow | /blog/wp-content/upgrade/ | - |
| Disallow | /blog/wp-admin/ | - |
| Disallow | /blog/wp-includes/ | - |
| Disallow | /*?p=*& | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cosyproject.com/sitemap.xml |
Comments