col2.com
robots.txt
Robots Exclusion Standard data for col2.com
Resource Scan
Scan Details
| Site Domain | col2.com |
| Base Domain | col2.com |
| Scan Status | Ok |
| Last Scan | 2024-06-16T19:11:51+00:00 |
| Next Scan | 2024-06-23T19:11:51+00:00 |
Last Scan
| Scanned | 2024-06-16T19:11:51+00:00 |
| URL | http://col2.com/robots.txt |
| Domain IPs | 185.59.204.176 |
| Response IP | 185.59.204.176 |
| Found | Yes |
| Hash | 1d0e4f1e7d5f4a2e8e53b65a865819c3996bb77a29018c5009f13c6005a9d27c |
| SimHash | 68445b10d2f5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /404.php |
| Disallow | /archives/ |
| Disallow | /cgi-bin/ |
| Disallow | /search |
| Disallow | /tag/ |
| Disallow | /trackback/ |
| Disallow | /wp- |
| Disallow | /wp-admin/ |
| Disallow | /wp-content/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-login.php |
| Allow | /feed/$ |
| Disallow | /?s= |
| Disallow | /*? |
| Disallow | /search |
| Disallow | /*.php$ |
| Disallow | /*.js$ |
| Disallow | /*.inc$ |
| Disallow | /*.css$ |
| Disallow | /comments |
| Disallow | /comments/feed |
| Disallow | /feed |
| Disallow | /index.php |
| Disallow | /trackback/ |
| Disallow | /*/comments |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
| Allow | /* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://col2.com/sitemap.xml |
| sitemap | http://col2.com/sitemap.xml.gz |
Comments