cv6.org
robots.txt
Robots Exclusion Standard data for cv6.org
Resource Scan
Scan Details
| Site Domain | cv6.org |
| Base Domain | cv6.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-06-09T19:34:19+00:00 |
| Next Scan | 2025-08-08T19:34:19+00:00 |
Last Successful Scan
| Scanned | 2025-03-19T19:32:40+00:00 |
| URL | http://cv6.org/robots.txt |
| Domain IPs | 54.186.246.70 |
| Response IP | 54.186.246.70 |
| Found | Yes |
| Hash | 22a38ce41b4ef6383a1bb5e041c9447d85b2f3a144bc3228d12cbb3e48d9ab32 |
| SimHash | 3158b2c53002 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /1933.htm |
| Disallow | /1941.htm |
| Disallow | /1942.htm |
| Disallow | /1943.htm |
| Disallow | /1944.htm |
| Disallow | /1945.htm |
| Disallow | /1946.htm |
| Disallow | /big_e.htm |
| Disallow | /decoration.htm |
| Disallow | /doolittle.htm |
| Disallow | /gazetteer.htm |
| Disallow | /puc.htm |
| Disallow | /register.htm |
| Disallow | /remember.htm |
| Disallow | /solomons.htm |
| Disallow | /solomons_2.htm |
| Disallow | /solomons_3.htm |
| Disallow | /solomons_4.htm |
| Disallow | /tf16cite.htm |
| Disallow | /tf16speech.htm |
| Disallow | /tf16speech_2.htm |
| Disallow | /_private/ |
| Disallow | /books/ships_store.htm |
| Disallow | /catalog.wci/ |
| Disallow | /cgi-bin/ |
| Disallow | /company/accounts/norberg/default.htm |
| Disallow | /company/muster/display_ag.asp |
| Disallow | /company/muster/display_alpha.asp |
| Disallow | /company/muster/display_unit.asp |
| Disallow | /images/ |
| Disallow | /noumea/ |
| Disallow | /noumea/default.asp |
| Disallow | /noumea/ouemo.asp |
| Disallow | /onboard/ |
| Disallow | /onboard/default.asp |
| Disallow | /onboard/display_forum.asp |
| Disallow | /onboard/display_message.asp |
| Disallow | /remember/remember.htm |
| Disallow | /remember/lore/loreindex.htm |
| Disallow | /revs/ |
| Disallow | /site/schedule.htm |
| Disallow | /site/search.asp |
| Disallow | /site/searcha.asp |
| Disallow | /site/searchtips.asp |
| Disallow | /stats/ |
picosearch/1.0
| Rule | Path |
|---|---|
| Disallow | /1933.htm |
| Disallow | /1941.htm |
| Disallow | /1942.htm |
| Disallow | /1943.htm |
| Disallow | /1944.htm |
| Disallow | /1945.htm |
| Disallow | /1946.htm |
| Disallow | /big_e.htm |
| Disallow | /decoration.htm |
| Disallow | /doolittle.htm |
| Disallow | /gazetteer.htm |
| Disallow | /puc.htm |
| Disallow | /register.htm |
| Disallow | /remember.htm |
| Disallow | /solomons.htm |
| Disallow | /solomons_2.htm |
| Disallow | /solomons_3.htm |
| Disallow | /solomons_4.htm |
| Disallow | /tf16cite.htm |
| Disallow | /tf16speech.htm |
| Disallow | /tf16speech_2.htm |
| Disallow | /_private/ |
| Disallow | /catalog.wci/ |
| Disallow | /cgi-bin/ |
| Disallow | /company/accounts/norberg/default.htm |
| Disallow | /noumea/ouemo.asp |
| Disallow | /remember/remember.htm |
| Disallow | /remember/lore/loreindex.htm |
| Disallow | /revs/ |
| Disallow | /site/search.asp |
| Disallow | /site/searcha.asp |
| Disallow | /site/searchtips.asp |
| Disallow | /stats/ |
Comments