city-data.com
robots.txt
Robots Exclusion Standard data for city-data.com
Resource Scan
Scan Details
| Site Domain | city-data.com |
| Base Domain | city-data.com |
| Scan Status | Ok |
| Last Scan | 2024-05-23T04:43:45+00:00 |
| Next Scan | 2024-05-30T04:43:45+00:00 |
Last Scan
| Scanned | 2024-05-23T04:43:45+00:00 |
| URL | https://city-data.com/robots.txt |
| Redirect | https://www.city-data.com/robots.txt |
| Redirect Domain | www.city-data.com |
| Redirect Base | city-data.com |
| Domain IPs | 169.62.184.199 |
| Redirect IPs | 169.62.184.199 |
| Response IP | 169.62.184.199 |
| Found | Yes |
| Hash | 7a2b9a8f488c4beeb3c459a0b64367ed4b4fd8d61d0d53d75c7a4a73c4505ab9 |
| SimHash | db6491d2f373 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /forum/search.php* |
| Disallow | /forum/reputation.php* |
| Disallow | /forum/members |
| Disallow | /forum/newreply.php* |
| Disallow | /forum/subscribedforums.php* |
| Disallow | /cityname.php* |
| Disallow | /cityname2.php* |
| Disallow | /news/ |
| Disallow | /forum2/ |
| Disallow | /forumc/ |
| Disallow | /forumbeta/ |
| Disallow | /cityw/ |
| Disallow | /roost_ads/ |
| Disallow | /cd_ads/ |
| Disallow | /forum/fort-myers-cape-coral-area/515615-beware-dr-robert-di-fronzo.html |
| Disallow | /bs/ |
| Disallow | /business-profiles/map.php* |
| Disallow | /so/*.js |
| Disallow | /soz/*.js |
| Disallow | /knowledge/ |
| Disallow | /mapIt.html* |
| Disallow | /restaurants/afd.class.php* |
| Disallow | /city/js/getBoxes.php* |
| Disallow | /county/js/getBoxes.php* |
| Disallow | /zips/js/getBoxes.php* |
| Disallow | /neighborhood/js/getBoxes.php* |
| Disallow | /mtc.class.php* |
| Disallow | /restaurants/menus/ |
| Disallow | /mod_comments/* |
| Disallow | /fc/* |
Warnings
- 3 invalid lines.