neighborhoodlink.com
robots.txt
Robots Exclusion Standard data for neighborhoodlink.com
Resource Scan
Scan Details
| Site Domain | neighborhoodlink.com |
| Base Domain | neighborhoodlink.com |
| Scan Status | Ok |
| Last Scan | 2024-06-07T07:46:42+00:00 |
| Next Scan | 2024-06-14T07:46:42+00:00 |
Last Scan
| Scanned | 2024-06-07T07:46:42+00:00 |
| URL | http://www.neighborhoodlink.com/robots.txt |
| Domain IPs | 198.58.121.174 |
| Response IP | 198.58.121.174 |
| Found | Yes |
| Hash | 5f5606a53394a048af9257ef1aae6721ec2ccb651aba1b746db7f9bedb455506 |
| SimHash | 62d201614692 |
Groups
slurp
| Rule | Path |
|---|---|
| Disallow | /offsite/ |
| Disallow | /cgi-bin/ |
| Disallow | /LIVEWIRE_TEMP- |
| Disallow | /Joke/topics/202761 |
| Disallow | /Joke/topics/200781 |
| Disallow | /zip/schools |
| Disallow | /zip/polygon |
| Disallow | /zip/neighshapes |
| Disallow | /places/polygon |
| Disallow | /places/statepolygon |
| Disallow | /public/passLoginNo.html |
| Disallow | /places/weather |
| Disallow | /login |
| Disallow | /self_serve_advertisers/new |
| Disallow | /*/posts/*/report$ |
| Disallow | /*/posts/*/reply$ |
| Disallow | /admin/comment_mail |
| Disallow | /admin/create_support |
charlotte
discobot
mj12bot
scoutjet
dotbot
turnitinbot
gsa-askrims
aspseek
e-societyrobot
twiceler
seven7b
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /offsite/ |
| Disallow | /cgi-bin/ |
| Disallow | /LIVEWIRE_TEMP- |
| Disallow | /Joke/topics/202761 |
| Disallow | /Joke/topics/200781 |
| Disallow | /zip/schools |
| Disallow | /zip/polygon |
| Disallow | /zip/neighshapes |
| Disallow | /places/polygon |
| Disallow | /places/statepolygon |
| Disallow | /public/passLoginNo.html |
| Disallow | /places/weather |
| Disallow | /login |
| Disallow | /self_serve_advertisers/new |
| Disallow | /*/posts/*/report$ |
| Disallow | /*/posts/*/reply$ |
| Disallow | /admin/comment_mail |
| Disallow | /admin/create_support |
Warnings
- 2 invalid lines.