msdh.ms.gov
robots.txt

Robots Exclusion Standard data for msdh.ms.gov

Resource Scan

Scan Details

Site Domain msdh.ms.gov
Base Domain ms.gov
Scan Status Ok
Last Scan2024-05-28T04:56:10+00:00
Next Scan 2024-06-27T04:56:10+00:00

Last Scan

Scanned2024-05-28T04:56:10+00:00
URL https://msdh.ms.gov/robots.txt
Domain IPs 205.144.237.192
Response IP 205.144.237.192
Found Yes
Hash 763bb5aa76752a9a70c4a60c5a5a422b25bc327898a938b775e2826d78128031
SimHash 0b1a8b96e76a

Groups

*

Rule Path
Disallow /msdhsite/scripts
Disallow /msdhsite/review
Disallow /Wastewater/
Disallow /Onsite/
Disallow /phs/forms/form502f.htm
Disallow /phs/forms/form522f.htm
Disallow /phs/forms/form523f.htm
Disallow /phs/forms/form502.pdf
Disallow /phs/forms/form522.pdf
Disallow /phs/forms/form523.pdf
Disallow /ochs/phs/default.htm
Disallow /vchek.htm
Disallow /go/
Disallow /documents/
Disallow /recruitment/
Disallow /sanitation/
Disallow /index_images/
Disallow /index_files/
Disallow /Resumes/
Disallow /old/
Disallow /boilwater/
Disallow /calendar/
Disallow /calendars/
Disallow /cancer/
Disallow /DeadBirds/
Disallow /firststeps/
Disallow /images/
Disallow /Immunization/
Disallow /intranet/
Disallow /policy/
Disallow /radiological/
Disallow /std/
Disallow /test/
Disallow /temp/
Disallow /Video/
Disallow /cancer/
Disallow /WellnessSurvey/
Disallow /phr/
Disallow /food/
Disallow /home/
Disallow /web/

browsershots

Rule Path
Disallow

ninjabot

Rule Path
Allow /

Comments

  • This file can be used to affect how search engines and other web site crawlers see your site.
  • For more information, please see http://www.w3.org/TR/html4/appendix/notes.html#h-B.4.1.1
  • WebMatrix 2.0