manchesternh.gov
robots.txt

Robots Exclusion Standard data for manchesternh.gov

Resource Scan

Scan Details

Site Domain manchesternh.gov
Base Domain manchesternh.gov
Scan Status Ok
Last Scan2024-10-21T19:13:36+00:00
Next Scan 2024-11-20T19:13:36+00:00

Last Scan

Scanned2024-10-21T19:13:36+00:00
URL https://manchesternh.gov/robots.txt
Redirect https://www.manchesternh.gov/robots.txt
Redirect Domain www.manchesternh.gov
Redirect Base manchesternh.gov
Domain IPs 208.82.76.157
Redirect IPs 208.82.76.157
Response IP 208.82.76.157
Found Yes
Hash 35eb4b73d44cc64eae7503711feb7dec779044b6155a0214bad2b34540a77615
SimHash 0355414ecc07

Groups

gsa-crawler

Rule Path
Allow /Portals/2/Departments/
Allow /Portals/3/library_files/
Allow /Portals/4/SiteContent/
Allow /Portals/5/SiteContent/
Allow /Portals/6/SiteContent/

Other Records

Field Value
crawl-delay 2

sogou spider

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /*/ctl/
Disallow /admin/
Disallow /App_Browsers/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /Config/
Disallow /contest/
Disallow /controls/
Disallow /DesktopModules/
Disallow /Documentation/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /js/
Disallow /Portals/
Disallow /Providers/
Disallow /Resources/ContentRotator/
Disallow /Resources/ControlPanel/
Disallow /Resources/Dashboard/
Disallow /Resources/FeedBrowser/
Disallow /Resources/OpenForceAd/
Disallow /Resources/Search/
Disallow /Resources/Shared/
Disallow /Resources/SkinWidgets/
Disallow /Resources/TabStrip/
Disallow /Resources/Widgets/
Disallow /User-Profile/
Disallow /Default.aspx?tabid=1177&EntryID=974
Disallow /Departments/Police/PoliceBlog/tabid/1177/EntryId/974/
Disallow /Departments/Police/PoliceBlog/tabid/1177/BlogDate/2009-12-31/DateType/month/
Disallow /Departments/Police/PoliceBlog/tabid/1177/EntryId/974/Default.aspx
Disallow /Departments/Police/PoliceBlog/tabid/1177/BlogDate/2009-12-31/DateType/month/Default.aspx
Disallow /mctl/EventDetails/
Disallow /BlogDate/
Disallow /Employee-Login/
Disallow /Employee-Login
Disallow /openenrollment/

Other Records

Field Value
crawl-delay 2