celebrateboston.com
robots.txt

Robots Exclusion Standard data for celebrateboston.com

Resource Scan

Scan Details

Site Domain celebrateboston.com
Base Domain celebrateboston.com
Scan Status Ok
Last Scan2024-09-14T16:03:57+00:00
Next Scan 2024-09-21T16:03:57+00:00

Last Scan

Scanned2024-09-14T16:03:57+00:00
URL http://celebrateboston.com/robots.txt
Redirect http://www.celebrateboston.com/robots.txt
Redirect Domain www.celebrateboston.com
Redirect Base celebrateboston.com
Domain IPs 107.180.118.255
Redirect IPs 107.180.118.255
Response IP 107.180.118.255
Found Yes
Hash 0862360dff389cdd69f5ffda667faa4cfc6fd1cdb375841366c9a12f6da9881f
SimHash 885ccc642f60

Groups

ia_archiver

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /blog/
Disallow /directory/
Disallow /firsts/
Disallow /forum/
Disallow /event/
Disallow /_private/
Disallow /~str/
Disallow /piwik/
Disallow /recipe/
Disallow /stats/
Disallow /temp/
Disallow /vm/
Disallow /main/sitemap.htm
Disallow /copley-square-hotels-map-v5.htm
Disallow /hotel/10030537-11410440O.html%26lang%3DENG