mcboe.net
robots.txt

Robots Exclusion Standard data for mcboe.net

Resource Scan

Scan Details

Site Domain mcboe.net
Base Domain mcboe.net
Scan Status Ok
Last Scan2024-09-18T16:54:42+00:00
Next Scan 2024-10-18T16:54:42+00:00

Last Scan

Scanned2024-09-18T16:54:42+00:00
URL https://mcboe.net/robots.txt
Redirect https://www.mcboe.net/servlet/RobotsFileService
Redirect Domain www.mcboe.net
Redirect Base mcboe.net
Domain IPs 34.145.177.78
Redirect IPs 34.145.177.78
Response IP 34.145.177.78
Found Yes
Hash 298ed4720233bba52cbd5f0aaf51a722704db1dc0e0147f0edd15e85464318ef
SimHash 73dd9d511eb9

Groups

googlebot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

googlebot-mobile

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

twitterbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

w3c-checklink

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/
Disallow /m/classes/
Disallow /ourpages

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

accessiblewebbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/temp.jsp
Disallow /m/api

facebookexternalhit

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

rogerbot

Rule Path
Disallow

dotbot

Rule Path
Disallow

riddler

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

scrapybot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

powermapper

Rule Path
Allow /

*

Rule Path
Disallow /
Allow /robots.txt

Other Records

Field Value
sitemap https://www.mcboe.net/sitemap.xml