Log In Sign Up

burlington-nj.net
robots.txt

Robots Exclusion Standard data for burlington-nj.net

Resource Scan

Scan Details

Site Domain burlington-nj.net
Base Domain burlington-nj.net
Scan Status Ok
Last Scan2024-08-29T23:29:03+00:00
Next Scan 2024-09-28T23:29:03+00:00

Last Scan

Scanned2024-08-29T23:29:03+00:00
URL https://burlington-nj.net/robots.txt
Domain IPs 34.85.142.38
Response IP 34.85.142.38
Found Yes
Hash 0d8243ef8fa553a497ce5682f94ec9ee4324d1428d610d75a020744c8ff5606f
SimHash 73dd9d510e39

Groups

googlebot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

googlebot-mobile

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

twitterbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

w3c-checklink

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/
Disallow /m/classes/
Disallow /ourpages

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

accessiblewebbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/temp.jsp
Disallow /m/api

facebookexternalhit

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

rogerbot

Rule Path
Disallow

dotbot

Rule Path
Disallow

riddler

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

scrapybot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

powermapper

Rule Path
Allow /

*

Rule Path
Disallow /
Allow /robots.txt
Back to top

Other Records

Field Value
sitemap https://www.burlington-nj.net/sitemap.xml
Back to top