Log In Sign Up

edkey.org
robots.txt

Robots Exclusion Standard data for edkey.org

Resource Scan

Scan Details

Site Domain edkey.org
Base Domain edkey.org
Scan Status Ok
Last Scan2024-08-29T18:06:39+00:00
Next Scan 2024-09-28T18:06:39+00:00

Last Scan

Scanned2024-08-29T18:06:39+00:00
URL https://edkey.org/robots.txt
Redirect https://www.edkey.org/servlet/RobotsFileService
Redirect Domain www.edkey.org
Redirect Base edkey.org
Domain IPs 35.245.59.22
Redirect IPs 35.245.59.22
Response IP 35.245.59.22
Found Yes
Hash abd05d2cdae1128ee2dcb08bb561e5e74327340c834286293f9bc8191ce859c9
SimHash 77dd9d510e39

Groups

googlebot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

googlebot-mobile

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

twitterbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

w3c-checklink

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/
Disallow /m/classes/
Disallow /ourpages

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

accessiblewebbot

Rule Path
Disallow /apps/ajax/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/temp.jsp
Disallow /m/api

facebookexternalhit

Rule Path
Disallow /apps/ajax/
Disallow /apps/classes/
Disallow /apps/directory/
Disallow /apps/events/events_rss.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/view_calendar.jsp
Disallow /apps/events/list_pff.jsp
Disallow /apps/events/calendar_yearly_pff.jsp
Disallow /apps/events/calendar_pff.jsp
Disallow /apps/events/calendar_month_pff.jsp
Disallow /apps/email
Disallow /apps/email/
Disallow /apps/email/index.jsp
Disallow /apps/file_manager/
Disallow /apps/mediaplayer-3-16/
Disallow /apps/ourpages/
Disallow /apps/ourpages
Disallow /apps/forms/
Disallow /apps/login/
Disallow /apps/s/
Disallow /apps/thickbox/
Disallow /apps/tools/
Disallow /apps/videos/
Disallow /apps/cross.jsp
Disallow /apps/temp.jsp
Disallow /m/api
Disallow /m/classes

Other Records

Field Value
crawl-delay 1

rogerbot

Rule Path
Disallow

dotbot

Rule Path
Disallow

riddler

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

scrapybot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

powermapper

Rule Path
Allow /

*

Rule Path
Disallow /
Allow /robots.txt
Back to top

Other Records

Field Value
sitemap https://www.edkey.org/sitemap.xml
Back to top