easternflorida.edu
robots.txt
Robots Exclusion Standard data for easternflorida.edu
Resource Scan
Scan Details
| Site Domain | easternflorida.edu |
| Base Domain | easternflorida.edu |
| Scan Status | Ok |
| Last Scan | 2024-11-15T20:37:44+00:00 |
| Next Scan | 2024-12-15T20:37:44+00:00 |
Last Scan
| Scanned | 2024-11-15T20:37:44+00:00 |
| URL | https://easternflorida.edu/robots.txt |
| Redirect | https://www.easternflorida.edu:443/robots.txt |
| Redirect Domain | www.easternflorida.edu |
| Redirect Base | easternflorida.edu |
| Domain IPs | 15.197.168.222, 3.33.165.76 |
| Redirect IPs | 3.210.130.100, 3.216.119.25 |
| Response IP | 3.210.130.100 |
| Found | Yes |
| Hash | b812fa6f436c16ed84f2c76758a9569d0d44c6a3786014a7acc89d73ad6bc321 |
| SimHash | 4405d7d0ffd5 |
Groups
*
mediapartners-google
mediapartners-google*
facebookbot
discordbot
bingbot
adsbot-google
bingpreview
deepcrawl
googlebot
googlebot-image
googlebot-mobile
googlebot-video
storebot-google
google-inspectiontool
googleother
apis-google
google-extended
adsbot-google-mobile
feedfetcher-google
googlebot-news
mediapartners-google
stc-bot
searchmetricsbot
twitterbot
yahoo! slurp
archive.org_bot
bingbot
ia_archiver
slurp
spinn3r
gptbot
mj12bot
baiduspider
msnbot
yandex
applebot
duckduckbot
mozilla/5.0 (compatible; konqueror/3.5; linux) khtml/3.5.5 (like gecko) (exabot-thumbnails)
mozilla/5.0 (compatible; exabot/3.0; +http://www.exabot.com/go/robot)
facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
mozilla/5.0 (compatible; integrity/10; +https://peacockmedia.software/mac/integrity/)
deepcrawl
screaming frog
lumar
majestic
sitesucker
swiftbot
ccbot/2.0
ccbot/2.0*
xenu link sleuth
| Rule | Path |
|---|---|
| Disallow | /*/images/* |
| Disallow | /*/nav.inc |
| Disallow | /*/props.inc |
| Disallow | /zz-test |
| Disallow | /go |
| Disallow | /images |
| Disallow | /documents |
| Disallow | /info |
| Disallow | /*/documents/* |
| Disallow | /thanks |
| Disallow | /_resources/xsl |
| Disallow | /_resources/ou |
| Disallow | /_resources/ldp |
| Disallow | /_resources/dmc |
| Disallow | /academics/advising/transfer-plans.php |
| Disallow | /academics/calendar/fall-calendar.php |
| Disallow | /academics/calendar/spring-calendar.php |
| Disallow | /academics/calendar/summer-calendar.php |
| Disallow | /academics/public-safety-institute/brevard-police-testing-selection-center/equivalency-of-training/eot-videos.php |
| Disallow | /admissions/first-time-student-enrollment/first-time-in-college-welcome.php |
| Disallow | /admissions/dual-enrollment/bps-resources.php |
| Disallow | /admissions/enrollment-events/ghga |
| Disallow | /student-handbook/student-appeals-copy.php |
| Disallow | /degrees-certifications |
| Disallow | /faculty-staff/institutional-effectiveness |
| Disallow | /student-housing/application-form.php |
| Disallow | /maintenance.php |
| Disallow | /admissions/outreach.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
adsbot-google
adsbot-google-mobile
googlebot
google-inspectiontool
googlebot-image
bingbot
googlebot-news
googlebot-mobile
googlebot-video
mediapartners-google
facebookbot
duckduckbot
xenu link sleuth
mozilla/5.0 (compatible; integrity/10; +https://peacockmedia.software/mac/integrity/)
| Rule | Path |
|---|---|
| Allow | /_resources/css |
| Allow | /_resources/js |
| Allow | /_resources/fonts |
| Allow | /_resources/images |
| Allow | /_resources/icons |
| Allow | /_resources/php |
| Allow | /_resources/search |
| Allow | /_resources/includes |
| Allow | /images |
| Allow | /info/spring |
| Allow | /info/summer |
| Allow | /info/fall |
| Allow | /info/winter |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.easternflorida.edu/sitemap.xml |
Warnings
- `noindex` is not a known field.
Comments