lasierra.edu
robots.txt

Robots Exclusion Standard data for lasierra.edu

Resource Scan

Scan Details

Site Domain lasierra.edu
Base Domain lasierra.edu
Scan Status Ok
Last Scan2025-03-10T02:51:39+00:00
Next Scan 2025-04-09T02:51:39+00:00

Last Scan

Scanned2025-03-10T02:51:39+00:00
URL https://lasierra.edu/robots.txt
Domain IPs 192.156.214.2
Response IP 192.156.214.2
Found Yes
Hash a29c921a356e2b85e6fc4fa558a7b524e328f0482453bdc65d5fa1c65db0aaba
SimHash b81cfeaf0bd7

Groups

*

Rule Path
Disallow /*eID*
Disallow /*?rave.php*
Disallow /fileadmin/AAA/
Disallow /fileadmin/documents/AAA/
Disallow /esem/pixel.php*
Disallow /esem/
Disallow /*ADMCMD_prev*
Disallow /typo3/
Disallow /typo3_src/
Disallow /mailer/
Disallow /fileadmin/documents/leaf/leaf-minor-waiver.pdf
Disallow /records-office/directory/
Disallow /3d/salsu/visions/2017/index.html
Disallow /3d/*
Disallow /fileadmin/documents/oacs/curriculum-sheets-pre-health/20*
Disallow /fileadmin/documents/oacs/curriculum-sheets-majors/20*
Disallow /fileadmin/documents/oacs/curriculum-sheets-minor/20*
Disallow /fileadmin/documents/oacs/curriculum-sheets-honors/20*
Disallow /fileadmin/documents/oacs/curriculum-sheets-pre-professional/20*
Disallow /fileadmin/documents/library/criterion/*
Disallow /fileadmin/documents/bulletins/undergraduate-bulletin-*
Disallow /fileadmin/documents/bulletins/graduate-bulletin-*

googlebot-image

Rule Path
Disallow /fileadmin/_processed_/csm_shirley-gregg*.jpg
Disallow /fileadmin/*shirley-gregg*.jpg
Disallow /uploads/RTEmagicC_gregg_s.jpg.jpg
Disallow /fileadmin/_processed_/csm_kimberly-hall*.jpg
Disallow /fileadmin/*kimberly-hall*.jpg

ccbot*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

scoutjet

Rule Path
Disallow /

sogou*

Rule Path
Disallow /

genieo

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bing

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10