library.educause.edu
robots.txt
Robots Exclusion Standard data for library.educause.edu
Resource Scan
Scan Details
| Site Domain | library.educause.edu |
| Base Domain | educause.edu |
| Scan Status | Ok |
| Last Scan | 2024-09-21T05:30:52+00:00 |
| Next Scan | 2024-10-21T05:30:52+00:00 |
Last Scan
| Scanned | 2024-09-21T05:30:52+00:00 |
| URL | https://library.educause.edu/robots.txt |
| Domain IPs | 104.20.242.84, 104.20.243.84, 172.67.2.68, 2606:4700:10::6814:f254, 2606:4700:10::6814:f354, 2606:4700:10::ac43:244 |
| Response IP | 104.20.243.84 |
| Found | Yes |
| Hash | 46add49f8968825e05df216f1e8f5cc4c530548962500324faca4ffdc4499940 |
| SimHash | 2c5f96f0ac37 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.pdf$ |
| Disallow | /sitecore |
| Disallow | /sitecore_modules |
| Disallow | /sitecore_files |
| Disallow | /temp |
| Disallow | /upload |
| Disallow | /import |
| Disallow | /util |
| Disallow | /StaticFile/Image |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://er.educause.edu/sitemaps/ero_sitemap.xml |
| sitemap | http://library.educause.edu/sitemaps/library_sitemap.xml |
| sitemap | http://members.educause.edu/sitemaps/members_sitemap.xml |
| sitemap | http://members.educause.edu/sitemaps/members_sitemap1.xml |
| sitemap | http://members.educause.edu/sitemaps/members_sitemap2.xml |
| sitemap | http://members.educause.edu/sitemaps/members_sitemap3.xml |
| sitemap | http://members.educause.edu/sitemaps/members_sitemap4.xml |
| sitemap | http://members.educause.edu/sitemaps/members_sitemap5.xml |
| sitemap | http://members.educause.edu/sitemaps/members_sitemap6.xml |
| sitemap | http://events.educause.edu/sitemaps/events_sitemap.xml |
| sitemap | http://www.educause.edu/sitemaps/educause_sitemap.xml |
Warnings
- 2 invalid lines.
Comments