doctors.rush.edu
robots.txt
Robots Exclusion Standard data for doctors.rush.edu
Resource Scan
Scan Details
Site Domain | doctors.rush.edu |
Base Domain | rush.edu |
Scan Status | Ok |
Last Scan | 2024-11-03T10:23:46+00:00 |
Next Scan | 2024-12-03T10:23:46+00:00 |
Last Scan
Scanned | 2024-11-03T10:23:46+00:00 |
URL | https://doctors.rush.edu/robots.txt |
Domain IPs | 18.210.198.20 |
Response IP | 18.210.198.20 |
Found | Yes |
Hash | c9cb0c31d78e0662deae8e67dbd3489878476d8a6a4f344e8362d8a498c0fb38 |
SimHash | 6d565091c591 |
Groups
bingbot
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
googlebot
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
googlebot-image
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
googlebot-mobile
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
gsa-crawler
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
ia_archiver
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
idol_bot
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
mediapartners-google
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
psbot
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
sitecheck-sitecrawl by siteimprove.com
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
slurp
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
swiftbot
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
teoma
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
yahoo! slurp
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
yahoo-mmcrawler
Rule | Path |
---|---|
Disallow | /pdfdownload |
Disallow | /PDFDownload |
Disallow | /shared-content |
Disallow | /Error |
Disallow | /error |
Disallow | /vCard |
Disallow | /PDF_Default |
Disallow | /pdf_default |
Disallow | /Transparency |
Disallow | /transparency |
Disallow | /PDF_Print |
Disallow | /pdf_print |
Disallow | /Kids |
Disallow | /kids |
Disallow | /Listings |
Disallow | /listings |
*
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://doctors.rush.edu/sitemap.xml |