doctors.rush.edu
robots.txt

Robots Exclusion Standard data for doctors.rush.edu

Resource Scan

Scan Details

Site Domain doctors.rush.edu
Base Domain rush.edu
Scan Status Ok
Last Scan2024-11-03T10:23:46+00:00
Next Scan 2024-12-03T10:23:46+00:00

Last Scan

Scanned2024-11-03T10:23:46+00:00
URL https://doctors.rush.edu/robots.txt
Domain IPs 18.210.198.20
Response IP 18.210.198.20
Found Yes
Hash c9cb0c31d78e0662deae8e67dbd3489878476d8a6a4f344e8362d8a498c0fb38
SimHash 6d565091c591

Groups

bingbot

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

googlebot

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

googlebot-image

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

googlebot-mobile

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

gsa-crawler

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

ia_archiver

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

idol_bot

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

mediapartners-google

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

psbot

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

sitecheck-sitecrawl by siteimprove.com

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

slurp

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

swiftbot

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

teoma

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

yahoo! slurp

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

yahoo-mmcrawler

Rule Path
Disallow /pdfdownload
Disallow /PDFDownload
Disallow /shared-content
Disallow /Error
Disallow /error
Disallow /vCard
Disallow /PDF_Default
Disallow /pdf_default
Disallow /Transparency
Disallow /transparency
Disallow /PDF_Print
Disallow /pdf_print
Disallow /Kids
Disallow /kids
Disallow /Listings
Disallow /listings

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://doctors.rush.edu/sitemap.xml