digitalcommons.gardner-webb.edu
robots.txt

Robots Exclusion Standard data for digitalcommons.gardner-webb.edu

Resource Scan

Scan Details

Site Domain digitalcommons.gardner-webb.edu
Base Domain gardner-webb.edu
Scan Status Ok
Last Scan2025-03-28T17:09:39+00:00
Next Scan 2025-04-27T17:09:39+00:00

Last Scan

Scanned2025-03-28T17:09:39+00:00
URL https://digitalcommons.gardner-webb.edu/robots.txt
Domain IPs 13.57.92.51, 50.18.241.247
Response IP 13.57.92.51
Found Yes
Hash 81b9d74148e55307da72c579fda1cd8a182690a8abef73209af2b184d9cd6aa0
SimHash 60cc8e70567b

Groups

popetech-crawlbot

Rule Path
Disallow

popetech-scanbot

Rule Path
Disallow

*

Rule Path
Disallow /cgi/areyousure.cgi
Disallow /cgi/author_dashboard.cgi
Disallow /cgi/author_downloads.cgi
Disallow /cgi/cgs_survey.cgi
Disallow /cgi/confirm.cgi
Disallow /cgi/disciplines.cgi
Disallow /cgi/editor.cgi
Disallow /cgi/errordoc.cgi
Disallow /cgi/help.cgi
Disallow /cgi/institutions.cgi
Disallow /cgi/ir_submit.cgi
Disallow /cgi/login.cgi
Disallow /cgi/mail_assets.cgi
Disallow /cgi/maileditor.cgi
Disallow /cgi/mysubscriptions.cgi
Disallow /cgi/nellco_setup.cgi
Disallow /cgi/notification.cgi
Disallow /cgi/openurl_forwarder.cgi
Disallow /cgi/proquest_setup.cgi
Disallow /cgi/query.cgi
Disallow /cgi/review_history.cgi
Disallow /cgi/site_setup.cgi
Disallow /cgi/submit.cgi
Disallow /cgi/submit_lawreview.cgi
Disallow /cgi/subscription_orders.cgi
Disallow /cgi/subscription_request.cgi
Disallow /cgi/unsubscribe.cgi
Disallow /cgi/upload_additional.cgi
Disallow /cgi/user_subscribe.cgi
Disallow /cgi/useradd.cgi
Disallow /areyousure.cgi
Disallow /author_dashboard.cgi
Disallow /author_downloads.cgi
Disallow /cgs_survey.cgi
Disallow /confirm.cgi
Disallow /disciplines.cgi
Disallow /editor.cgi
Disallow /errordoc.cgi
Disallow /help.cgi
Disallow /institutions.cgi
Disallow /ir_submit.cgi
Disallow /login.cgi
Disallow /mail_assets.cgi
Disallow /maileditor.cgi
Disallow /mysubscriptions.cgi
Disallow /nellco_setup.cgi
Disallow /notification.cgi
Disallow /openurl_forwarder.cgi
Disallow /proquest_setup.cgi
Disallow /query.cgi
Disallow /review_history.cgi
Disallow /site_setup.cgi
Disallow /submit.cgi
Disallow /submit_lawreview.cgi
Disallow /subscription_orders.cgi
Disallow /subscription_request.cgi
Disallow /unsubscribe.cgi
Disallow /upload_additional.cgi
Disallow /user_subscribe.cgi
Disallow /useradd.cgi
Disallow /do/email_editor
Disallow /do/
Disallow /fe-journals/

Other Records

Field Value
sitemap https://digitalcommons.gardner-webb.edu/siteindex.xml
sitemap https://digitalcommons.gardner-webb.edu/exhibit/sitemap.xml

Warnings

  • 2 invalid lines.