digitalmaine.com
robots.txt
Robots Exclusion Standard data for digitalmaine.com
Resource Scan
Scan Details
| Site Domain | digitalmaine.com |
| Base Domain | digitalmaine.com |
| Scan Status | Ok |
| Last Scan | 2025-06-21T23:04:41+00:00 |
| Next Scan | 2025-07-21T23:04:41+00:00 |
Last Scan
| Scanned | 2025-06-21T23:04:41+00:00 |
| URL | https://digitalmaine.com/robots.txt |
| Domain IPs | 13.57.92.51, 50.18.241.247 |
| Response IP | 50.18.241.247 |
| Found | Yes |
| Hash | bf739afa8ca07466c354b0357498366ec0f6c7b104bed3aebca6c90df36de45f |
| SimHash | 60c42c74465b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi/areyousure.cgi |
| Disallow | /cgi/author_dashboard.cgi |
| Disallow | /cgi/author_downloads.cgi |
| Disallow | /cgi/cgs_survey.cgi |
| Disallow | /cgi/confirm.cgi |
| Disallow | /cgi/disciplines.cgi |
| Disallow | /cgi/editor.cgi |
| Disallow | /cgi/errordoc.cgi |
| Disallow | /cgi/help.cgi |
| Disallow | /cgi/institutions.cgi |
| Disallow | /cgi/ir_submit.cgi |
| Disallow | /cgi/login.cgi |
| Disallow | /cgi/mail_assets.cgi |
| Disallow | /cgi/maileditor.cgi |
| Disallow | /cgi/mysubscriptions.cgi |
| Disallow | /cgi/nellco_setup.cgi |
| Disallow | /cgi/notification.cgi |
| Disallow | /cgi/openurl_forwarder.cgi |
| Disallow | /cgi/proquest_setup.cgi |
| Disallow | /cgi/query.cgi |
| Disallow | /cgi/review_history.cgi |
| Disallow | /cgi/site_setup.cgi |
| Disallow | /cgi/submit.cgi |
| Disallow | /cgi/submit_lawreview.cgi |
| Disallow | /cgi/subscription_orders.cgi |
| Disallow | /cgi/subscription_request.cgi |
| Disallow | /cgi/unsubscribe.cgi |
| Disallow | /cgi/upload_additional.cgi |
| Disallow | /cgi/user_subscribe.cgi |
| Disallow | /cgi/useradd.cgi |
| Disallow | /areyousure.cgi |
| Disallow | /author_dashboard.cgi |
| Disallow | /author_downloads.cgi |
| Disallow | /cgs_survey.cgi |
| Disallow | /confirm.cgi |
| Disallow | /disciplines.cgi |
| Disallow | /editor.cgi |
| Disallow | /errordoc.cgi |
| Disallow | /help.cgi |
| Disallow | /institutions.cgi |
| Disallow | /ir_submit.cgi |
| Disallow | /login.cgi |
| Disallow | /mail_assets.cgi |
| Disallow | /maileditor.cgi |
| Disallow | /mysubscriptions.cgi |
| Disallow | /nellco_setup.cgi |
| Disallow | /notification.cgi |
| Disallow | /openurl_forwarder.cgi |
| Disallow | /proquest_setup.cgi |
| Disallow | /query.cgi |
| Disallow | /review_history.cgi |
| Disallow | /site_setup.cgi |
| Disallow | /submit.cgi |
| Disallow | /submit_lawreview.cgi |
| Disallow | /subscription_orders.cgi |
| Disallow | /subscription_request.cgi |
| Disallow | /unsubscribe.cgi |
| Disallow | /upload_additional.cgi |
| Disallow | /user_subscribe.cgi |
| Disallow | /useradd.cgi |
| Disallow | /do/email_editor |
| Disallow | /do/ |
| Disallow | /fe-journals/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://digitalmaine.com/siteindex.xml |
| sitemap | https://digitalmaine.com/exhibit/sitemap.xml |
Warnings
- 2 invalid lines.