joblist.mla.org
robots.txt

Robots Exclusion Standard data for joblist.mla.org

Resource Scan

Scan Details

Site Domain joblist.mla.org
Base Domain mla.org
Scan Status Ok
Last Scan2025-07-01T20:07:40+00:00
Next Scan 2025-07-31T20:07:40+00:00

Last Scan

Scanned2025-07-01T20:07:40+00:00
URL https://joblist.mla.org/robots.txt
Domain IPs 52.222.144.120, 52.222.144.35, 52.222.144.8, 52.222.144.86
Response IP 52.85.5.43
Found Yes
Hash 2fc9a2917048102159e59c2e648116e9ba645dc95d1721c9c397870c8dcbca21
SimHash 795f3f8041d3

Groups

*

Rule Path
Disallow /job-alerts/
Disallow /quick-add-alert/
Disallow /add-job-alert/
Disallow /add-job-alert-logged-out/
Disallow /job-preview/
Disallow /session-img/
Disallow /ads/
Disallow /metric-scripts/
Disallow /advert-scripts/
Disallow /health/
Disallow /supporting-documents/
Disallow /job-view/

Other Records

Field Value
sitemap https://joblist.mla.org/sitemapindex.xml

Comments

  • Robot exclusion file