library.cornell.edu
robots.txt

Robots Exclusion Standard data for library.cornell.edu

Resource Scan

Scan Details

Site Domain library.cornell.edu
Base Domain cornell.edu
Scan Status Ok
Last Scan2024-05-30T19:17:50+00:00
Next Scan 2024-06-29T19:17:50+00:00

Last Scan

Scanned2024-05-30T19:17:50+00:00
URL https://library.cornell.edu/robots.txt
Domain IPs 23.185.0.3, 2620:12a:8000::3, 2620:12a:8001::3
Response IP 23.185.0.3
Found Yes
Hash 51565e7d7463eb0a7ac0be451209bcfa0b32baa319287c138423ad38f41e9bda
SimHash 4101c840cd93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://library.cornell.edu/wp-sitemap.xml