yalebooks.yale.edu
robots.txt

Robots Exclusion Standard data for yalebooks.yale.edu

Resource Scan

Scan Details

Site Domain yalebooks.yale.edu
Base Domain yale.edu
Scan Status Ok
Last Scan2024-05-01T17:55:18+00:00
Next Scan 2024-05-31T17:55:18+00:00

Last Scan

Scanned2024-05-01T17:55:18+00:00
URL https://yalebooks.yale.edu/robots.txt
Domain IPs 23.185.0.4
Response IP 23.185.0.4
Found Yes
Hash efadc3ccd2a9c4ce99f11e1573132b8f473c17cf403e7be756177e70edf3a223
SimHash 494148c4e59a

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://yalebooks.yale.edu/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.