toledolibrary.org
robots.txt

Robots Exclusion Standard data for toledolibrary.org

Resource Scan

Scan Details

Site Domain toledolibrary.org
Base Domain toledolibrary.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-31T16:31:14+00:00
Next Scan 2024-11-29T16:31:14+00:00

Last Successful Scan

Scanned2023-10-14T15:32:11+00:00
URL https://www.toledolibrary.org/robots.txt
Domain IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash 22fa77bce9c6fe5653ee437b05e8b8b3f5fff88b46e8374494debfbce2c948da
SimHash 4901484089b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.toledolibrary.org/wp-sitemap.xml