worldlibrary.org
robots.txt

Robots Exclusion Standard data for worldlibrary.org

Resource Scan

Scan Details

Site Domain worldlibrary.org
Base Domain worldlibrary.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-01-28T21:24:23+00:00
Next Scan 2026-04-28T21:24:23+00:00

Last Successful Scan

Scanned2025-10-01T06:33:59+00:00
URL http://worldlibrary.org/robots.txt
Domain IPs 72.235.245.98
Response IP 72.235.245.98
Found Yes
Hash 98d7a4a89c93df14bd0034ac520f8005b0091b3af1aa2f7fd7396198fd11bdfc
SimHash 4340cc47e352

Groups

*

Rule Path Comment
Allow /* -
Disallow /view/ -
Disallow /ebooks/ -
Disallow /Articles/ -
Disallow /results.aspx -
Disallow /Get956uFile.aspx -
Disallow /ebooks/Get956uFile.aspx -
Disallow /App_Themes/ -
Disallow /img/ private area
Disallow /images/ private area
Disallow /js/ private area
Disallow /Members/ private area
Disallow /Members.2/ private area
Disallow /Members.3/ private area
Disallow /Members.4/ private area
Disallow /Members.5/ private area
Disallow /Members.6/ private area
Disallow /Members.7/ private area
Disallow /Members.8/ private area
Disallow /Members.9/ private area
Disallow /opac/ private area
Disallow /Report/ private area
Disallow /Services/ -
Disallow /styles/ -
Disallow /view/opac* -
Disallow /XmlDb/ -

Other Records

Field Value
sitemap http://worldlibrary.org/sitemap.xml

Comments

  • robots.txt