library.unt.edu
robots.txt

Robots Exclusion Standard data for library.unt.edu

Resource Scan

Scan Details

Site Domain library.unt.edu
Base Domain unt.edu
Scan Status Ok
Last Scan2026-01-25T04:01:08+00:00
Next Scan 2026-02-24T04:01:08+00:00

Last Scan

Scanned2026-01-25T04:01:08+00:00
URL https://library.unt.edu/robots.txt
Domain IPs 129.120.90.156
Response IP 129.120.90.156
Found Yes
Hash c135c948bac99364dde6b4efa2164a1e4c6cc66b1b541bf1909fd7af26f23811
SimHash 690cd5554713

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://library.unt.edu/sitemap.xml