htu.edu
robots.txt

Robots Exclusion Standard data for htu.edu

Resource Scan

Scan Details

Site Domain htu.edu
Base Domain htu.edu
Scan Status Ok
Last Scan2025-11-26T23:02:18+00:00
Next Scan 2025-12-26T23:02:18+00:00

Last Scan

Scanned2025-11-26T23:02:18+00:00
URL https://htu.edu/robots.txt
Domain IPs 50.6.194.94
Response IP 50.6.194.94
Found Yes
Hash b8fccd689d6fd832f1c2f5d1f5995d33ce45361a6d1299b17b04b6e3cbb48982
SimHash 6100c8008bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://htu.edu/wp-sitemap.xml