cs.unm.edu
robots.txt

Robots Exclusion Standard data for cs.unm.edu

Resource Scan

Scan Details

Site Domain cs.unm.edu
Base Domain unm.edu
Scan Status Ok
Last Scan2024-10-02T02:36:20+00:00
Next Scan 2024-11-01T02:36:20+00:00

Last Scan

Scanned2024-10-02T02:36:20+00:00
URL https://cs.unm.edu/robots.txt
Domain IPs 64.106.20.76
Response IP 64.106.20.76
Found Yes
Hash 1557896834f92fc1abb6d97b004bf04f7c61658b8626f0cb249cc58e36a7176e
SimHash 881d82607e8a

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /tmp/
Disallow /tapialab/People/kageweiss/

semrushbot

Rule Path
Disallow /
Disallow /tapialab/People/kageweiss/

ahrefsbot

Rule Path
Disallow /
Disallow /tapialab/People/kageweiss/

amazonbot

Rule Path
Disallow /
Disallow /tapialab/People/kageweiss/

dotbot

Rule Path
Disallow /
Disallow /tapialab/People/kageweiss/

mj12bot

Rule Path
Disallow /
Disallow /tapialab/People/kageweiss/

Comments

  • robots.txt