student.uva.nl
robots.txt

Robots Exclusion Standard data for student.uva.nl

Resource Scan

Scan Details

Site Domain student.uva.nl
Base Domain uva.nl
Scan Status Ok
Last Scan2024-05-24T04:41:55+00:00
Next Scan 2024-06-07T04:41:55+00:00

Last Scan

Scanned2024-05-24T04:41:55+00:00
URL https://student.uva.nl/robots.txt
Domain IPs 20.126.232.42
Response IP 20.126.232.42
Found Yes
Hash e4c46b7201cf94a18aad66fc635393557945adc1a70633a07c7321caa15db3aa
SimHash 810c9a55c793

Groups

*

Rule Path
Disallow /errors

addsearchbot

Rule Path
Allow /
Disallow /errors

Other Records

Field Value
sitemap https://student.uva.nl/sitemap.xml

Comments

  • PRODUCTION