technion.ac.il
robots.txt

Robots Exclusion Standard data for technion.ac.il

Resource Scan

Scan Details

Site Domain technion.ac.il
Base Domain technion.ac.il
Scan Status Ok
Last Scan2024-10-26T20:54:15+00:00
Next Scan 2024-11-25T20:54:15+00:00

Last Scan

Scanned2024-10-26T20:54:15+00:00
URL https://technion.ac.il/robots.txt
Domain IPs 132.68.238.9
Response IP 132.68.238.9
Found Yes
Hash 3c6a5e9e25b6c309ab75008dbdaa6e7e935847c121d2c5682097cdbd8a20ec10
SimHash 88089a226ba2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /