haifa.ac.il
robots.txt

Robots Exclusion Standard data for haifa.ac.il

Resource Scan

Scan Details

Site Domain haifa.ac.il
Base Domain haifa.ac.il
Scan Status Ok
Last Scan2024-11-11T14:23:41+00:00
Next Scan 2024-12-11T14:23:41+00:00

Last Scan

Scanned2024-11-11T14:23:41+00:00
URL https://haifa.ac.il/robots.txt
Redirect https://www.haifa.ac.il/robots.txt
Redirect Domain www.haifa.ac.il
Redirect Base haifa.ac.il
Domain IPs 104.40.134.102
Redirect IPs 104.40.134.102
Response IP 104.40.134.102
Found Yes
Hash 58fd86cdc526cd506a0467cb50189e0557c44a7ffab97d722c7e03ecbe1e2478
SimHash 7820dc4a8d93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow *?s=
Disallow /search/
Disallow *?csrt=
Disallow *?undefined=undefined
Disallow /feed/

Other Records

Field Value
sitemap https://www.haifa.ac.il/sitemap_index.xml