mathavuz.itu.edu.tr
robots.txt

Robots Exclusion Standard data for mathavuz.itu.edu.tr

Resource Scan

Scan Details

Site Domain mathavuz.itu.edu.tr
Base Domain itu.edu.tr
Scan Status Ok
Last Scan2025-03-31T00:59:26+00:00
Next Scan 2025-04-30T00:59:26+00:00

Last Scan

Scanned2025-03-31T00:59:26+00:00
URL https://mathavuz.itu.edu.tr/robots.txt
Domain IPs 160.75.25.14
Response IP 160.75.25.14
Found Yes
Hash be71b7a380fe04d7a47633338268f5dd2bdf17336109253cc013decdd17b65d5
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10