www.takvim.sis.itu.edu.tr
robots.txt

Robots Exclusion Standard data for www.takvim.sis.itu.edu.tr

Resource Scan

Scan Details

Site Domain www.takvim.sis.itu.edu.tr
Base Domain itu.edu.tr
Scan Status Ok
Last Scan2025-04-02T18:41:18+00:00
Next Scan 2025-05-02T18:41:18+00:00

Last Scan

Scanned2025-04-02T18:41:18+00:00
URL https://www.takvim.sis.itu.edu.tr/robots.txt
Domain IPs 160.75.25.14
Response IP 160.75.25.14
Found Yes
Hash be71b7a380fe04d7a47633338268f5dd2bdf17336109253cc013decdd17b65d5
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10