halil.gen.tr
robots.txt

Robots Exclusion Standard data for halil.gen.tr

Resource Scan

Scan Details

Site Domain halil.gen.tr
Base Domain halil.gen.tr
Scan Status Ok
Last Scan2025-08-06T22:44:24+00:00
Next Scan 2025-08-13T22:44:24+00:00

Last Scan

Scanned2025-08-06T22:44:24+00:00
URL https://halil.gen.tr/robots.txt
Domain IPs 104.21.40.217, 172.67.139.10, 2606:4700:3033::6815:28d9, 2606:4700:3035::ac43:8b0a
Response IP 172.67.139.10
Found Yes
Hash 57f38a4a2d6506400546e5a94c234be21691e4be72d5bc000c431e133a7170e4
SimHash 405ccd60679b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Warnings

  • `sitemap https` is not a known field.