ilkercivil.com
robots.txt

Robots Exclusion Standard data for ilkercivil.com

Resource Scan

Scan Details

Site Domain ilkercivil.com
Base Domain ilkercivil.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-26T06:24:26+00:00
Next Scan 2025-10-10T06:24:26+00:00

Last Successful Scan

Scanned2025-09-11T04:36:07+00:00
URL https://ilkercivil.com/robots.txt
Domain IPs 104.247.162.35
Response IP 104.247.162.35
Found Yes
Hash 136c79f8976eb1efbb7e77c073ef1db5d5565e33aebc5788d8b8b02d248388b4
SimHash 6141c3015797

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Allow ads.txt

Warnings

  • 1 invalid line.