halkegitimkurs.com
robots.txt

Robots Exclusion Standard data for halkegitimkurs.com

Resource Scan

Scan Details

Site Domain halkegitimkurs.com
Base Domain halkegitimkurs.com
Scan Status Ok
Last Scan2024-11-15T13:36:50+00:00
Next Scan 2024-11-22T13:36:50+00:00

Last Scan

Scanned2024-11-15T13:36:50+00:00
URL https://halkegitimkurs.com/robots.txt
Domain IPs 104.21.83.74, 172.67.217.137, 2606:4700:3035::ac43:d989, 2606:4700:3036::6815:534a
Response IP 104.21.83.74
Found Yes
Hash 09d16ec91af558824bab781ce7d0b75b8fcf4542f53410642d4412fecb0dba18
SimHash e564deb47193

Groups

*

Rule Path
Disallow /wp-admin
Disallow /cgi-bin/
Disallow /stats/
Disallow /feed/
Disallow /wp-includes/
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Disallow /*ref%3D*
Disallow /*?ref=*
Disallow /?ref=*
Allow /wp-includes/images/
Allow /wp-admin/admin-ajax.php
Disallow *?replytocom

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

yandexbot

Rule Path
Allow /

cuil

Rule Path
Allow /

slurp

Rule Path
Allow /

yahoo

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

ia_archiver-web.archive.org

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

fast

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

backrub/*.*

Rule Path
Disallow /

grub.org

Rule Path
Disallow /

botrighthere

Rule Path
Disallow /

larbin

Rule Path
Disallow /

walhello appie

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

crescent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://halkegitimkurs.com/sitemap_index.xml