ogrencimerkezi.org
robots.txt

Robots Exclusion Standard data for ogrencimerkezi.org

Resource Scan

Scan Details

Site Domain ogrencimerkezi.org
Base Domain ogrencimerkezi.org
Scan Status Ok
Last Scan2024-11-04T22:32:18+00:00
Next Scan 2024-11-11T22:32:18+00:00

Last Scan

Scanned2024-11-04T22:32:18+00:00
URL https://ogrencimerkezi.org/robots.txt
Domain IPs 104.21.20.26, 172.67.190.251, 2606:4700:3031::6815:141a, 2606:4700:3033::ac43:befb
Response IP 172.67.190.251
Found Yes
Hash a72e14c628398e90725297fd99c5a798a97e98f57c5ab225b40573c3e6007380
SimHash e564deb6f593

Groups

*

Rule Path
Disallow /wp-admin
Disallow /cgi-bin/
Disallow /stats/
Disallow /feed/
Disallow /wp-includes/
Disallow /*ref%3D*
Disallow /*?ref=*
Disallow /?ref=*
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Allow /wp-includes/images/
Allow /wp-admin/admin-ajax.php
Disallow *?replytocom

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

cuil

Rule Path
Allow /

yandexbot

Rule Path
Allow /

slurp

Rule Path
Allow /

yahoo

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

ia_archiver-web.archive.org

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

fast

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

backrub/*.*

Rule Path
Disallow /

grub.org

Rule Path
Disallow /

botrighthere

Rule Path
Disallow /

larbin

Rule Path
Disallow /

walhello appie

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

crescent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ogrencimerkezi.org/sitemap_index.xml