nays.tr
robots.txt

Robots Exclusion Standard data for nays.tr

Resource Scan

Scan Details

Site Domain nays.tr
Base Domain nays.tr
Scan Status Ok
Last Scan2024-11-15T11:27:20+00:00
Next Scan 2024-11-22T11:27:20+00:00

Last Scan

Scanned2024-11-15T11:27:20+00:00
URL https://nays.tr/robots.txt
Domain IPs 84.247.20.25
Response IP 84.247.20.25
Found Yes
Hash 31713c07c810310e31560446f530b92523fe51b29b3410f2f6a7858f5b490f83
SimHash 0d71d7f41597

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /feed
Disallow /rss
Disallow */feed/
Disallow */feed
Disallow /feed/
Disallow /eyeblaster
Disallow /addineyeV2.html
Disallow /eyeblaster/addineyeV2.html
Disallow /*?ref=
Allow /tag

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot

Rule Path
Allow /wp-content/plugins/wpsmart-mobile/

googlebot

Rule Path
Allow /wp-content/

googlebot

Rule Path
Allow /resimler/

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /wp-content/plugins/wpsmart-mobile/

googlebot-mobile

Rule Path
Allow /wp-content/

googlebot-mobile

Rule Path
Allow /resimler/

yandexbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yandex

Rule Path
Allow /

cuil

Rule Path
Allow /

slurp

Rule Path
Allow /

yahoo

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

ia_archiver-web.archive.org

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

fast

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

backrub/*.*

Rule Path
Disallow /

grub.org

Rule Path
Disallow /

botrighthere

Rule Path
Disallow /

larbin

Rule Path
Disallow /

psbot

Rule Path
Disallow /

walhello appie

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

crescent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nays.tr/sitemap.xml