Log In Sign Up

gezginbirchef.com
robots.txt

Robots Exclusion Standard data for gezginbirchef.com

Resource Scan

Scan Details

Site Domain gezginbirchef.com
Base Domain gezginbirchef.com
Scan Status Ok
Last Scan2025-07-26T22:02:52+00:00
Next Scan 2025-08-02T22:02:52+00:00

Last Scan

Scanned2025-07-26T22:02:52+00:00
URL https://gezginbirchef.com/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.80.1
Found Yes
Hash 1a0fcd64615d76d2b1e94c76d0c34eb7cc4556e466fd39e0a8d36dc8dc8859f0
SimHash c5765bd66639

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /cgi-bin/
Disallow /trackback/
Disallow /comments/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /search/
Disallow */feed/
Disallow /feed/
Disallow /etiket/
Disallow /tag/
Disallow /sef/
Disallow /type/
Disallow /page/
Disallow /category/
Disallow /author/
Disallow /*?s=
Disallow /*?phpinfo
Disallow /*?wp_scrape
Disallow /*?fbclid
Disallow /*?tagverify
Disallow /*?utm_source
Disallow /*?utm_medium
Disallow /*?utm_campaign
Disallow /*?ref
Disallow *?*
Allow /wp-content/uploads/

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

duckduckbot

Rule Path
Allow /

slurp

Rule Path
Allow /

applebot

Rule Path
Allow /

baiduspider

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://gezginbirchef.com/sitemap_index.xml
Back to top

Comments

  • =============================================================
  • GEZGINBIRCHEF.COM İÇİN BÄ°RLEŞTÄ°RÄ°LMİŞ ve OPTÄ°MÄ°ZE EDÄ°LMİŞ ROBOTS.TXT
  • =============================================================
  • 1. STANDART WORDPRESS SÄ°STEM DOSYALARINI ENGELLE
  • 2. SEO İÇİN GEREKSÄ°Z ARŞİV ve SAYFA TÜRLERÄ°NÄ° ENGELLE
  • 3. YAYGIN PARAMETRELÄ° (SORU İŞARETLÄ°) URL'LERÄ° ENGELLE
  • 4. GÖRSELLERÄ°N TARANMASINA Ä°ZÄ°N VER (ÖNEMLÄ°)
  • =============================================================
  • ÖZEL BOT AYARLARI (Bu bölümü olduğu gibi korumak faydalıdır)
  • =============================================================
  • =============================================================
  • SÄ°TE HARÄ°TASI
  • =============================================================
Back to top