Log In Sign Up

teknodag.com
robots.txt

Robots Exclusion Standard data for teknodag.com

Resource Scan

Scan Details

Site Domain teknodag.com
Base Domain teknodag.com
Scan Status Ok
Last Scan2025-11-26T19:03:56+00:00
Next Scan 2025-12-03T19:03:56+00:00

Last Scan

Scanned2025-11-26T19:03:56+00:00
URL https://teknodag.com/robots.txt
Domain IPs 104.21.9.38, 172.67.141.111, 2606:4700:3031::6815:926, 2606:4700:3031::ac43:8d6f
Response IP 172.67.141.111
Found Yes
Hash e09d7e87f97a7a612be90b27d5cb6818da2c1b905fbd81e2cb4fdc7c297fd4af
SimHash 3f74d3c5c139

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*/*.css
Allow /*/*.js
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow *?attachment_id=

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /wp-content/uploads/

yandex

Rule Path
Allow /

applebot

Rule Path
Allow /

yandeximages

Rule Path
Allow /wp-content/uploads/

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider/2.0

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

sogou spider

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

sosospider

Rule Path
Allow /

sosospider+

Rule Path
Allow /

sosospider/2.0

Rule Path
Allow /

yodao

Rule Path
Allow /

youdao

Rule Path
Allow /

youdaobot

Rule Path
Allow /

youdaobot/1.0

Rule Path
Allow /

naverbot

Rule Path
Allow /

seznambot

Rule Path
Allow /

facebook

Rule Path
Allow /

facebookplatform/1.0

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookexternalhit/1.0

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookscraper

Rule Path
Allow /

facebot/1.0

Rule Path
Allow /

visionutils/0.2

Rule Path
Allow /

datagnionbot/1.0

Rule Path
Allow /

instagrambot

Rule Path
Allow /

whatsapp bot

Rule Path
Allow /

telegrambot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

linkedinbot/1.0

Rule Path
Allow /

pinterest bot

Rule Path
Allow /

pinterest/0.1

Rule Path
Allow /

pinterest/0.2

Rule Path
Allow /

discordbot

Rule Path
Allow /

*

Rule Path
Allow /*.webp$

*

Rule Path
Allow /*.jpg$

*

Rule Path
Allow /*.png$

*

Rule Path
Allow /*.gif$

*

Rule Path
Allow /*.pdf$

*

Rule Path
Allow /*.docx$

*

Rule Path
Allow /*.html$

*

Rule Path
Allow /*.php$
Back to top

Other Records

Field Value
sitemap https://teknodag.com/post-sitemap.xml
sitemap https://teknodag.com/page-sitemap.xml
sitemap https://teknodag.com/post-sitemap.xml
sitemap https://teknodag.com/page-sitemap.xml
sitemap https://teknodag.com/sitemap.xml
sitemap https://teknodag.com/post-sitemap.xml
sitemap https://teknodag.com/page-sitemap.xml
sitemap https://teknodag.com/sitemap.xml
sitemap https://teknodag.com/post-sitemap.xml
sitemap https://teknodag.com/page-sitemap.xml
sitemap https://teknodag.com/sitemap-news.xml
sitemap https://teknodag.com/product-sitemap.xml
Back to top

Comments

  • Advanced Wordpress
  • Yoast Sitemap Link
  • Rankmath Sitemap Link
  • All in One SEO Sitemap Link
  • Squirrly Sitemap Link
  • XML Sitemaps Sitemap Link
  • Jetpack Sitemap Link
  • News Sitemap Link
  • Product Sitemap Link
  • Allow Google Bot
  • Allow Google Images Bot
  • Allow Google Media Partners Bot
  • Allow Google AdsBot Bot
  • Allow Bing Bot
  • Allow Google Mobile Bot
  • Allow MSN Bot
  • Allow MSNBot Media Bot
  • Allow Yandex Bot
  • Allow Apple Bot
  • Allow Yandex Images Bot
  • Allow Yahoo Search (Slurp bot)
  • Allow DuckDuckGo Bot
  • Allow Qwant Bot
  • Allow Baidu/Sogou/Soso/Youdao Bot
  • Allow Naver Bot
  • Allow Seznam Bot
  • Allow Facebook Bot
  • Allow Instagram Bot
  • Allow Whatsapp Bot
  • Allow Telegram Bot
  • Allow Twitter Bot
  • Allow Linkedin Bot
  • Allow Pinterest Bot
  • Allow Discord Bot
  • Allow Webp Images
  • Allow Jpg Images
  • Allow Png Images
  • Allow Gif Images
  • Allow PDF Files
  • Allow DOCX Files
  • Allow Html Files
  • Allow Php Files
Back to top

Warnings

  • `post-sitemap` is not a known field.
Back to top