Log In Sign Up

geeknabe.com
robots.txt

Robots Exclusion Standard data for geeknabe.com

Resource Scan

Scan Details

Site Domain geeknabe.com
Base Domain geeknabe.com
Scan Status Ok
Last Scan2026-03-01T14:15:30+00:00
Next Scan 2026-03-08T14:15:30+00:00

Last Scan

Scanned2026-03-01T14:15:30+00:00
URL https://geeknabe.com/robots.txt
Domain IPs 172.66.45.21, 172.66.46.235, 2606:4700:310c::ac42:2d15, 2606:4700:310c::ac42:2eeb
Response IP 172.66.45.21
Found Yes
Hash bf98d7dae456742fc9b623300c81ed4c0342990e8adb4a1ccadcc770594033f6
SimHash 7b467340d515

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

leikibot

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

mediatoolkitbot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yak

Rule Path
Allow /

trendictionbot

Rule Path
Allow /

adstxtcrawler

Rule Path
Allow /ads.txt

disqusadstxtcrawler

Rule Path
Allow /ads.txt

adsbot

Rule Path
Allow /ads.txt

centro ads.txt crawler

Rule Path
Allow /ads.txt

iab atq team adform robot

Rule Path
Allow /ads.txt

grapeshotcrawler

Rule Path
Allow /

slurp

Rule Path
Allow /

bingbot

Rule Path
Allow /

surdotlybot

Rule Path
Allow /

applebot

Rule Path
Allow /

mojeekbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

telegrambot

Rule Path
Allow /

twittermemebot

Rule Path
Allow /

discordbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

datagnionbot

Rule Path
Allow /

barkrowler

Rule Path
Allow /

ias_crawler

Rule Path
Allow /

bidswitchbot

Rule Path
Allow /ads.txt

pulsepoint-ads

Rule Path
Allow /ads.txt

petalbot

Rule Path
Allow /

awariorssbot
awariosmartbot

Rule Path
Allow /

zoominfobot

Rule Path
Allow /

criteobot/0.1

Rule Path
Allow /

linespider/1.1

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://geeknabe.com/sitemap.xml
Back to top

Comments

  • This is a comment.
  • Disallow every bot from scraping/indexing the entire site.
  • Google's general bot
  • Google Image bot
  • Google News bot
  • DoubleVerify bot
  • Google Video bot
  • Google Adsense bot
  • media toolkit bot
  • Google's bot to check desktop web page ad quality
  • Google's bot to check mobile web page ad quality
  • Yandex bot (russia search engine)
  • Linkfluence bot
  • trendiction bot
  • Allow only for ads.txt
  • Oracle crawler
  • Yahoo bot
  • Microsoft Bing bot
  • SudortlyBot
  • Applebot
  • Mojeek bot
  • DuckDuckGo bot
  • Exalead bot
  • Facebook bot
  • Facebook bot
  • Twitter bot
  • Telegram bot
  • Twitter bot
  • Discord bot
  • Amazon Alexa bot
  • dataognion bot
  • Barbar tech bot
  • IAS Crawler
  • https://integralads.com/site-indexing-policy/
  • bidswitch bot
  • Pulsepoint
  • Petal search engine
  • Awario
  • Zoominfobot
  • Criteobot
  • LINE
  • Sitemap location
Back to top