nerdordie.com
robots.txt

Robots Exclusion Standard data for nerdordie.com

Resource Scan

Scan Details

Site Domain nerdordie.com
Base Domain nerdordie.com
Scan Status Ok
Last Scan2024-09-20T09:27:48+00:00
Next Scan 2024-09-27T09:27:48+00:00

Last Scan

Scanned2024-09-20T09:27:48+00:00
URL https://nerdordie.com/robots.txt
Domain IPs 104.26.12.40, 104.26.13.40, 172.67.69.201, 2606:4700:20::681a:c28, 2606:4700:20::681a:d28, 2606:4700:20::ac43:45c9
Response IP 104.26.13.40
Found Yes
Hash 4893eaffdbabd3c30b89cbe4f2cd083c12e1cb1bec5eef4c3823348a5c412f43
SimHash a4934b018032

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-login.php?*
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow */trackback/
Disallow */feed
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow /my-account/*
Disallow /?s=*
Disallow /login/
Disallow /register/*
Disallow /forgot/*
Disallow /search/*
Disallow /cart/*
Allow /wp-admin/admin-ajax.php
Allow /wp-content/themes/*.css
Allow /wp-content/plugins/*.css
Allow /wp-content/uploads/*.css
Allow /wp-content/themes/*.js
Allow /wp-content/plugins/*.js
Allow /wp-content/uploads/*.js
Allow /wp-includes/css/
Allow /wp-includes/js/
Allow /wp-includes/images/
Allow /wp-content/uploads/

turnitinbot

Rule Path
Disallow /

legs

Rule Path
Disallow /

yandexwebmaster

Rule Path
Disallow /

speedy

Rule Path
Disallow /

spider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

goo

Rule Path
Disallow /

yandexwebmaster/2.0

Rule Path
Disallow /

java

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

voyager

Rule Path
Disallow /

scooter

Rule Path
Disallow /

robot

Rule Path
Disallow /

fido

Rule Path
Disallow /

motor

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

crawl

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

xenu

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nerdordie.com/sitemap_index.xml

Comments

  • .____________________________________________________________________________________________________.
  • .____________________________________________________________________________________________________.
  • .____________________________________________________________________________________________________.
  • .____ This file is for search engines only. Nothing to look at. Keep going and enjoy your life. _____.
  • .____________________________________________________________________________________________________.
  • .____________________________________________________________________________________________________.
  • .____________________________________________________________________________________________________.
  • ._____________________________________________`/yNdo-________________________________________________.
  • .__________________________________________.+hNMMMMMMms:`____________________________________________.
  • ._______________________________________`:smNMMMMMMMMMMMMNh+.________________________________________.
  • .___________________________________./ymMMMMMMMMMMMMMMMMMMMNdo:`_____________________________________.
  • ._______________________________`-+hNMMMMMMMMMMMMMMMMMMMMMMMMMNmy/.__________________________________.
  • .____________________________`:sdNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMmh+-_______________________________.
  • ._________________________./ymMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdo:`___________________________.
  • ._____________________ `-ohNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMmy/._______________________.
  • .___________________.:sdNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNh/_____________________.
  • ._______________`./ymMMMMMMMMMMMMMMMMMMMMMMMMMMMmy/odNMMMMMMMMMMMMMMMMMMMMMMMMMd_____________________.
  • .____________`-ohNMMMMMMMMMMMMMMMMMMMMMMMMMMNms:`____./yNMMMMMMMMMMMMMMMMMMMMMMd_____________________.
  • ._________`:smMMMMMMMMMMMMMMMMMMMMMMMMMMMNd+-___________`:smNMMMMMMMMMMMMMMMMMMd_____________________.
  • .______.+hNMMMMMMMMMMMMMMMMMMMMMMMMMMMNy/.__________________-+hNMMMMMMMMMMMMMMMd_____________________.
  • .___-odMMMMMMMMMMMMMMMMMMMMMMMMMMMMms:_________________________`dMMMMMMMMMMMMMNo_____________________.
  • .:yNMMMMMMMMMMMMMMMMMMMMMMMMMMMMh+._____________________________dMMMMMMMMMMdo-_______________________.
  • .`:ymMMMMMMMMMMMMMMMMMMMMMMMmy/`________________________________dMMMMMMNh+.________-+hNd+-___________.
  • .___`:smMMMMMMMMMMMMMMMMMdo-`______./.__________________________dMMMds:`______`:smNMMMMMNdo-_________.
  • .______`-odMMMMMMMMMMNh+.`______-+hNM:__________________________hho-`______./yNMMMMMMMMMMMMNms:`_____.
  • ._________`-ohNMMMmy/.______`:smNMMMM:__________________________``_____`-odNMMMMMMMMMMMMMMMMMMNms:`__.
  • .____________`.+o-`______-/hmMMMMMMMM:______________________________.:smNMMMMMMMMMMMMMMMMMMMMMMMMMms..
  • .____________________`-odNMMMMMMMMMMM:___________________________./hmMMMMMMMMMMMMMMMMMMMMMMMMMMMmh+._.
  • .____________________-MMMMMMMMMMMMMMMh:.______________________`-odNMMMMMMMMMMMMMMMMMMMMMMMMMMNms:.___.
  • .____________________:MMMMMMMMMMMMMMMMMmh+.`______________.:sdMMMMMMMMMMMMMMMMMMMMMMMMMMMNdo-`_______.
  • .____________________:MMMMMMMMMMMMMMMMMMMMNds:`_______`.+hmMMMMMMMMMMMMMMMMMMMMMMMMMMMmy/.___________.
  • .____________________:MMMMMMMMMMMMMMMMMMMMMMMMmy/.``-odNMMMMMMMMMMMMMMMMMMMMMMMMMMNms:`______________.
  • .____________________-NMMMMMMMMMMMMMMMMMMMMMMMMMMNdmMMMMMMMMMMMMMMMMMMMMMMMMMMMNh+-__________________.
  • ._____________________-+hNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNy/`_____________________.
  • .________________________`/yNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMdo-_________________________.
  • .____________________________-sdMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNh+.____________________________.
  • .________________________________.+hNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMms:`______________________________.
  • .___________________________________`/ymMMMMMMMMMMMMMMMMMMMMMMMNho-`_________________________________.
  • .______________________________________`-odNMMMMMMMMMMMMMMMMmy/.`____________________________________.
  • ._________________________________________`.+hmMMMMMMMMMMds:`________________________________________.
  • ._____________________________________________.:sdMMMNh+-`___________________________________________.
  • .---`____---._.---------_.-------.____--------`_`-o/.___________________--------.`____---._.---------.
  • .MMMd:...hMMy.oMMMNNNNNN.sMMMNNNNmh/.:MMMNNNNNmh/`......................hMMMNNNNNds...MMM+.hMMMNNNNNh.
  • .MMMMNy..hMMy.oMMN.......sMMM...oMMM.:MMM/--:oNMMy..../yyyys..hdyyh+... hMMd--:/hMMN:.MMM+.hMMd.......
  • .MMMNMMm.dMMy.oMMMddddd:.sMMM.../MMM.:MMM.....+MMM-..+Mo`.-Mh.mM:.mN....hMMh.....hMMd.MMM+.hMMNddddd`.
  • .MMM+.mMMMMMy.oMMMooooo..sMMMmNNMMm+.:MMM.....oMMM-..:Ny-.+My.mMymM+....hMMh....`dMMh.MMM+.hMMmooooo`.
  • .MMM+..yMMMMy.oMMM.......sMMN//dMMy..:MMM+/+ohMMNo....-oyys/..sy..so`...hMMm//+smMMm..MMM+.hMMm.......
  • .MMM+...:dMMy.oMMMMMMMMM.sNNm..`sNNd.:MMMMMMNNho........................hMMMMMMNmy/`..MMM+.hMMMMMMMMM.
  • .____________________________________________________________________________________________________.
  • .____________________________________________________________________________________________________.
  • .____________________________________________________________________________________________________.
  • .____________________________________________________________________________________________________.
  • .____________________________________________________________________________________________________.
  • User-agent: Yandex
  • Disallow: /
  • User-agent: YandexBot
  • Disallow: /
  • User-agent: MJ12bot
  • Disallow: /
  • User-agent: Majestic-SEO
  • Disallow: /
  • user-agent: AhrefsBot
  • disallow: /
  • User-agent: YandexBot/3.0
  • Disallow: /

Warnings

  • 4 invalid lines.