Log In Sign Up

engenieer.com
robots.txt

Robots Exclusion Standard data for engenieer.com

Resource Scan

Scan Details

Site Domain engenieer.com
Base Domain engenieer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-16T01:13:51+00:00
Next Scan 2024-12-15T01:13:51+00:00

Last Successful Scan

Scanned2023-07-31T05:34:00+00:00
URL https://engenieer.com/robots.txt
Domain IPs 155.138.194.233
Response IP 155.138.194.233
Found Yes
Hash 3b136643a13e1d50f2e39480122742815dbb613631de4ba2b4de2c728a12d128
SimHash c2f35d40f92b

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /comments/feed
Disallow /readme.html
Disallow /search/
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout
Disallow /register/
Disallow /register

applebot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

baiduspider

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /comments/feed
Disallow /readme.html
Disallow /search/
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout
Disallow /register/
Disallow /register

bingbot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

discordbot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

googlebot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

googlebot-image

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

adsbot-google

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

ia_archiver

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /comments/feed
Disallow /readme.html
Disallow /search/
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout
Disallow /register/
Disallow /register

linkedinbot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

msnbot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

naverbot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

pinterestbot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

seznambot

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /comments/feed
Disallow /readme.html
Disallow /search/
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout
Disallow /register/
Disallow /register

slurp

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

teoma

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /comments/feed
Disallow /readme.html
Disallow /search/
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout
Disallow /register/
Disallow /register

telegrambot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

twitterbot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

yandex

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

yeti

Rule Path
Disallow /wp-content/
Disallow /wp-content/plugins/
Disallow /cgi-bin/
Disallow /*?
Disallow /wp-admin/
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /author/
Disallow /comments/feed
Disallow /readme.html
Disallow /wp-login.php
Disallow /register/
Disallow /blog-posts/
Disallow /blog/
Disallow /blogs/
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /all-courses/
Disallow /courses/
Disallow /wp-login.php?redirect_to=httpswww.engenieer.comtestimonials
Disallow /admin/
Disallow /admin
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout
Disallow /account/
Disallow /accounts/
Disallow /accounts

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Allow /wp-content/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /*?
Disallow /tmp/
Disallow /junk/
Disallow /search/
Disallow /comments/feed
Disallow /readme.html
Disallow /blogs/*%2B*
Disallow /blogs/**
Disallow /blogs/**
Disallow /*/blogs/*%2B*
Disallow /*/blogs/**
Disallow /*/blogs/**
Disallow /cart/
Disallow /cart
Disallow /orders/
Disallow /orders
Disallow /order/
Disallow /checkout/
Disallow /checkout

Other Records

Field Value
crawl-delay 10

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenuãƒâ¢ã¢â€šâ¬ã¢â€žâ¢s

Rule Path
Disallow /

xenuãƒâ¢ã¢â€šâ¬ã¢â€žâ¢s link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

archive.org bot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

gigablast spider

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

picscout

Rule Path
Disallow /

blexbot crawler

Rule Path
Disallow /

tineye

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

ezooms robot

Rule Path
Disallow /

netestate ne crawler (+http://www.website-datenbank.de/)

Rule Path
Disallow /

wiseguys robot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

pi-monster

Rule Path
Disallow /

eccp/1.0 (search@eniro.com)

Rule Path
Disallow /

psbot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

zbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

simplepie

Rule Path
Disallow /

wget

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

quantify

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

cuam

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://genieprep.com/sitemap_index.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top