Log In Sign Up

thanhpholangson.edu.vn
robots.txt

Robots Exclusion Standard data for thanhpholangson.edu.vn

Resource Scan

Scan Details

Site Domain thanhpholangson.edu.vn
Base Domain thanhpholangson.edu.vn
Scan Status Ok
Last Scan2024-11-17T00:21:55+00:00
Next Scan 2024-11-24T00:21:55+00:00

Last Scan

Scanned2024-11-17T00:21:55+00:00
URL http://thanhpholangson.edu.vn/robots.txt
Domain IPs 123.31.24.115
Response IP 123.31.24.115
Found Yes
Hash be251300c2c4947f20e22952ce5319fce7c6bc2439ad1c43d1dd209ba85c0cff
SimHash 1ae92351e0e0

Groups

*

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /User-Profile/ Do not index user profiles
Disallow /Contest/ Do not index the old contest site
Disallow /guidedtour/ Do not index the old guidedtour

msnbot

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /User-Profile/ Do not index user profiles
Disallow /Contest/ Do not index the old contest site
Disallow /guidedtour/ Do not index the old guidedtour

Other Records

Field Value
crawl-delay 5

slurp

Rule Path Comment
Disallow /*/ctl/ Slurp permits *
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /User-Profile/ Do not index user profiles
Disallow /Contest/ Do not index the old contest site
Disallow /guidedtour/ Do not index the old guidedtour

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path Comment
Disallow /*/ctl/ Googlebot permits *
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /User-Profile/ Do not index user profiles
Disallow /Contest/ Do not index the old contest site
Disallow /guidedtour/ Do not index the old guidedtour

yahoo pipes 1.0

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /images/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /sitemap.xml -
Disallow /User-Profile/ Do not index user profiles
Disallow /Contest/ Do not index the old contest site
Disallow /guidedtour/ Do not index the old guidedtour

openindexspider

Rule Path
Disallow /

openindex

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

spbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

fr-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

cloudservermarketspider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

lipperhey-kaus-australis

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

linkstats

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

iccrawler

Rule Path
Disallow /

plista

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

lipperhey-kaus-australis

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

mindupbot

Rule Path
Disallow /

sg-orbiter

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

kraken

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

thumbsniper

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

implisensebot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

python/3.5 aiohttp

Rule Path
Disallow /

toweya.com

Rule Path
Disallow /

netestate

Rule Path
Disallow /

bubing

Rule Path
Disallow /

linguee

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

gosign-security-crawler

Rule Path
Disallow /

siteliner

Rule Path
Disallow /

sabsimbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /
Back to top

Comments

  • /-----------------------------------------------\
  • | |
  • | |
  • | |
  • \-----------------------------------------------/
  • Legacy restriction, testing removal
  • User-agent: MS Search 4.0 Robot
  • Disallow: /
  • Legacy restriction, testing removal
  • User-agent: Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft
  • Disallow: /
  • Preserve "Resources" for site friendly urls
  • Preserve "Resources" for site friendly urls
  • Preserve "Resources" for site friendly urls
  • Preserve "Resources" for site friendly urls
  • Preserve "Resources" for site friendly urls
  • datenbutler.de
Back to top

Warnings

  • 2 invalid lines.
Back to top