Log In Sign Up

m.directg.net
robots.txt

Robots Exclusion Standard data for m.directg.net

Resource Scan

Scan Details

Site Domain m.directg.net
Base Domain directg.net
Scan Status Ok
Last Scan2024-11-03T07:27:31+00:00
Next Scan 2024-12-03T07:27:31+00:00

Last Scan

Scanned2024-11-03T07:27:31+00:00
URL https://m.directg.net/robots.txt
Domain IPs 110.10.129.207
Response IP 110.10.129.207
Found Yes
Hash 8872ffd49b0148d36b05434b8d558be4c36804114d84c63a188e1215cab8ade4
SimHash 4e3d17028421

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

similarweb

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gtwek

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot@gmail.com)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/1.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/2.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/3.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/4.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/5.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

askpeterbot

Rule Path
Disallow /

flipboard

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

mozilla/5.0 (compatible; null; +null; null)

Rule Path
Disallow /

js-kit url resolver

Rule Path
Disallow /

js-kit url resolver, http://js-kit.com/

Rule Path
Disallow /

http://siteexplorer.info/

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mozilla/5.0 (compatible; butterfly/1.0; +http://labs.topsy.com/butterfly/) gecko/2009032608 firefox/3.0.8

Rule Path
Disallow /

tweetmeme

Rule Path
Disallow /

mozilla/5.0 (macintosh; u; intel mac os x 10.6; en-us; rv:1.9.2) gecko/20100115 firefox/3.6 (flipboardproxy/0.0.5; +http://flipboard.com/browserproxy)

Rule Path
Disallow /

mozilla/5.0 (macintosh; u; intel mac os x 10.6; en-us; rv:1.9.2) gecko/20100115 firefox/3.6 (flipboardproxy/1.1; +http://flipboard.com/browserproxy)

Rule Path
Disallow /

badbot

Rule Path
Disallow /

mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

mozilla/5.0 (compatible; msie 6.0b; windows nt 5.0) gecko/2009011913 firefox/3.0.6 tweetmemebot

Rule Path
Disallow /

tweetedtimes bot/1.0

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

mozilla/5.0 (compatible; exabot/3.0 (biggerbetter); +http://www.exabot.com/go/robot)

Rule Path
Disallow /

mozilla/5.0 (compatible; exabot/3.0; +http:/www.exabot.com/go/robot)

Rule Path
Disallow /

mozilla/5.0 (compatible; tweetmemebot/2.11; +http://tweetmeme.com/)

Rule Path
Disallow /

mozilla/5.0 (compatible; tweetmemebot/3.0; +http://tweetmeme.com/)

Rule Path
Disallow /

tweetmemebot/3.0; +http://tweetmeme.com/

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 8.0; windows nt 6.1; trident/4.0; apcpms=^n201309130831584094993260671919b0e33f_4^; slcc2; .net clr 2.0.50727; .net clr 3.5.30729; .net clr 3.0.30729; media center pc 6.0

Rule Path
Disallow /

bingbot
daumoa
googlebot
yahoo! slurp
naverbot
msnbot
yeti

Rule Path
Disallow /__conf__/
Disallow /board/
Disallow /mypage/
Disallow /order/
Disallow /favicon/
Disallow /intro/
Disallow /lib/
Disallow /mypage/
Disallow /outline/
Disallow /member/
Disallow /smartxpay/
Disallow /blank.php
Back to top