Log In Sign Up

directg.net
robots.txt

Robots Exclusion Standard data for directg.net

Resource Scan

Scan Details

Site Domain directg.net
Base Domain directg.net
Scan Status Ok
Last Scan2024-06-28T16:36:39+00:00
Next Scan 2024-07-28T16:36:39+00:00

Last Scan

Scanned2024-06-28T16:36:39+00:00
URL https://directg.net/robots.txt
Domain IPs 110.10.129.207
Response IP 110.10.129.207
Found Yes
Hash 98f3e146ae48e09b294ef67b725bed29bb921309af1e71a4df00775bf76e69b8
SimHash 203d1700c401

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gtwek

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot@gmail.com)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/1.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/2.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/3.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/4.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/5.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

askpeterbot

Rule Path
Disallow /

flipboard

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

mozilla/5.0 (compatible; null; +null; null)

Rule Path
Disallow /

js-kit url resolver

Rule Path
Disallow /

js-kit url resolver, http://js-kit.com/

Rule Path
Disallow /

http://siteexplorer.info/

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mozilla/5.0 (compatible; butterfly/1.0; +http://labs.topsy.com/butterfly/) gecko/2009032608 firefox/3.0.8

Rule Path
Disallow /

tweetmeme

Rule Path
Disallow /

mozilla/5.0 (macintosh; u; intel mac os x 10.6; en-us; rv:1.9.2) gecko/20100115 firefox/3.6 (flipboardproxy/0.0.5; +http://flipboard.com/browserproxy)

Rule Path
Disallow /

mozilla/5.0 (macintosh; u; intel mac os x 10.6; en-us; rv:1.9.2) gecko/20100115 firefox/3.6 (flipboardproxy/1.1; +http://flipboard.com/browserproxy)

Rule Path
Disallow /

badbot

Rule Path
Disallow /

mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

mozilla/5.0 (compatible; msie 6.0b; windows nt 5.0) gecko/2009011913 firefox/3.0.6 tweetmemebot

Rule Path
Disallow /

tweetedtimes bot/1.0

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

mozilla/5.0 (compatible; exabot/3.0 (biggerbetter); +http://www.exabot.com/go/robot)

Rule Path
Disallow /

mozilla/5.0 (compatible; exabot/3.0; +http:/www.exabot.com/go/robot)

Rule Path
Disallow /

mozilla/5.0 (compatible; tweetmemebot/2.11; +http://tweetmeme.com/)

Rule Path
Disallow /

mozilla/5.0 (compatible; tweetmemebot/3.0; +http://tweetmeme.com/)

Rule Path
Disallow /

tweetmemebot/3.0; +http://tweetmeme.com/

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 8.0; windows nt 6.1; trident/4.0; apcpms=^n201309130831584094993260671919b0e33f_4^; slcc2; .net clr 2.0.50727; .net clr 3.5.30729; .net clr 3.0.30729; media center pc 6.0

Rule Path
Disallow /

bingbot
daumoa
googlebot
yahoo! slurp
naverbot
msnbot
yeti

Rule Path
Disallow /xpay/
Disallow /test/
Disallow /mypage/
Disallow /order/
Disallow /_Admin2/
Disallow /mobile/
Disallow /mobile2/
Disallow /info/
Disallow /checkplus/
Disallow /Spac_Editor/
Disallow /member/
Disallow /api/
Disallow /log4php/
Disallow /log/
Disallow /naver/
Disallow /t3-assets/
Disallow /api/
Disallow /bootstrap/
Disallow /community/
Disallow /game/restrictions_chk.php
Back to top