softwant.com
robots.txt

Robots Exclusion Standard data for softwant.com

Resource Scan

Scan Details

Site Domain softwant.com
Base Domain softwant.com
Scan Status Ok
Last Scan2024-07-07T09:09:11+00:00
Next Scan 2024-07-14T09:09:11+00:00

Last Scan

Scanned2024-07-07T09:09:11+00:00
URL http://softwant.com/robots.txt
Domain IPs 121.152.44.209
Response IP 121.152.44.209
Found Yes
Hash e2099894a94923c1e4a4971bb0dcf3f4899f1dcd7aa81d63734273a27502fb80
SimHash a8234111a9a3

Groups

*

Rule Path
Disallow /
Disallow /image*/
Disallow /*.txt/
Disallow /*.html/
Disallow /*.htm/
Disallow /*.zip/

googlebot

Rule Path
Allow /

naverbot

Rule Path
Allow /

daumoa

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

alexa

Rule Path
Disallow /

ask

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bloglines

Rule Path
Disallow /

custo

Rule Path
Disallow /

exabot

Rule Path
Disallow /

faviconizer

Rule Path
Disallow /

feedfetcher-google

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

java

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

netcraft

Rule Path
Disallow /

nutch

Rule Path
Disallow /

outfoxbot/yodaobot

Rule Path
Disallow /

powermarks

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

stackrambler

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

turn it

Rule Path
Disallow /

unknown robot

Rule Path
Disallow /

voila

Rule Path
Disallow /

w3c validator

Rule Path
Disallow /

wget tools

Rule Path
Disallow /

yandex bot

Rule Path
Disallow /

cyotekhttpclient

Rule Path
Disallow /

cyotek webcopy

Rule Path
Disallow /

get

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

webcopy/

Rule Path
Disallow /

bubing

Rule Path
Disallow /
Disallow /itgi/_core/
Disallow /itgi/_var/
Disallow /itgi/_tmp/
Disallow /itgi/layouts/
Disallow /itgi/modules/
Disallow /itgi/pages/
Disallow /itgi/files/
Disallow /itgi/switchs/
Disallow /itgi/widgets/
Disallow /*system%3Dedit
Disallow /*_themeconfig
Disallow /itgi/admin
Disallow /*m%3Dadmin
Disallow /itgi/p/login
Disallow /*mod%3Dlogin
Disallow /itgi/p/join
Disallow /*mod%3Djoin
Disallow /*mod%3Dwrite
Disallow /*iframe%3Dy
Disallow /*keyword%3D
Disallow /*mod%3Ddelete
Disallow /*%26a%3D
Disallow /*?a=
Disallow /*action/
Disallow /*type%3Dmodify

Other Records

Field Value
crawl-delay 10