deeponion.org
robots.txt
Robots Exclusion Standard data for deeponion.org
Resource Scan
Scan Details
| Site Domain | deeponion.org |
| Base Domain | deeponion.org |
| Scan Status | Ok |
| Last Scan | 2024-09-23T21:36:55+00:00 |
| Next Scan | 2024-10-23T21:36:55+00:00 |
Last Scan
| Scanned | 2024-09-23T21:36:55+00:00 |
| URL | https://deeponion.org/robots.txt |
| Domain IPs | 104.21.22.52, 172.67.202.243, 2606:4700:3030::ac43:caf3, 2606:4700:3031::6815:1634 |
| Response IP | 104.21.22.52 |
| Found | Yes |
| Hash | 3a6429695ac5abd837a0049d1cc8eb208690f3df4005ba6032711603872e0664 |
| SimHash | 80511694a0d2 |
Groups
abachobot
antbot
anzwerscrawl
aolbuild
applebot
architextspider
arielisbot
askjeeves
askjeeves
atn
atn_worldwide
auskunftbot
baiduspider
barkrowler
behloolbot
bingbot
bingbot
boardreader
burf.co
carianbot
cliqzbot
cliqzbot
cmc
coccocbot
coolbot
dataparksearch
daumoa
daviesbot
deepindex
digger
duckduckbot
elefent
elfinbot
enlle bot
enterprise_search
exabot
exif-search
exploratodo
facebot
fast-webcrawler
fido
findxbot
freecrawl
freefind
geliyoobot
gencrawler
gigabot
google
googlebot
googlebot
googlebot-image
gowikibot
grabber
griffon
gromit
grub
gulliver
ia_archiver
informant
infoseek
ingrid
iqdb
istellabot
izsearch.com
jambot
jcrawler
kaz.kz_bot
kd bot
kit-fireball
kocmohabt bot
larbin_indexer
laserlikebot
legs
letsearchbot
linkalarm
linkapediabot
lycos
lycos_spider_(t-rex)
magibot
mail.ru
mail.ru_bot
marvin
megasheep
metajobbot
mirago
moget
mojeekbot
motominerbot
msnbot
msnbot
naverbot
netmechanic
netpursual
netscoop
newscan-online
omgilibot
openbot
openfosbot
orangebot
orbiter
parasite
parsijoo-bot
pdfdrivecrawler
pjspider
plukkie
polybot
pompos
psbot
qwantify
robozilla
rogerbot
ru-robot
saucenao
scooter
scooter
scoutabout
seeker
seznambot
slurp
smartspider
sogou
solbot
sosospider
speedy
speedy_spider
spider_monkey
sputnikbot
stackrambler
storm-crawler
suke
superarama
swobblspider
tarantula
tarmotgezgin
teeraidbot
teoma
tineye
topiclink
toweyabot
twitterbot
vagabondo
vebidoobot
voyager
vuhuvbot
wapspider
wbsearchbot
wbsrch
whowhere
winona
wotbox
yacybot
yahoo!
yahoo-mmcrawler
yandexbot
yioopbot
yisouspider
yooo bot
yoozbot
yottabot
youdaobot
zyborg
glindahl-cocrawler
| Rule | Path |
|---|---|
| Disallow | /community/find-new/ |
| Disallow | /community/account/ |
| Disallow | /community/attachments/ |
| Disallow | /community/account/ |
| Disallow | /community/goto/ |
| Disallow | /community/search/ |
| Disallow | /community/login/ |
| Disallow | /community/admin.php |
| Disallow | /community/online/ |
| Disallow | /community/lost-password/ |
| Disallow | /community/misc/style |
| Disallow | /community/admin.php |
| Disallow | /community/ajax/ |
| Disallow | /community/conversations/ |
| Disallow | /community/misc/quick-navigation-menu?* |
| Disallow | /community/forums/-/ |
| Disallow | /community/threads/tera-tweet-from-* |
| Disallow | /community/xentrade/ |
| Disallow | /votecentral/login |
| Disallow | /votecentral/api |
| Disallow | /votecentral/contact_us |
| Disallow | /votecentral/password_recovery |
| Disallow | /votecentralreport.php?date* |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | /feed |
| Disallow | /comments/feed |
| Disallow | /feed/$ |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
| Disallow | /?s= |
| Disallow | /search |
| Disallow | /community/media/*/preview |
| Disallow | /community/tags/*/preview |
| Disallow | /community/forums/*/?last_post_date* |
| Disallow | /community/media/categories/*/?type* |
| Disallow | /community/media/categories/*/?order* |
| Disallow | /community/media/categories/*/?type=image_upload* |
| Disallow | /community/media/categories/*/?type=video_embed* |
| Disallow | /community/media/categories/*/?type=video_upload* |
| Disallow | /community/media/users/*/?order* |
| Disallow | /community/media/users/*/?container=* |
| Disallow | /community/media/users/*/?type=image_upload* |
| Disallow | /community/media/users/*/?type=video_embed* |
| Disallow | /community/media/users/*/?type=video_upload* |
| Disallow | /community/media/albums/*/?order* |
| Disallow | /community/media/?order=view_count* |
| Disallow | /community/media/?order=likes* |
| Disallow | /community/media/?order=rating_avg* |
| Disallow | /community/media/?order=comment_count* |
| Disallow | /community/media/?order=media_date* |
| Disallow | /community/media/?container=site |
| Disallow | /community/media/?container=album |
| Disallow | /community/forums/*/?order=title* |
| Disallow | /community/forums/*/?order=post_date* |
| Disallow | /community/forums/*/?order=reply_count* |
| Disallow | /community/forums/*/?order=view_count* |
| Disallow | /community/forums/*/?order=title* |
| Disallow | /community/forums/*/?direction=asc* |
| Disallow | /community/forums/*/?direction=desc* |
| Disallow |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://deeponion.org/community/sitemap.php |
| sitemap | https://deeponion.org/langsitemaps.xml |
Warnings
- 3 invalid lines.