cogamoney.com
robots.txt
Robots Exclusion Standard data for cogamoney.com
Resource Scan
Scan Details
Site Domain | cogamoney.com |
Base Domain | cogamoney.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-25T13:16:03+00:00 |
Next Scan | 2024-10-25T13:16:03+00:00 |
Last Successful Scan
Scanned | 2024-08-04T13:15:22+00:00 |
URL | https://cogamoney.com/robots.txt |
Redirect | https://cogamoney.net/robots.txt |
Redirect Domain | cogamoney.net |
Redirect Base | cogamoney.net |
Domain IPs | 104.21.28.111, 172.67.145.224 |
Redirect IPs | 104.21.17.106, 172.67.175.120 |
Response IP | 104.21.17.106 |
Found | Yes |
Hash | 7e789377c08fc88f0e95d2c424438f7a926139a9d76ee8278590a8d764092908 |
SimHash | 479a1a6369e0 |
Groups
*
Rule | Path |
---|---|
Disallow | /find-new/ |
Disallow | /account/ |
Disallow | /attachments/ |
Disallow | /goto/ |
Disallow | /posts/ |
Disallow | /login/ |
Disallow | /misc/ |
Disallow | /help/ |
Disallow | /admin.php |
Disallow | /lost-password/ |
Disallow | /online/ |
Disallow | /forums/*/?last_days |
Disallow | /forums/*/?prefix_id |
Disallow | /forums/*/?starter_id |
Disallow | /forums/*/?order |
Disallow | /forums/*/?direction |
Disallow | /forums/*/page-*?order |
Disallow | */latest |
Disallow | /recent-activity/ |
Disallow | /register |
Disallow | /search/ |
Disallow | /threads/*/poll |
Disallow | /*?prefix_id* |
Disallow | /*?last_days=* |
Disallow | */post-* |
Disallow | /reply?quote |
Disallow | /*?last_days=* |
Allow | / |
Allow | /forums/ |
Allow | /forums/*/ |
Allow | /forums/*/page-* |
Allow | /threads/*/ |
Allow | /threads/*/page-* |
Allow | /forums/-/index.rss |
Allow | */index.rss |
grub-client
grub
looksmart
webzip
larbin
b2w/0.1
psbot
python-urllib
netmechanic
url_spider_pro
cherrypicker
emailcollector
emailsiphon
webbandit
emailwolf
extractorpro
copyrightcheck
crescent
sitesnagger
prowebwalker
cheesebot
lnspiderguy
ia_archiver
ia_archiver/1.6
teleport
teleportpro
miixpc
telesoft
website quester
moget/2.1
webzip/4.0
webstripper
websauger
webcopier
netants
mister pix
webauto
thenomad
www-collector-e
rma
libweb/clshttp
asterias
httplib
turingos
spanner
infonavirobot
harvest/1.5
bullseye/1.0
mozilla/4.0 (compatible; bullseye; windows 95)
crescent internet toolpak http ole control v.1.0
cherrypickerse/1.0
cherrypickerelite/1.0
webbandit/3.50
nicerspro
microsoft url control - 5.01.4511
dittospyder
foobot
webmasterworldforumbot
spankbot
botalot
lwp-trivial/1.34
lwp-trivial
bunnyslippers
microsoft url control - 6.00.8169
urly warning
wget/1.6
wget/1.5.3
wget
linkwalker
cosmos
moget
hloader
humanlinks
linkextractorpro
offline explorer
mata hari
lexibot
web image collector
the intraformant
true_robot/1.0
true_robot
blowfish/1.0
jennybot
miixpc/4.2
builtbottough
propowerbot/2.14
backdoorbot/1.0
tocrawl/urldispatcher
webenhancer
suzuran
vci webviewer vci webviewer win32
vci
szukacz/1.4
queryn metasearch
openfind data gathere
openfind
xenu's link sleuth 1.1c
xenu's
zeus
repomonkey bait & tackle/v1.01
repomonkey
microsoft url control
openbot
url control
zeus link scout
zeus 32297 webster pro v2.9 win32
webster pro
erocrawler
linkscan/8.1a unix
keyword density/0.9
kenjin spider
iron33/1.0.2
bookmark search tool
getright/4.2
fairad client
gaisbot
aqua_products
radiation retriever 1.1
flaming attackbot
oracle ultra search
msiecrawler
perman
searchpreview
olecrawler
mj12bot
wotbox
ahrefsbot
blexbot
bubing
vedma
semrushbot
semrushbot-sa
riddler
curl
guzzlehttp
go-http-client
ccbot
admantx
weborama
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://cogamoney.net/sitemap.php |
Warnings
- `host` is not a known field.