selectscience.net
robots.txt
Robots Exclusion Standard data for selectscience.net
Resource Scan
Scan Details
| Site Domain | selectscience.net |
| Base Domain | selectscience.net |
| Scan Status | Ok |
| Last Scan | 2024-05-10T07:31:03+00:00 |
| Next Scan | 2024-06-09T07:31:03+00:00 |
Last Scan
| Scanned | 2024-05-10T07:31:03+00:00 |
| URL | https://selectscience.net/robots.txt |
| Redirect | https://www.selectscience.net/robots.txt |
| Redirect Domain | www.selectscience.net |
| Redirect Base | selectscience.net |
| Domain IPs | 104.25.80.25, 104.25.81.25, 172.67.64.196, 2606:4700:20::6819:5019, 2606:4700:20::6819:5119, 2606:4700:20::ac43:40c4 |
| Redirect IPs | 104.25.80.25, 104.25.81.25, 172.67.64.196, 2606:4700:20::6819:5019, 2606:4700:20::6819:5119, 2606:4700:20::ac43:40c4 |
| Response IP | 104.25.80.25 |
| Found | Yes |
| Hash | 7e541319285cd6e2babbcc991c4a65ced7b0b57638caabbd14b0fcfa6364b446 |
| SimHash | 63af5331e567 |
Groups
acoon
exabot
mozilla/4.0 (compatible; msie 5.0; windows nt; digext; dts agent
sosospider
spinn3r
alexibot
aqua_products
asterias
b2w/0.1
backdoorbot/1.0
becomebot
black hole
blowfish/1.0
bookmark search tool
botalot
builtbottough
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypicker /1.0
cherrypickerelite/1.0
cherrypickerse/1.0
copernic
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
dittospyder
dumbot
emailcollector
emailsiphon
emailwolf
erocrawler
es
extractorpro
fairad client
flaming attackbot
foobot
freefind
gaisbot
getright/4.2
grub
grub-client
harvest/1.5
hatena antenna
hloader
httplib
humanlinks
infonavirobot
iron33/1.0.2
jennybot
jetbot
jetbot/1.0
kenjin spider
keyword density/0.9
larbin
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lnspiderguy
lwp-trivial
lwp-trivial/1.34
mata hari
mediapartners-google
metatagrobot
metatagrobot/2.1+
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
moget
moget/2.1
msiecrawler
naver
netants
netmechanic
nicerspro
nutch
offline explorer
omniexplorer_bot
openbot
openfind
openfind data gathere
oracle ultra search
perman
propowerbot/2.14
prowebwalker
psbot
python-urllib
qqbrowser
queryn metasearch
radiation retriever 1.1
repomonkey
repomonkey bait & tackle/v1.01
rma
searchpreview
sitesnagger
sootle
spankbot
spanner
sogou pic spider
sogou head spider
sogou web spider
sogou orion spider
sogou-test-spider
sogou spider
sogou pic agent
stanford
stanford comp sci
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
url control
url_spider_pro
urly warning
vci
vci webviewer vci webviewer win32
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webenhancer
webmasterworldforumbot
websauger
website quester
webster pro
webstripper
webvac
webzip
webzip/4.0
wget
wget/1.5.3
wget/1.6
www-collector-e
yandexbot
yandexmobilebot
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /Error_* | - |
| Disallow | /go/* | - |
| Disallow | /includes/logClickThroughs.asp?* | - |
| Disallow | /util* | - |
| Disallow | /commNW* | - |
| Disallow | /elrignewsdetail.aspx | - |
| Disallow | /enquiryForm.aspx | - |
| Disallow | /enquiryFormApp.aspx | - |
| Disallow | /enquiryReg.aspx | - |
| Disallow | /eventsList.asp | - |
| Disallow | /prodsEnquiry.aspx | - |
| Disallow | /FFregister.aspx | - |
| Disallow | /SSReg* | - |
| Disallow | /SSUser* | - |
| Disallow | /review.aspx | - |
| Disallow | /add/* | - |
| Disallow | /login* | - |
| Disallow | /sponsoradmin* | - |
| Disallow | /guidelines* | - |
| Disallow | /newsbs* | - |
| Disallow | /prodDir.asp | - |
| Disallow | /*_pittcon.aspx | - |
| Disallow | /sbs* | - |
| Disallow | /searchmain.aspx?* | Begin ADDED |
| Disallow | /*/page/* | Already in list |
| Disallow | /*/page-1* | missing in list |
| Disallow | /*/page-2* | missing in list |
| Disallow | /*/page-3* | missing in list |
| Disallow | /*/page-4* | missing in list |
| Disallow | /*/page-5* | missing in list |
| Disallow | /*?tag=* | - |
| Disallow | /*%26tag%3D* | - |
| Disallow | /user-profile/*?userID=* | Also remove link on product page to here |
| Disallow | /sponsoradmin/* | TBC |
| Disallow | /Guidelines/* | - |
| Disallow | /commNWDetails.aspx?* | - |
| Disallow | /contact.aspx?* | - |
| Disallow | /register_product.aspx?* | LoginWall |
| Disallow | /review.aspx?prodid=* | - |
| Disallow | /enquiryForm.aspx?* | - |
| Disallow | /ThankYouReg.aspx?* | - |
| Disallow | /suppliers/syncroscopy/?compID=5812 | - |
| Disallow | /SelectScience-TV/Videos/science-behind-the-olympics-prof-david-cowan-at-anti-doping-hq/?VideoID=1001 | - |
| Disallow | /antibodies-product/apc%2Bfire-750-anti-mouse-cd4/?antibodyID=13418 | - |
| Disallow | /editorial-articles/anion-application-notes-for-environmental-water-analysis-experts/?artID=42506 | - |
| Disallow | /products/%28disabled%29bio-rads-knowitall-adme%2Btox-edition/?prodID=10437 | - |
| Disallow | /products/contraa---300--high-resolution-continuum-source-aas/?prodID=86106 | - |
| Disallow | /products/contraa---600--high-resolution-continuum-source-aas/?prodID=11164 | - |
| Disallow | /products/contraa---700--high-resolution-continuum-source-aas/?prodID=86107 | - |
| Disallow | /products/crysscreen-protein-crystallography-software/?prodID=13937 | - |
| Disallow | /products/density-meter-dma-4200-m/?prodID=197569 | - |
| Disallow | /products/density-meter-for-the-petroleum-industry-dma-4200-m/?prodID=197614 | - |
| Disallow | /products/facts-flexible-assay-composer-and-task-scheduler/?prodID=13934 | - |
| Disallow | /products/freedom-evo-%2B-remp-sss-factory/?prodID=81304 | - |
| Disallow | /products/freedom-evo---digest/?prodID=13949 | - |
| Disallow | /products/freedom-evo---genotyping/?prodID=13947 | - |
| Disallow | /products/freedom-evo-series/?prodID=194968 | - |
| Disallow | /products/genomic-and-proteomic-applications---microarrays/?prodID=13946 | - |
| Disallow | /products/haveitall-nmr/?prodID=6794 | - |
| Disallow | /products/haveitall-raman/?prodID=9929 | - |
| Disallow | /products/hs-4800-pro-and-400-pro-hybridization-stations/?prodID=10216 | - |
| Disallow | /products/knowitall-informatics-system-chemwindow-edition/?prodID=9823 | - |
| Disallow | /products/knowitall-ir-databases-and-software/?prodID=116551 | - |
| Disallow | /products/knowitall-spectral-data-management/?prodID=9826 | - |
| Disallow | /products/ls-reloaded-laser-scanner/?prodID=10207 | - |
| Disallow | /products/octet-htx-system/?prodID=194964 | - |
| Disallow | /products/octet-red-system/?prodID=84598 | - |
| Disallow | /products/portrait-heat-sealer/?prodID=81320 | - |
| Disallow | /products/safegrip-nitrile-powder-free-gloves/?prodID=12279 | - |
| Disallow | /products/sample-administration-system-%28sas%29/?prodID=81308 | - |
| Disallow | /products/seal-piercing-family/?prodID=81323 | - |
| Disallow | /products/stabinger-viscometer-svm-3000/?prodID=114760 | - |
| Disallow | /products/stacking-heat-sealer/?prodID=81321 | - |
| Disallow | /products/storage-plate-384/?prodID=81313 | - |
| Disallow | /products/tube-punching-workstation/?prodID=81324 | - |
| Disallow | /downloads/articles/* | - |
| Allow | /go/*%26url%3D*selectscience.net | - |
| Allow | /blog/feed | - |
| Allow | /rss.aspx | - |
| Allow | /register.aspx?* | - |
| Allow | /register.aspx | - |
| Allow | /mediakit | - |
| Allow | /mediakit/* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.selectscience.net/sitemap.xml |
| sitemap | https://www.selectscience.net/sitemapmain.xml |
| sitemap | https://www.selectscience.net/videositemap.xml |
| sitemap | https://www.selectscience.net/news_sitemap1.xml |
| sitemap | https://www.selectscience.net/images/mailshots/SelectScience/CDpodcastfeed_2013.xml |
| sitemap | https://www.selectscience.net/sitemaps/antibodysitemap4.xml |
| sitemap | https://www.selectscience.net/sitemaps/antibodysitemap29.xml |
| sitemap | https://www.selectscience.net/sitemaps/antibodysitemap28.xml |
| sitemap | https://www.selectscience.net/sitemaps/antibodysitemap27.xml |
| sitemap | https://www.selectscience.net/sitemaps/antibodysitemap14102016.xml |
| sitemap | https://www.selectscience.net/sitemaps/antibodysitemap102016.xml |
| sitemap | https://www.selectscience.net/sitemaps/antibodysitemap.xml |
| sitemap | https://www.selectscience.net/sitemaps/antibodysitemap31.xml |
Warnings
- 2 invalid lines.
Comments