mendeley.com
robots.txt
Robots Exclusion Standard data for mendeley.com
Resource Scan
Scan Details
| Site Domain | mendeley.com |
| Base Domain | mendeley.com |
| Scan Status | Ok |
| Last Scan | 2024-04-25T04:51:24+00:00 |
| Next Scan | 2024-05-25T04:51:24+00:00 |
Last Scan
| Scanned | 2024-04-25T04:51:24+00:00 |
| URL | https://mendeley.com/robots.txt |
| Redirect | https://www.mendeley.com/robots.txt |
| Redirect Domain | www.mendeley.com |
| Redirect Base | mendeley.com |
| Domain IPs | 54.192.18.31, 54.192.18.36, 54.192.18.40, 54.192.18.78 |
| Redirect IPs | 162.159.130.86, 162.159.133.86, 2606:4700:7::a29f:8256, 2606:4700:7::a29f:8556 |
| Response IP | 162.159.130.86 |
| Found | Yes |
| Hash | 829b2a7c3774ad9f273c3f7d453c3296934ed36d14da8ed73c415bc7d493632f |
| SimHash | 144cc1286536 |
Groups
adsbot-google-mobile
adsbot-google
*
| Rule | Path |
|---|---|
| Disallow | /beta/ |
| Disallow | /graphics/ |
| Disallow | /jscript/ |
| Disallow | /client/ |
| Disallow | /download/ |
| Disallow | /textimage/ |
| Disallow | /embed/ |
| Disallow | /newsletter/ |
| Disallow | /research-papers/search/ |
| Disallow | /research-papers/?rec |
| Disallow | /research-papers/?ref |
| Disallow | /research-papers/tagged/ |
| Disallow | /tags/ |
| Disallow | /groups/search/ |
| Disallow | /footer/ |
| Disallow | /c/ |
| Disallow | /map |
| Disallow | /groups/*/settings/$ |
| Disallow | /groups/*/papers/ |
| Disallow | /papers/*?* |
| Disallow | /research-papers/*?* |
| Disallow | /catalogue/*?* |
| Disallow | /research/*?* |
| Disallow | /import/* |
| Disallow | /callback/ |
| Disallow | /sign/ |
| Disallow | /onboarding/ |
| Disallow | /confirm-creation/ |
| Disallow | /verify/ |
| Disallow | /intent/ |
| Disallow | /session/ |
| Allow | /careers/misc/*.css$ |
| Allow | /careers/misc/*.css? |
| Allow | /careers/misc/*.js$ |
| Allow | /careers/misc/*.js? |
| Allow | /careers/misc/*.gif |
| Allow | /careers/misc/*.jpg |
| Allow | /careers/misc/*.jpeg |
| Allow | /careers/misc/*.png |
| Allow | /careers/modules/*.css$ |
| Allow | /careers/modules/*.css? |
| Allow | /careers/modules/*.js$ |
| Allow | /careers/modules/*.js? |
| Allow | /careers/modules/*.gif |
| Allow | /careers/modules/*.jpg |
| Allow | /careers/modules/*.jpeg |
| Allow | /careers/modules/*.png |
| Allow | /careers/profiles/*.css$ |
| Allow | /careers/profiles/*.css? |
| Allow | /careers/profiles/*.js$ |
| Allow | /careers/profiles/*.js? |
| Allow | /careers/profiles/*.gif |
| Allow | /careers/profiles/*.jpg |
| Allow | /careers/profiles/*.jpeg |
| Allow | /careers/profiles/*.png |
| Allow | /careers/themes/*.css$ |
| Allow | /careers/themes/*.css? |
| Allow | /careers/themes/*.js$ |
| Allow | /careers/themes/*.js? |
| Allow | /careers/themes/*.gif |
| Allow | /careers/themes/*.jpg |
| Allow | /careers/themes/*.jpeg |
| Allow | /careers/themes/*.png |
| Disallow | /careers/includes/ |
| Disallow | /careers/misc/ |
| Disallow | /careers/modules/ |
| Disallow | /careers/profiles/ |
| Disallow | /careers/scripts/ |
| Disallow | /careers/themes/ |
| Disallow | /careers/CHANGELOG.txt |
| Disallow | /careers/cron.php |
| Disallow | /careers/INSTALL.mysql.txt |
| Disallow | /careers/INSTALL.pgsql.txt |
| Disallow | /careers/INSTALL.sqlite.txt |
| Disallow | /careers/install.php |
| Disallow | /careers/INSTALL.txt |
| Disallow | /careers/LICENSE.txt |
| Disallow | /careers/MAINTAINERS.txt |
| Disallow | /careers/update.php |
| Disallow | /careers/UPGRADE.txt |
| Disallow | /careers/xmlrpc.php |
| Disallow | /careers/admin/ |
| Disallow | /careers/comment/reply/ |
| Disallow | /careers/filter/tips/ |
| Disallow | /careers/node/add/ |
| Disallow | /careers/search/ |
| Disallow | /careers/user/register/ |
| Disallow | /careers/user/password/ |
| Disallow | /careers/user/login/ |
| Disallow | /careers/user/logout/ |
| Disallow | /careers/?q=admin%2F |
| Disallow | /careers/?q=comment%2Freply%2F |
| Disallow | /careers/?q=filter%2Ftips%2F |
| Disallow | /careers/?q=node%2Fadd%2F |
| Disallow | /careers/?q=search%2F |
| Disallow | /careers/?q=user%2Fpassword%2F |
| Disallow | /careers/?q=user%2Fregister%2F |
| Disallow | /careers/?q=user%2Flogin%2F |
| Disallow | /careers/?q=user%2Flogout%2F |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.mendeley.com/sitemaps/sitemap-index-papers.xml |
| sitemap | http://www.mendeley.com/sitemaps/sitemap-index-disciplines.xml |
| sitemap | http://www.mendeley.com/sitemaps/sitemap-index-general.xml |
| sitemap | http://www.mendeley.com/sitemaps/sitemap-index-groups.xml |
| sitemap | http://www.mendeley.com/sitemaps/sitemap-cms.xml |
Comments