service.elsevier.com
robots.txt

Robots Exclusion Standard data for service.elsevier.com

Resource Scan

Scan Details

Site Domain service.elsevier.com
Base Domain elsevier.com
Scan Status Ok
Last Scan2025-12-17T13:55:22+00:00
Next Scan 2026-01-16T13:55:22+00:00

Last Scan

Scanned2025-12-17T13:55:22+00:00
URL https://service.elsevier.com/robots.txt
Domain IPs 147.154.237.60
Response IP 147.154.237.60
Found Yes
Hash 6b0b31201a8cffd6e574df234eb023362a8000444a4b217c61e8e6ba7b125df7
SimHash 6eded800d447

Groups

googlebot

Product Comment
googlebot Google # CUSTOM
Rule Path Comment
Disallow CUSTOM

msnbot

Product Comment
msnbot MSN # CUSTOM
Rule Path Comment
Disallow CUSTOM

Other Records

Field Value Comment
crawl-delay 0.2 CUSTOM

slurp

Product Comment
slurp Yahoo! # CUSTOM
Rule Path Comment
Disallow CUSTOM

Other Records

Field Value Comment
crawl-delay 0.2 CUSTOM

teoma

Product Comment
teoma Ask.com # CUSTOM
Rule Path Comment
Disallow CUSTOM

bingbot

Product Comment
bingbot Bing # CUSTOM
Rule Path Comment
Disallow CUSTOM

*

Product Comment
* CUSTOM
Rule Path Comment
Disallow / CUSTOM

gptbot

Product Comment
gptbot CUSTOM
Rule Path Comment
Disallow / CUSTOM

chatgpt-user

Product Comment
chatgpt-user CUSTOM
Rule Path Comment
Disallow / CUSTOM

google-extended

Product Comment
google-extended CUSTOM
Rule Path Comment
Disallow / CUSTOM

*

Product Comment
* ADDED BY HMS
Rule Path Comment
Disallow / ADDED BY HMS

Other Records

Field Value Comment
sitemap https://service.elsevier.com/cc/sitemap CUSTOM