pure.elsevier.com
robots.txt

Robots Exclusion Standard data for pure.elsevier.com

Resource Scan

Scan Details

Site Domain pure.elsevier.com
Base Domain elsevier.com
Scan Status Ok
Last Scan2024-05-29T07:44:48+00:00
Next Scan 2024-06-28T07:44:48+00:00

Last Scan

Scanned2024-05-29T07:44:48+00:00
URL https://pure.elsevier.com/robots.txt
Redirect https://helpcenter.pure.elsevier.com:443/robots.txt
Redirect Domain helpcenter.pure.elsevier.com
Redirect Base elsevier.com
Domain IPs 52.48.86.116, 52.49.116.242, 54.154.71.17
Redirect IPs 54.204.238.15, 54.209.91.188, 54.221.251.148, 75.101.184.39
Response IP 54.204.238.15
Found Yes
Hash c5bd3726fb11117c05571fbe4cc34f466f539da389560947d435ec83bb459f5f
SimHash b014d8208172

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Comments

  • OpenAI
  • Bard