ssrn.com
robots.txt

Robots Exclusion Standard data for ssrn.com

Resource Scan

Scan Details

Site Domain ssrn.com
Base Domain ssrn.com
Scan Status Ok
Last Scan2026-01-12T02:44:45+00:00
Next Scan 2026-02-11T02:44:45+00:00

Last Scan

Scanned2026-01-12T02:44:45+00:00
URL https://ssrn.com/robots.txt
Redirect https://www.ssrn.com/robots.txt
Redirect Domain www.ssrn.com
Redirect Base ssrn.com
Domain IPs 13.35.238.123, 13.35.238.21, 13.35.238.37, 13.35.238.80
Redirect IPs 104.16.39.248, 104.16.40.248, 104.16.41.248, 104.16.42.248, 104.16.43.248
Response IP 104.16.40.248
Found Yes
Hash ab3e94cea927f2da51b16dd509d137ba8798c0a20229d6961b9df577079d2465
SimHash 6b15d850e331

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /tasks/
Disallow /config/

Other Records

Field Value
crawl-delay 5