andrewgelman.com
robots.txt

Robots Exclusion Standard data for andrewgelman.com

Resource Scan

Scan Details

Site Domain andrewgelman.com
Base Domain andrewgelman.com
Scan Status Ok
Last Scan2025-08-12T17:23:22+00:00
Next Scan 2025-09-11T17:23:22+00:00

Last Scan

Scanned2025-08-12T17:23:22+00:00
URL https://andrewgelman.com/robots.txt
Redirect https://statmodeling.stat.columbia.edu/robots.txt
Redirect Domain statmodeling.stat.columbia.edu
Redirect Base columbia.edu
Domain IPs 35.232.19.148
Redirect IPs 162.159.128.65, 162.159.138.64, 2606:4700:7::a29f:8041, 2606:4700:7::a29f:8a40
Response IP 162.159.138.64
Found Yes
Hash cf35b361804ff2662cf782ada68c45d3836d3f360192d1a9ca98c6a30cdeff09
SimHash cb204c88eab2

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 3600