astm.org
robots.txt

Robots Exclusion Standard data for astm.org

Resource Scan

Scan Details

Site Domain astm.org
Base Domain astm.org
Scan Status Ok
Last Scan2025-10-17T18:14:09+00:00
Next Scan 2025-11-16T18:14:09+00:00

Last Scan

Scanned2025-10-17T18:14:09+00:00
URL https://astm.org/robots.txt
Redirect https://www.astm.org/robots.txt
Redirect Domain www.astm.org
Redirect Base astm.org
Domain IPs 2600:9000:2939:1600:1d:d45f:4300:93a1, 2600:9000:2939:3600:1d:d45f:4300:93a1, 2600:9000:2939:4200:1d:d45f:4300:93a1, 2600:9000:2939:4800:1d:d45f:4300:93a1, 2600:9000:2939:5400:1d:d45f:4300:93a1, 2600:9000:2939:6400:1d:d45f:4300:93a1, 2600:9000:2939:6800:1d:d45f:4300:93a1, 2600:9000:2939:ca00:1d:d45f:4300:93a1, 3.175.207.104, 3.175.207.114, 3.175.207.17, 3.175.207.24
Redirect IPs 13.33.88.27, 13.33.88.52, 13.33.88.74, 13.33.88.76, 2600:9000:223b:1400:1f:90a9:3b00:93a1, 2600:9000:223b:2a00:1f:90a9:3b00:93a1, 2600:9000:223b:4c00:1f:90a9:3b00:93a1, 2600:9000:223b:8400:1f:90a9:3b00:93a1, 2600:9000:223b:d400:1f:90a9:3b00:93a1, 2600:9000:223b:da00:1f:90a9:3b00:93a1, 2600:9000:223b:de00:1f:90a9:3b00:93a1, 2600:9000:223b:e00:1f:90a9:3b00:93a1
Response IP 13.33.88.27
Found Yes
Hash eebb704e372fbc101c1ac4b3526f3921b7ac42232c59ba20dfaad6046fd4b96d
SimHash c101ca20cf33

Groups

*

Rule Path
Allow /
Disallow /contentstack/components/dropdown
Disallow /maintenance-mode

Other Records

Field Value
sitemap https://www.astm.org/sitemap.xml