mobile.latercera.com
robots.txt

Robots Exclusion Standard data for mobile.latercera.com

Resource Scan

Scan Details

Site Domain mobile.latercera.com
Base Domain latercera.com
Scan Status Ok
Last Scan2024-04-25T17:56:57+00:00
Next Scan 2024-05-25T17:56:57+00:00

Last Scan

Scanned2024-04-25T17:56:57+00:00
URL https://mobile.latercera.com/robots.txt
Redirect https://www.latercera.com/robots.txt
Redirect Domain www.latercera.com
Redirect Base latercera.com
Domain IPs 13.33.88.121, 13.33.88.53, 13.33.88.55, 13.33.88.82, 2600:9000:223b:1400:16:6e8c:8180:93a1, 2600:9000:223b:1800:16:6e8c:8180:93a1, 2600:9000:223b:2600:16:6e8c:8180:93a1, 2600:9000:223b:6e00:16:6e8c:8180:93a1, 2600:9000:223b:8400:16:6e8c:8180:93a1, 2600:9000:223b:9c00:16:6e8c:8180:93a1, 2600:9000:223b:ce00:16:6e8c:8180:93a1, 2600:9000:223b:d800:16:6e8c:8180:93a1
Redirect IPs 125.56.219.9, 2600:1413:b000:14::b857:c144, 2600:1413:b000:14::b857:c155, 96.17.72.74
Response IP 42.99.140.200
Found Yes
Hash fa53aa273eea0b883d8e92915816ef46d44ca9860711f9ce8fe2b71ed30a9d3a
SimHash 5818c800cfd3

Groups

petalbot

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /arcio/news-sitemap/

Other Records

Field Value
sitemap https://www.latercera.com/arc/outboundfeeds/sitemap-index?outputType=xml
sitemap https://www.latercera.com/arc/outboundfeeds/news-sitemap-index?outputType=xml
sitemap https://www.latercera.com/arc/outboundfeeds/sitemap?outputType=xml

Comments

  • Huawei