blog.aboutamazon.com
robots.txt

Robots Exclusion Standard data for blog.aboutamazon.com

Resource Scan

Scan Details

Site Domain blog.aboutamazon.com
Base Domain aboutamazon.com
Scan Status Ok
Last Scan2024-05-02T03:15:24+00:00
Next Scan 2024-06-01T03:15:24+00:00

Last Scan

Scanned2024-05-02T03:15:24+00:00
URL https://blog.aboutamazon.com/robots.txt
Redirect https://www.aboutamazon.com/robots.txt
Redirect Domain www.aboutamazon.com
Redirect Base aboutamazon.com
Domain IPs 108.156.133.118, 108.156.133.27, 108.156.133.74, 108.156.133.98, 2600:9000:2755:3000:c:19fd:2240:93a1, 2600:9000:2755:4800:c:19fd:2240:93a1, 2600:9000:2755:4a00:c:19fd:2240:93a1, 2600:9000:2755:5e00:c:19fd:2240:93a1, 2600:9000:2755:7400:c:19fd:2240:93a1, 2600:9000:2755:7e00:c:19fd:2240:93a1, 2600:9000:2755:8600:c:19fd:2240:93a1, 2600:9000:2755:e600:c:19fd:2240:93a1
Redirect IPs 108.156.133.118, 108.156.133.27, 108.156.133.74, 108.156.133.98, 2600:9000:2755:0:c:19fd:2240:93a1, 2600:9000:2755:1600:c:19fd:2240:93a1, 2600:9000:2755:2800:c:19fd:2240:93a1, 2600:9000:2755:2a00:c:19fd:2240:93a1, 2600:9000:2755:5400:c:19fd:2240:93a1, 2600:9000:2755:bc00:c:19fd:2240:93a1, 2600:9000:2755:ce00:c:19fd:2240:93a1, 2600:9000:2755:d200:c:19fd:2240:93a1
Response IP 108.156.133.118
Found Yes
Hash 03e8b5f79b5f51cbeab9c569e7f0e03c9fd7d18d3b783baad051420181a0d6d8
SimHash 6b08dc546401

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.aboutamazon.com/sitemap.xml
sitemap https://www.aboutamazon.com/news-sitemap.xml