countryfile.com
robots.txt

Robots Exclusion Standard data for countryfile.com

Resource Scan

Scan Details

Site Domain countryfile.com
Base Domain countryfile.com
Scan Status Ok
Last Scan2024-05-31T22:50:07+00:00
Next Scan 2024-06-07T22:50:07+00:00

Last Scan

Scanned2024-05-31T22:50:07+00:00
URL https://countryfile.com/robots.txt
Redirect https://www.countryfile.com/robots.txt
Redirect Domain www.countryfile.com
Redirect Base countryfile.com
Domain IPs 3.124.189.64
Redirect IPs 2600:9000:234d:2c00:19:e4bb:3140:93a1, 2600:9000:234d:3000:19:e4bb:3140:93a1, 2600:9000:234d:4600:19:e4bb:3140:93a1, 2600:9000:234d:4c00:19:e4bb:3140:93a1, 2600:9000:234d:7200:19:e4bb:3140:93a1, 2600:9000:234d:c400:19:e4bb:3140:93a1, 2600:9000:234d:e00:19:e4bb:3140:93a1, 2600:9000:234d:f600:19:e4bb:3140:93a1, 65.9.112.122, 65.9.112.27, 65.9.112.32, 65.9.112.71
Response IP 18.165.171.19
Found Yes
Hash f85d0f0e4450403b46d79f4f866135cc107011536a5784ec150920f279249aad
SimHash e10c9860c113

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.countryfile.com/sitemap/index.xml.gz
sitemap https://www.countryfile.com/sitemap/news.xml.gz