britannica.com
robots.txt

Robots Exclusion Standard data for britannica.com

Resource Scan

Scan Details

Site Domain britannica.com
Base Domain britannica.com
Scan Status Ok
Last Scan2024-11-13T12:59:46+00:00
Next Scan 2024-11-20T12:59:46+00:00

Last Scan

Scanned2024-11-13T12:59:46+00:00
URL https://britannica.com/robots.txt
Redirect https://www.britannica.com:443/robots.txt
Redirect Domain www.britannica.com
Redirect Base britannica.com
Domain IPs 18.207.7.43, 34.200.125.92
Redirect IPs 104.18.4.110, 104.18.5.110
Response IP 104.18.5.110
Found Yes
Hash ae63db37b65de49448e08925e3e43b5011910871e640b6ac0966ba0aba0c74af
SimHash 3984ad650692

Groups

*

Rule Path
Disallow /search

Other Records

Field Value
sitemap https://www.britannica.com/bps-ssl-gsm-index.xml

Comments

  • /robots.txt file for encyclopaedia britannica