encyclopedia.design
robots.txt

Robots Exclusion Standard data for encyclopedia.design

Resource Scan

Scan Details

Site Domain encyclopedia.design
Base Domain encyclopedia.design
Scan Status Ok
Last Scan2026-02-11T16:10:09+00:00
Next Scan 2026-02-18T16:10:09+00:00

Last Scan

Scanned2026-02-11T16:10:09+00:00
URL https://encyclopedia.design/robots.txt
Domain IPs 104.26.2.58, 104.26.3.58, 172.67.73.161, 2606:4700:20::681a:23a, 2606:4700:20::681a:33a, 2606:4700:20::ac43:49a1
Response IP 104.26.2.58
Found Yes
Hash 755f046fb54dc0d92dd9a014ff96c25361ef3383ad28e3657c3f81de1a3dbb28
SimHash 40009820e133

Groups

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://encyclopedia.design/sitemap.xml
sitemap https://encyclopedia.design/news-sitemap.xml