persistiq.com
robots.txt

Robots Exclusion Standard data for persistiq.com

Resource Scan

Scan Details

Site Domain persistiq.com
Base Domain persistiq.com
Scan Status Ok
Last Scan2025-09-02T13:52:51+00:00
Next Scan 2025-10-02T13:52:51+00:00

Last Scan

Scanned2025-09-02T13:52:51+00:00
URL https://www.persistiq.com/robots.txt
Domain IPs 104.26.8.47, 104.26.9.47, 172.67.73.52, 2606:4700:20::681a:82f, 2606:4700:20::681a:92f, 2606:4700:20::ac43:4934
Response IP 104.26.9.47
Found Yes
Hash cf51f5a68077621982633f99e155915871547325eb20c953d7d69d4719731f04
SimHash 4f25c2018802

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

chatgpt-user/2.0

Rule Path
Allow /

claudebot/1.0

Rule Path
Allow /

claude-web/1.0

Rule Path
Allow /

claude-user

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user/1.0

Rule Path
Allow /

google-extended/1.0

Rule Path
Allow /

bingbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

applebot

Rule Path
Allow /

duckassistbot/1.0

Rule Path
Allow /

cohere-ai/1.0

Rule Path
Allow /

ai2bot/1.0

Rule Path
Allow /

ccbot/1.0

Rule Path
Allow /

diffbot/0.1

Rule Path
Allow /

youbot

Rule Path
Allow /

mistralai-user/1.0

Rule Path
Allow /

bingchat

Rule Path
Allow /

metabot

Rule Path
Allow /

copilotbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.persistiq.com/sitemap_index.xml