Log In Sign Up

utahparentcenter.org
robots.txt

Robots Exclusion Standard data for utahparentcenter.org

Resource Scan

Scan Details

Site Domain utahparentcenter.org
Base Domain utahparentcenter.org
Scan Status Ok
Last Scan2025-12-20T11:01:18+00:00
Next Scan 2026-01-19T11:01:18+00:00

Last Scan

Scanned2025-12-20T11:01:18+00:00
URL https://utahparentcenter.org/robots.txt
Domain IPs 35.227.166.44
Response IP 35.227.166.44
Found Yes
Hash dc6d218073393be91f5a310796ea32ebe9cbdca9c026cc45193d057e3303e228
SimHash 76d95cd2ec9b

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ahrefsbot
ahrefssiteaudit
barkrowler
dataforseobot
dotbot
rogerbot
semrushbot
siteauditbot
semrushbot-ba

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

crawl4ai

Rule Path
Disallow /

deepseekbot

Rule Path
Disallow /

iaskbot

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

kunatocrawler

Rule Path
Disallow /

wrtnbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://utahparentcenter.org/sitemap.xml
Back to top

Comments

  • START DARK VISITORS BLOCK
  • ---------------------------
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/anthropic-ai
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/claude-web
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/cohere-ai
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/crawl4ai
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/deepseekbot
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/iaskbot
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/iaskspider
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/kunatocrawler
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/wrtnbot
  • ---------------------------
  • END DARK VISITORS BLOCK
Back to top