hughniverse.com
robots.txt

Robots Exclusion Standard data for hughniverse.com

Resource Scan

Scan Details

Site Domain hughniverse.com
Base Domain hughniverse.com
Scan Status Ok
Last Scan2025-10-13T01:35:10+00:00
Next Scan 2025-11-12T01:35:10+00:00

Last Scan

Scanned2025-10-13T01:35:10+00:00
URL https://hughniverse.com/robots.txt
Redirect https://www.hughniverse.com/robots.txt
Redirect Domain www.hughniverse.com
Redirect Base hughniverse.com
Domain IPs 192.124.249.13
Redirect IPs 192.124.249.13
Response IP 192.124.249.13
Found Yes
Hash f8e6785d2573330ecc508ace0f83580a659a9144149c7d99655fd4340552aae6
SimHash 1838d810c433

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /category/radio-show/podcast/
Disallow /category/radio-show/feed/podcast/
Disallow /feed/podcast/
Disallow /category/hugh-hewitt-show/radio-show/feed/podcast/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Comments

  • AI Bots
  • OpenAI bots
  • Google AI bots - Bard, Gemini and VertexAI
  • commoncrawl AI
  • Perplexity AI
  • End AI Bots