wisehosting.com
robots.txt

Robots Exclusion Standard data for wisehosting.com

Resource Scan

Scan Details

Site Domain wisehosting.com
Base Domain wisehosting.com
Scan Status Ok
Last Scan2026-01-02T04:12:06+00:00
Next Scan 2026-01-16T04:12:06+00:00

Last Scan

Scanned2026-01-02T04:12:06+00:00
URL https://wisehosting.com/robots.txt
Domain IPs 104.26.0.248, 104.26.1.248, 172.67.74.153, 2606:4700:20::681a:1f8, 2606:4700:20::681a:f8, 2606:4700:20::ac43:4a99
Response IP 172.67.74.153
Found Yes
Hash b895a55d442c031bb165fd586eb03b82499451e1a548c11fea0fd8d9da8d316a
SimHash 401051402e34

Groups

*

Rule Path
Disallow /cart.php
Disallow /dl/
Allow /billing/login.php
Allow /billing/clientarea.php
Disallow /billing/
Allow /minecraft-seeds/
Allow /minecraft-seeds/search
Allow /minecraft-seeds/tag/

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

claude-web

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

amazonbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

youbot

Rule Path
Allow /

bytespider

Rule Path
Allow /

ccbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

diffbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://wisehosting.com/sitemap.xml

Comments

  • General crawlers
  • Minecraft Seeds - Allow full crawling
  • AI/LLM Crawlers - Welcome!
  • Sitemaps and LLM resources