Log In Sign Up

hidencloud.com
robots.txt

Robots Exclusion Standard data for hidencloud.com

Resource Scan

Scan Details

Site Domain hidencloud.com
Base Domain hidencloud.com
Scan Status Ok
Last Scan2025-12-10T13:27:56+00:00
Next Scan 2025-12-17T13:27:56+00:00

Last Scan

Scanned2025-12-10T13:27:56+00:00
URL https://hidencloud.com/robots.txt
Redirect https://www.hidencloud.com/robots.txt
Redirect Domain www.hidencloud.com
Redirect Base hidencloud.com
Domain IPs 104.26.0.183, 104.26.1.183, 172.67.69.72, 2606:4700:20::681a:1b7, 2606:4700:20::681a:b7, 2606:4700:20::ac43:4548
Redirect IPs 104.26.0.183, 104.26.1.183, 172.67.69.72, 2606:4700:20::681a:1b7, 2606:4700:20::681a:b7, 2606:4700:20::ac43:4548
Response IP 104.26.1.183
Found Yes
Hash d75d046e45d89ab520e4fad104f1f3e652757c8a4e5bf856979bae9312568e2e
SimHash a130bd52a474

Groups

gptbot

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

chatgpt-user

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

google-extended

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

anthropic-ai

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

claude-web

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

ccbot

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

perplexitybot

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

facebookbot

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

meta-externalagent

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

cohere-ai

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

amazonbot

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

applebot-extended

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

bytespider

Rule Path
Allow /
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /
Allow /service/
Allow /about-us
Allow /contact-us
Allow /terms-of-service
Allow /privacy-policy
Allow /cookies-policy
Allow /free-discord-hosting
Allow /free-minecraft-hosting
Allow /discord-hosting
Allow /minecraft-hosting
Allow /python-hosting
Allow /node-hosting
Allow /game-servers
Allow /free-tier
Allow /compare/
Allow /cheap-*
Allow /best-*
Allow /affordable-*
Allow /premium-*
Allow /fast-*
Allow /assets/
Allow /sitemap.xml
Allow /sitemap.xsl
Allow /ads.txt
Allow /ai.txt
Allow /manifest.json
Disallow /vendor/
Disallow /src/
Disallow /lang/
Disallow /hidencloudstorage/
Disallow /composer.json
Disallow /composer.lock
Disallow /helpers.php
Disallow /switch-lang.php
Disallow /php_errorlog
Disallow /*.log
Disallow /*.php
Disallow /.*

Other Records

Field Value
crawl-delay 10
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.hidencloud.com/sitemap.xml
Back to top

Comments

  • robots.txt for HidenCloud
  • https://www.hidencloud.com
  • ============================================
  • AI CRAWLERS - Specific rules for AI bots
  • ============================================
  • OpenAI GPTBot
  • OpenAI ChatGPT browsing
  • Google AI (Bard/Gemini training)
  • Anthropic Claude
  • Common Crawl (used by many AI systems)
  • Perplexity AI
  • Meta AI
  • Cohere AI
  • Amazon Alexa
  • Apple Intelligence
  • ByteDance
  • ============================================
  • STANDARD SEARCH ENGINE CRAWLERS
  • ============================================
  • Allow public pages
  • Allow comparison pages (SEO)
  • Allow keyword landing pages (SEO)
  • Allow public assets
  • Disallow internal directories
  • Disallow configuration and log files
  • Disallow direct PHP file access (except routed URLs)
  • Disallow hidden files
  • Sitemap location
  • Crawl-delay (optional, be gentle with the server)
Back to top