hyperverge.co
robots.txt

Robots Exclusion Standard data for hyperverge.co

Resource Scan

Scan Details

Site Domain hyperverge.co
Base Domain hyperverge.co
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-22T07:22:44+00:00
Next Scan 2026-01-21T07:22:44+00:00

Last Successful Scan

Scanned2025-08-31T18:12:15+00:00
URL https://hyperverge.co/robots.txt
Domain IPs 89.116.133.119
Response IP 89.116.133.119
Found Yes
Hash 863ae4aa029fe7f0831300b0713002146bc0e66c27a1fabc0b66920727209a9c
SimHash 556c2bc2b6f5

Groups

*

Rule Path
Disallow
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

apis-google

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

storebot-google

Rule Path
Allow /

google-extended

Rule Path
Allow /

googleother

Rule Path
Allow /

bingbot

Rule Path
Allow /

adidxbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

operator

Rule Path
Allow /

meta-externalfetcher

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

facebookbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claude-user

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

bytespider

Rule Path
Allow /

ccbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

cohere-training-data-crawler

Rule Path
Allow /

ai2bot

Rule Path
Allow /

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

*

Rule Path
Disallow /wp-content/uploads/2025/07/ipp-00oo.docx.pdf
Disallow /wp-content/uploads/2025/07/geep-00oogeep.docx.pdf
Disallow /wp-content/uploads/2025/07/coc-00oocc.docx.pdf
Disallow /wp-content/uploads/2025/07/amp-00ooap.docx.pdf
Disallow /wp-content/uploads/2025/07/abac-00ooabandac.docx.pdf
Disallow /wp-content/uploads/2025/07/aigp-00ooai.docx.pdf
Disallow /wp-content/uploads/2025/07/tp-00ootphv.pdf
Disallow /wp-content/uploads/2025/07/posh-00oop.pdf
Disallow /wp-content/uploads/2025/07/Posh.docx.pdf
Disallow /wp-content/uploads/2025/08/AI-Team-List-of-Tools.docx.pdf

Other Records

Field Value
sitemap https://hyperverge.co/sitemap_index.xml
sitemap https://hyperverge.co/sitemap_home.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Allow specific directories (optional, for example)
  • Sitemaps
  • ---------------------------
  • END YOAST BLOCK
  • Allow all known AI and major bots
  • WP Import Export Rule