Log In Sign Up

ibithub.com
robots.txt

Robots Exclusion Standard data for ibithub.com

Resource Scan

Scan Details

Site Domain ibithub.com
Base Domain ibithub.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-13T06:36:10+00:00
Next Scan 2025-07-27T06:36:10+00:00

Last Successful Scan

Scanned2025-06-28T06:34:47+00:00
URL https://ibithub.com/robots.txt
Domain IPs 2a02:4780:1:1246:0:10ed:2c6b:2, 31.170.166.7
Response IP 31.170.166.7
Found Yes
Hash ab6a7eeb93dc702333418daa124abed03e77b0b9e83d764ebe27f399fd6cf37c
SimHash 683445960610

Groups

*

Rule Path Comment
Allow / -
Allow /index.php -
Allow /register.php -
Allow /iBH-Wallet.zip -
Allow /poker/ -
Allow /racing/ -
Allow /mining-pools/ -
Allow /contact/ -
Allow /about/ -
Allow /blog/ -
Allow / faq
Allow / qa
Allow / home
Allow / technology
Allow / ecosystem
Allow / games
Allow / mining
Allow / wallets
Allow / origins
Allow / community
Allow / cta
Disallow /login.php -
Disallow /authenticate.php -
Disallow /admin/ -
Disallow /wp-admin/ -
Disallow /user/ -
Disallow /api/ -
Disallow /ibh-stats.php -
Disallow /js/login.js -
Disallow /lib/ -
Disallow /cache/ -
Disallow /*.php$ Block most PHP scripts
Allow /index.php Explicitly allow index.php
Allow /register.php Explicitly allow registration
Disallow /*?* Block query parameters to avoid duplicates
Disallow /trackback/ -
Disallow /feed/ -
Disallow /comments/ -
Disallow /*.log -
Disallow /*.bak -
Disallow /*.tmp -
Disallow /*.zip$ Block ZIP files
Allow /iBH-Wallet.zip Explicitly allow wallet download
Disallow /*.pdf -

googlebot-image

Rule Path
Allow /images/
Allow /IBH400.png
Allow /PokerRoom.jpeg
Allow /bb2.jpg

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.ibithub.com/sitemap.xml
Back to top

Comments

  • robots.txt for https://www.ibithub.com
  • Updated: April 24, 2025
  • Purpose: Optimize crawling for key pages, block sensitive/deprecated areas, and reference sitemap
  • Default rules for all crawlers
  • Allow key pages and sections
  • Disallow sensitive, deprecated, or non-indexable areas
  • Block specific file types
  • Sitemap
  • Specific rules for Googlebot images
  • Block aggressive bots (optional)
  • Notes:
  • - Subdomains (poker.ibithub.com, racing.ibithub.com) require separate robots.txt
  • - External sites (ibh.fyi, explorer.ibithub.com) have their own robots.txt
Back to top