Log In Sign Up

bitcoinchaser.com
robots.txt

Robots Exclusion Standard data for bitcoinchaser.com

Resource Scan

Scan Details

Site Domain bitcoinchaser.com
Base Domain bitcoinchaser.com
Scan Status Ok
Last Scan2025-08-17T11:59:39+00:00
Next Scan 2025-09-16T11:59:39+00:00

Last Scan

Scanned2025-08-17T11:59:39+00:00
URL https://bitcoinchaser.com/robots.txt
Domain IPs 104.21.64.58, 172.67.176.167, 2606:4700:3031::6815:403a, 2606:4700:3037::ac43:b0a7
Response IP 172.67.176.167
Found Yes
Hash 07b54204a71d204d86953fb043c5f440630a7fb5f6bf835cf22df1f3c9690090
SimHash c8e15903a1f8

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /goto/
Disallow /calendar/action%3Aposterboard/
Disallow /calendar/action%3Aagenda/
Disallow /calendar/action%3Aoneday/
Disallow /calendar/action%3Amonth/
Disallow /calendar/action%3Aweek/
Disallow /calendar/action%3Amap/
Disallow */feed*
Disallow /feed/
Disallow /comments/feed/
Disallow /provider/*/feed/
Disallow /game/*/feed/
Disallow /bonus/*/feed/
Disallow /streamer/*/feed/
Disallow /review/*/feed/
Disallow /*?p=*
Disallow /*%26p%3D*
Disallow /*?post_type=*
Disallow /*?s=*
Disallow /*?orderby=*
Disallow /.env
Disallow /vendor/
Disallow /wp-content/debug.log
Disallow /xmlrpc.php

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /
Back to top

Comments

  • Block admin and system paths
  • Block calendar-specific views
  • Block all feeds
  • Block provider/game/bonus/etc. feeds
  • Block query strings
  • Optional: Block paginated results
  • Disallow: */page/
  • Block common exploit scanners
  • Allow known bots (optional)
Back to top