bushofficial.com
robots.txt

Robots Exclusion Standard data for bushofficial.com

Resource Scan

Scan Details

Site Domain bushofficial.com
Base Domain bushofficial.com
Scan Status Ok
Last Scan2025-04-23T00:10:44+00:00
Next Scan 2025-05-23T00:10:44+00:00

Last Scan

Scanned2025-04-23T00:10:44+00:00
URL https://bushofficial.com/robots.txt
Domain IPs 104.21.65.230, 172.67.152.23, 2606:4700:3031::6815:41e6, 2606:4700:3037::ac43:9817
Response IP 104.21.65.230
Found Yes
Hash a94d627ae289b07c6a185024b1c1c5248034dac8ddbb832255bd7ff8fe750436
SimHash 6276c4d28317

Groups

*

Rule Path
Allow /
Disallow /inc/
Disallow /js/
Disallow /css/
Disallow /tools/

Other Records

Field Value
crawl-delay 10

googlebot/2.1

Rule Path
Allow /

spbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

wormly

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.com/crawler

Rule Path
Disallow /

Comments

  • E-mail webmaster@section101.com if you're authorized to access this site, but getting denied.