Log In Sign Up

cubebik.com
robots.txt

Robots Exclusion Standard data for cubebik.com

Resource Scan

Scan Details

Site Domain cubebik.com
Base Domain cubebik.com
Scan Status Ok
Last Scan2024-11-14T10:52:12+00:00
Next Scan 2024-11-21T10:52:12+00:00

Last Scan

Scanned2024-11-14T10:52:12+00:00
URL https://cubebik.com/robots.txt
Redirect https://www.cubebik.com/robots.txt
Redirect Domain www.cubebik.com
Redirect Base cubebik.com
Domain IPs 104.18.22.236, 104.18.23.236, 2606:4700::6812:16ec, 2606:4700::6812:17ec
Redirect IPs 104.18.22.236, 104.18.23.236, 2606:4700::6812:16ec, 2606:4700::6812:17ec
Response IP 104.18.23.236
Found Yes
Hash 1b4dda54131e89cdc4b21de15b523101dd1c7a4154c64ea8e09968514b9934cd
SimHash c22fd9defb15

Groups

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.1

*

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /opcache/
Disallow /checkout/
Disallow /cart/
Disallow /readme.html
Disallow /license.txt
Allow .js
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/images/*
Back to top

Other Records

Field Value
sitemap https://www.cubebik.com/sitemap_index.xml
Back to top

Comments

  • CCCCCCCCCCCCCUUUUUUUU UUUUUUUUBBBBBBBBBBBBBBBBB EEEEEEEEEEEEEEEEEEEEEEBBBBBBBBBBBBBBBBB IIIIIIIIIIKKKKKKKKK KKKKKKK
  • CCC::::::::::::CU::::::U U::::::UB::::::::::::::::B E::::::::::::::::::::EB::::::::::::::::B I::::::::IK:::::::K K:::::K
  • CC:::::::::::::::CU::::::U U::::::UB::::::BBBBBB:::::B E::::::::::::::::::::EB::::::BBBBBB:::::B I::::::::IK:::::::K K:::::K
  • C:::::CCCCCCCC::::CUU:::::U U:::::UUBB:::::B B:::::BEE::::::EEEEEEEEE::::EBB:::::B B:::::BII::::::IIK:::::::K K::::::K
  • C:::::C CCCCCC U:::::U U:::::U B::::B B:::::B E:::::E EEEEEE B::::B B:::::B I::::I KK::::::K K:::::KKK
  • C:::::C U:::::D D:::::U B::::B B:::::B E:::::E B::::B B:::::B I::::I K:::::K K:::::K
  • C:::::C U:::::D D:::::U B::::BBBBBB:::::B E::::::EEEEEEEEEE B::::BBBBBB:::::B I::::I K::::::K:::::K
  • C:::::C U:::::D D:::::U B:::::::::::::BB E:::::::::::::::E B:::::::::::::BB I::::I K:::::::::::K
  • C:::::C U:::::D D:::::U B::::BBBBBB:::::B E:::::::::::::::E B::::BBBBBB:::::B I::::I K:::::::::::K
  • C:::::C U:::::D D:::::U B::::B B:::::B E::::::EEEEEEEEEE B::::B B:::::B I::::I K::::::K:::::K
  • C:::::C U:::::D D:::::U B::::B B:::::B E:::::E B::::B B:::::B I::::I K:::::K K:::::K
  • C:::::C CCCCCC U::::::U U::::::U B::::B B:::::B E:::::E EEEEEE B::::B B:::::B I::::I KK::::::K K:::::KKK
  • C:::::CCCCCCCC::::C U:::::::UUU:::::::U BB:::::BBBBBB::::::BEE::::::EEEEEEEE:::::EBB:::::BBBBBB::::::BII::::::IIK:::::::K K::::::K
  • CC:::::::::::::::C UU:::::::::::::UU B:::::::::::::::::B E::::::::::::::::::::EB:::::::::::::::::B I::::::::IK:::::::K K:::::K
  • CCC::::::::::::C UU:::::::::UU B::::::::::::::::B E::::::::::::::::::::EB::::::::::::::::B I::::::::IK:::::::K K:::::K
  • CCCCCCCCCCCCC UUUUUUUUU BBBBBBBBBBBBBBBBB EEEEEEEEEEEEEEEEEEEEEEBBBBBBBBBBBBBBBBB IIIIIIIIIIKKKKKKKKK KKKKKKK
Back to top