test.betika.com
robots.txt

Robots Exclusion Standard data for test.betika.com

Resource Scan

Scan Details

Site Domain test.betika.com
Base Domain betika.com
Scan Status Ok
Last Scan2025-11-23T06:37:07+00:00
Next Scan 2025-12-07T06:37:07+00:00

Last Scan

Scanned2025-11-23T06:37:07+00:00
URL https://test.betika.com/robots.txt
Domain IPs 162.159.128.86, 162.159.129.86
Response IP 162.159.128.86
Found Yes
Hash baddce711f358569475bf07613f47047c5ab7cf83e49414d0344484c9543903c
SimHash 602e8e33c381

Groups

facebookexternalhit

Rule Path
Disallow

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /
Disallow /*?sport_id=*
Disallow /lite/*.html?
Disallow /sports/threeway?
Disallow /lite/.well-known/
Disallow /lite/?page=
Disallow /lite/?sub_type_id=
Disallow /share/*

Other Records

Field Value
sitemap https://betika.com/sitemap-en-ke.xml
sitemap https://betika.com/sitemap-en-gh.xml
sitemap https://betika.com/sitemap-fr-cd.xml

Comments

  • www.robotstxt.org/
  • Allow Facebook's scraper access to the website
  • Allow Twitterbot to access the entire site
  • Allow crawling of all content