cobait.com
robots.txt

Robots Exclusion Standard data for cobait.com

Resource Scan

Scan Details

Site Domain cobait.com
Base Domain cobait.com
Scan Status Ok
Last Scan2025-11-03T10:48:59+00:00
Next Scan 2025-12-03T10:48:59+00:00

Last Scan

Scanned2025-11-03T10:48:59+00:00
URL https://cobait.com/robots.txt
Domain IPs 192.124.249.11
Response IP 192.124.249.11
Found Yes
Hash dad1e6506ddc1894e1be97e6bbc9a34c10800c8a9aaec5e1e7252791b82d26da
SimHash 7ab6f8d4841b

Groups

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Disallow /wp-json/
Disallow /?rest_route=
Disallow /buy.php?*
Disallow /*/amp
Disallow /*/amp/
Disallow /*?amp=1
Disallow /*?amp=1%2F
Disallow /*?amp
Disallow /*?amp%2F

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cobait.com/sitemap_index.xml
sitemap https://cobait.com/sitemap_video2.xml
sitemap https://cobait.com/news-sitemap.xml

Comments

  • Block AMP pages
  • Block specific bots
  • Verified sitemaps (cobait.com domain)