jbalwikobra.com
robots.txt

Robots Exclusion Standard data for jbalwikobra.com

Resource Scan

Scan Details

Site Domain jbalwikobra.com
Base Domain jbalwikobra.com
Scan Status Ok
Last Scan2026-02-07T01:29:49+00:00
Next Scan 2026-02-21T01:29:49+00:00

Last Scan

Scanned2026-02-07T01:29:49+00:00
URL https://jbalwikobra.com/robots.txt
Redirect https://www.jbalwikobra.com/robots.txt
Redirect Domain www.jbalwikobra.com
Redirect Base jbalwikobra.com
Domain IPs 216.198.79.1
Redirect IPs 216.198.79.1, 64.29.17.1
Response IP 64.29.17.1
Found Yes
Hash e4b389cef9d869c0fa886dacd6cecf9490ec411ff54c7e120de386ee0faa2b51
SimHash 4519ce10e69d

Groups

googlebot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/
Disallow /settings/
Disallow /checkout/
Disallow /payment/
Disallow /order-history/
Disallow /_next/
Disallow /static/js/*.map

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/
Disallow /settings/
Disallow /checkout/
Disallow /payment/
Disallow /order-history/
Disallow /_next/

Other Records

Field Value
crawl-delay 2

slurp

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/
Disallow /settings/
Disallow /checkout/

Other Records

Field Value
crawl-delay 2

duckduckbot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/
Disallow /settings/

baiduspider

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/

Other Records

Field Value
crawl-delay 3

yandexbot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/

Other Records

Field Value
crawl-delay 2

gptbot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/
Disallow /checkout/

chatgpt-user

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/

claude-web

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/

anthropic-ai

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/

perplexitybot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /profile/
Disallow /settings/
Disallow /checkout/
Disallow /payment/
Disallow /order-history/
Disallow /notifications/
Disallow /wishlist/
Disallow /_next/
Disallow /static/js/*.map
Disallow /*.json$
Disallow /auth/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://jbalwikobra.com/sitemap.xml

Comments

  • robots.txt for https://jbalwikobra.com
  • Generated dynamically for optimal SEO
  • Allow all major search engine bots
  • AI Crawlers - Allow for AI training/indexing
  • Block malicious/unwanted bots
  • Default rule for all other bots
  • Sitemap location
  • Host directive (for Yandex)

Warnings

  • `host` is not a known field.