Log In Sign Up

3second.co.id
robots.txt

Robots Exclusion Standard data for 3second.co.id

Resource Scan

Scan Details

Site Domain 3second.co.id
Base Domain 3second.co.id
Scan Status Ok
Last Scan2024-10-08T03:01:26+00:00
Next Scan 2024-10-22T03:01:26+00:00

Last Scan

Scanned2024-10-08T03:01:26+00:00
URL https://3second.co.id/robots.txt
Domain IPs 139.59.192.19
Response IP 139.59.192.19
Found Yes
Hash c39f0635311e9250ae01acba72396a4e2a12b5ce3e89ae5797eebc13340e5de4
SimHash 5f545150fc22

Groups

*

Rule Path
Disallow /api/
Disallow /search?

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

attentio

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cloudfind

Rule Path
Disallow /

cloudfind/1.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

botify

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

siteimprovebot

Rule Path
Disallow /

siteimprovebot-crawler

Rule Path
Disallow /

cxense

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

marketgoo

Rule Path
Disallow /

prerender

Rule Path
Disallow /

addthis

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /
Allow /
Disallow /account/*
Disallow /cart
Disallow /wishlist
Disallow /checkout
Back to top

Other Records

Field Value
sitemap https://3second.co.id/sitemap.xml
Back to top

Comments

  • *
  • ChatGPT-User
  • GPTBot
  • Google-Extended
  • AhrefsBot
  • Attentio
  • Barkrowler
  • BLEXBot
  • Cloudfind
  • Cloudfind/1.0
  • dotbot
  • ltx71
  • MegaIndex
  • MegaIndex.ru
  • MauiBot
  • MJ12bot
  • SemrushBot
  • botify
  • DataForSeoBot
  • SiteAuditBot
  • SiteimproveBot
  • SiteimproveBot-Crawler
  • Cxense
  • rogerbot
  • MarketGoo
  • prerender
  • AddThis
  • SeekportBot
  • AwarioRssBot
  • AwarioSmartBot
  • SemrushBot-BA
  • SemrushBot-SI
  • SemrushBot-SWA
  • SemrushBot-CT
  • SemrushBot-SI
  • SplitSignalBot
  • SemrushBot-COUB
  • ClaudeBot
  • coccocbot-image
Back to top