mbaktotolink.com
robots.txt

Robots Exclusion Standard data for mbaktotolink.com

Resource Scan

Scan Details

Site Domain mbaktotolink.com
Base Domain mbaktotolink.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/23/2025, 4:37:20 AM
Next Scan 6/6/2025, 4:37:20 AM

Last Successful Scan

Scanned4/15/2025, 4:30:25 AM
URL https://mbaktotolink.com/robots.txt
Domain IPs 104.21.58.206, 172.67.164.169, 2606:4700:3036::6815:3ace, 2606:4700:3037::ac43:a4a9
Response IP 104.21.58.206
Found Yes
Hash e1d883b5c6fcd07f2821303971588d24ad3b3d20a983c8e098f2b43c895cea4a
SimHash 48549e22d5a3

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

yandex

Rule Path
Allow /

baiduspider

Rule Path
Allow /

facebot

Rule Path
Allow /

applebot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mbaktotolink.com/sitemap.xml

Comments

  • Blokir bot SEO dan scraper