shop-id.tokopedia.com
robots.txt

Robots Exclusion Standard data for shop-id.tokopedia.com

Resource Scan

Scan Details

Site Domain shop-id.tokopedia.com
Base Domain tokopedia.com
Scan Status Ok
Last Scan2025-03-09T07:23:44+00:00
Next Scan 2025-03-16T07:23:44+00:00

Last Scan

Scanned2025-03-09T07:23:44+00:00
URL https://shop-id.tokopedia.com/robots.txt
Domain IPs 23.210.250.98, 23.210.250.99
Response IP 23.59.80.107
Found Yes
Hash ba26a7348e9981c2da75810cb5cabb0b4c9e5b997440d7e3a1c95f593e458157
SimHash 89645d754790

Groups

baiduspider
sogouspider
yisouspider

Rule Path
Disallow /

*

Rule Path
Allow /business/
Allow /merchant/
Allow /merchantPlatform/
Allow /view/
Allow /steamer

Other Records

Field Value
sitemap https://www.shop.tiktok.com/creator-affiliate-sitemap.xml

Warnings

  • 1 invalid line.