boneshop.com
robots.txt

Robots Exclusion Standard data for boneshop.com

Resource Scan

Scan Details

Site Domain boneshop.com
Base Domain boneshop.com
Scan Status Ok
Last Scan2025-12-15T06:48:05+00:00
Next Scan 2026-01-14T06:48:05+00:00

Last Scan

Scanned2025-12-15T06:48:05+00:00
URL https://boneshop.com/robots.txt
Domain IPs 104.26.8.237, 104.26.9.237, 172.67.72.147, 2606:4700:20::681a:8ed, 2606:4700:20::681a:9ed, 2606:4700:20::ac43:4893
Response IP 104.26.8.237
Found Yes
Hash a8c45b625ad4558544b21ef41507464afc5c52a00676ad4dd60ee7962b62c816
SimHash d15c8d21de99

Groups

*

Rule Path
Allow /
Disallow */fpc/
Disallow */ajax/
Disallow */facebook/
Disallow */search/result/index/

ahrefsbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

crawl

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

buiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.boneshop.com/sitemap.xml
sitemap https://www.boneshop.com/tw/sitemap.xml
sitemap https://www.boneshop.com/us/sitemap.xml
sitemap https://www.boneshop.com/jp/sitemap.xml