shipomarket.com
robots.txt

Robots Exclusion Standard data for shipomarket.com

Resource Scan

Scan Details

Site Domain shipomarket.com
Base Domain shipomarket.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-02-03T03:53:16+00:00
Next Scan 2026-03-05T03:53:16+00:00

Last Successful Scan

Scanned2025-12-13T03:48:51+00:00
URL https://shipomarket.com/robots.txt
Domain IPs 87.236.210.66
Response IP 87.236.210.66
Found Yes
Hash c5b8180db75375f2e876a1d9f5f85a885ca8b5ad5234b55c951703e462acdd6c
SimHash 231bc9506775

Groups

*

Rule Path
Allow /
Disallow /plugins/
Disallow /libs/
Disallow /includes/
Disallow /print*
Disallow /*?sort_by=
Disallow /*%26sort_by%3D
Disallow /*?sort_type=
Disallow /*%26sort_type%3D

Other Records

Field Value
crawl-delay 20

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Comments

  • robots.txt