shopcounter.jp
robots.txt

Robots Exclusion Standard data for shopcounter.jp

Resource Scan

Scan Details

Site Domain shopcounter.jp
Base Domain shopcounter.jp
Scan Status Ok
Last Scan2025-03-06T20:23:22+00:00
Next Scan 2025-03-13T20:23:22+00:00

Last Scan

Scanned2025-03-06T20:23:22+00:00
URL https://shopcounter.jp/robots.txt
Domain IPs 104.26.0.247, 104.26.1.247, 172.67.71.121, 2606:4700:20::681a:1f7, 2606:4700:20::681a:f7, 2606:4700:20::ac43:4779
Response IP 104.26.1.247
Found Yes
Hash 3573caab12d9c796fd85c1832a05995e652bbf0cebdd15917c892c0ad2575dc7
SimHash 450ec6528535

Groups

*

Rule Path
Disallow /accounts/*
Disallow /owner/*
Disallow /tenant/*
Disallow /oauth/*
Disallow /spaces/*/share*
Disallow /amp/space/*
Disallow /images/*
Disallow /floorplans/*
Disallow /layout_diagram/*
Disallow /magazine/*/*/attachment/*
Disallow /magazine/author
Disallow /magazine/uncategorized
Disallow /magazine/?s=
Disallow /magazine/*/feed
Disallow /magazine/*/embed?
Disallow /forms/

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

baiduspider+

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1