shiro-shiro.jp
robots.txt

Robots Exclusion Standard data for shiro-shiro.jp

Resource Scan

Scan Details

Site Domain shiro-shiro.jp
Base Domain shiro-shiro.jp
Scan Status Ok
Last Scan2024-10-11T00:11:15+00:00
Next Scan 2024-11-10T00:11:15+00:00

Last Scan

Scanned2024-10-11T00:11:15+00:00
URL https://shiro-shiro.jp/robots.txt
Domain IPs 13.226.61.116, 13.226.61.120, 13.226.61.128, 13.226.61.19
Response IP 13.35.238.54
Found Yes
Hash 3fb647183d43d2d17f8d9336b4fa9b53ee340ebfa8684e94da7876c94393cdc1
SimHash 6e577c5585c2

Groups

*

Rule Path
Disallow /admin.html
Disallow /apply.html
Disallow /ajax_check_item_itemproperty_zaiko.html
Disallow /ajax_get_cart_info.html
Disallow /item_download.html
Disallow /item_download_real.html
Disallow /category/801/
Disallow /wishlist.html
Disallow /member_history.html
Disallow /member_mypage.html
Disallow /address_list.html
Disallow /cart_index.html
Disallow /cart_login.html
Disallow /item_nyuka_notice.html
Disallow /*.pdf$
Disallow /*?condition=
Disallow /*?item_list_mode=
Disallow /*?next_page=
Disallow /*?pointercat=
Disallow /*?redirectTo=
Disallow /*?request=
Disallow /*?SEARCH_MAX_ROW_LIST=
Disallow /*?sort_order=
Disallow /*?INFO_CATEGORY_ID=
Disallow /*?info_category_param=
Disallow /*?amp=

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yetbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://shiro-shiro.jp/ext/sitemap.xml