shop.catesauction.com
robots.txt

Robots Exclusion Standard data for shop.catesauction.com

Resource Scan

Scan Details

Site Domain shop.catesauction.com
Base Domain catesauction.com
Scan Status Ok
Last Scan2026-02-05T23:51:07+00:00
Next Scan 2026-03-07T23:51:07+00:00

Last Scan

Scanned2026-02-05T23:51:07+00:00
URL https://shop.catesauction.com/robots.txt
Domain IPs 100.51.133.234, 34.202.150.184, 34.207.12.181
Response IP 34.202.150.184
Found Yes
Hash e720f142e182072bf2c33c03d86b65465c161162ba01c74787076c3b21310a6f
SimHash 615458604e1f

Groups

*

Rule Path
Disallow /my-bidsquare
Disallow /my-account
Disallow /admin
Disallow /seller
Disallow /user
Disallow /search
Disallow /*?*category=
Disallow /category/*?*page=
Disallow /*?*search=
Disallow /*?*filters=
Disallow /*?*sort=
Disallow /*?*default=
Disallow /user/register/*
Disallow /user/register?*
Disallow /register/*
Disallow /register?*
Disallow /*?*is_ajax=
Allow /user/register

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shop.catesauction.com/sitemap.xml