live.clarsla.com
robots.txt

Robots Exclusion Standard data for live.clarsla.com

Resource Scan

Scan Details

Site Domain live.clarsla.com
Base Domain clarsla.com
Scan Status Ok
Last Scan2026-02-12T17:18:51+00:00
Next Scan 2026-03-14T17:18:51+00:00

Last Scan

Scanned2026-02-12T17:18:51+00:00
URL https://live.clarsla.com/robots.txt
Domain IPs 34.202.150.184, 34.207.12.181, 35.172.81.118
Response IP 34.207.12.181
Found Yes
Hash cd3963e06b4a6e3713703fa23eab8c9b5da66dc450d3c0ad9751693aa017c855
SimHash 611418604b1f

Groups

*

Rule Path
Disallow /my-bidsquare
Disallow /my-account
Disallow /admin
Disallow /seller
Disallow /user
Disallow /search
Disallow /*?*category=
Disallow /category/*?*page=
Disallow /*?*search=
Disallow /*?*filters=
Disallow /*?*sort=
Disallow /*?*default=
Disallow /user/register/*
Disallow /user/register?*
Disallow /register/*
Disallow /register?*
Disallow /*?*is_ajax=
Allow /user/register

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://live.clarsla.com/sitemap.xml