center.lv
robots.txt

Robots Exclusion Standard data for center.lv

Resource Scan

Scan Details

Site Domain center.lv
Base Domain center.lv
Scan Status Ok
Last Scan2026-01-28T02:25:36+00:00
Next Scan 2026-02-27T02:25:36+00:00

Last Scan

Scanned2026-01-28T02:25:36+00:00
URL https://center.lv/robots.txt
Domain IPs 195.201.96.245
Response IP 195.201.96.245
Found Yes
Hash 888bf7bd337016059b5f71259d846904f5423ca8feb3f5c729ed73ce00d7a256
SimHash 0a528d42d2a2

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /.*
Disallow /*/.*
Disallow /admin*
Disallow /backup*
Disallow /bitcoin*
Disallow /cart*
Disallow /cgi*
Disallow /install*
Disallow /login*
Disallow /new*
Disallow /old*
Disallow /phpnuke*
Disallow /phpunit*
Disallow /public*
Disallow /semalt*
Disallow /vendor*
Disallow /wordpress*
Disallow /wp-*
Disallow /xmlrpc*
Disallow /*/wp-includes/
Disallow /*.7z$
Disallow /*.7z?*
Disallow /*.asp$
Disallow /*.asp?*
Disallow /*.aspx$
Disallow /*.aspx?*
Disallow /*.exe$
Disallow /*.exe?*
Disallow /*.gz$
Disallow /*.gz?*
Disallow /*.log$
Disallow /*.log?*
Disallow /*.rar$
Disallow /*.rar?*
Disallow /*.sql$
Disallow /*.sql?*
Disallow /*.zip$
Disallow /*.zip?*
Disallow /en/order/
Disallow /lv/grozs/
Disallow /ru/zakaz/

Other Records

Field Value
crawl-delay 200

Other Records

Field Value
sitemap https://center.lv/sitemap.txt