rasprodaga.ru
robots.txt

Robots Exclusion Standard data for rasprodaga.ru

Resource Scan

Scan Details

Site Domain rasprodaga.ru
Base Domain rasprodaga.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-22T21:25:53+00:00
Next Scan 2024-10-21T21:25:53+00:00

Last Successful Scan

Scanned2024-06-24T21:23:04+00:00
URL https://rasprodaga.ru/robots.txt
Domain IPs 185.71.67.26
Response IP 185.71.67.26
Found Yes
Hash b8176629fdc2c3ecc682974d70e05f47cf12f547cbf7a8781ac859d2373bf16e
SimHash 6154c66af933

Groups

yandex

Rule Path
Disallow /api*
Disallow */search/*
Disallow */sphinx/*
Disallow */promokody/*
Disallow */arhive/*
Disallow */discounts/*
Disallow */brand/*
Disallow */collections-catalog/*
Disallow */company/archive/*
Disallow */view_shop/*
Disallow */catalog_item*
Disallow */reviews/*
Disallow */letter/*
Disallow /*.html
Disallow /change-city/*
Disallow /goto/*
Disallow */privacy-policy/
Disallow */promo/*
Disallow *?*
Allow *?page=*
Allow */js/*.js*
Allow */css/*.css*

*

Rule Path
Disallow /api*
Disallow */search/*
Disallow */sphinx/*
Disallow */promokody/*
Disallow */arhive/*
Disallow */discounts/*
Disallow */brand/*
Disallow */collections-catalog/*
Disallow */company/archive/*
Disallow */view_shop/*
Disallow */catalog_item*
Disallow */reviews/*
Disallow */letter/*
Disallow /*.html
Disallow /change-city/*
Disallow /goto/*
Disallow */privacy-policy/
Disallow */promo/*
Disallow *?*
Allow *?page=*
Allow */js/*.js*
Allow */css/*.css*

Other Records

Field Value
sitemap https://rasprodaga.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.