shopme.uz
robots.txt

Robots Exclusion Standard data for shopme.uz

Resource Scan

Scan Details

Site Domain shopme.uz
Base Domain shopme.uz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-06-15T17:27:31+00:00
Next Scan 2024-09-13T17:27:31+00:00

Last Successful Scan

Scanned2024-01-25T17:26:14+00:00
URL https://shopme.uz/robots.txt
Domain IPs 31.31.196.216
Response IP 31.31.196.216
Found Yes
Hash b43bc52b072512d1fdb5ce586f3af6e321a20c9dc702a6dc80920b3d1b6e19f8
SimHash 15928805c5b7

Groups

*

Rule Path
Disallow /auth*
Disallow /basket*
Disallow /order*
Disallow /personal/
Disallow /search/
Disallow /test/
Disallow /ajax/
Disallow *index.php*
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /bitrix/admin/
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER_BY
Disallow /*print*
Disallow /*action*
Disallow /*register%3D
Disallow /*password*
Disallow /*login%3D
Disallow /*type%3D
Disallow /*sort%3D
Disallow /*order%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow *?arrFilter*

Other Records

Field Value
crawl-delay 20

Warnings

  • `host` is not a known field.