купитьметалл.рф
robots.txt

Robots Exclusion Standard data for купитьметалл.рф

Resource Scan

Scan Details

Site Domain купитьметалл.рф
Base Domain купитьметалл.рф
Scan Status Ok
Last Scan2025-10-24T10:43:13+00:00
Next Scan 2025-11-23T10:43:13+00:00

Last Scan

Scanned2025-10-24T10:43:13+00:00
URL https://купитьметалл.рф/robots.txt
Redirect https://xn--80ajihiadw2acf5i.xn--p1ai/robots.txt
Domain IPs 77.222.40.14
Response IP 77.222.40.14
Found Yes
Hash cb2b6a57e7d279be38310ce3e0be9eda83ef82b5e47be07a2f628f08fdf9f601
SimHash cf5114562dbb

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /cart
Disallow /orders
Disallow /delivery
Disallow /%D0%B4%D0%BE%D1%81%D1%82%D0%B0%D0%B2%D0%BA%D0%B0
Disallow /pricelist
Disallow /search
Disallow /helpers
Disallow /models
Disallow /public
Disallow /views
Disallow /config.php

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://xn--80ajihiadw2acf5i.xn--p1ai/sitemap.xml

Warnings

  • `host` is not a known field.