1barter.ru
robots.txt

Robots Exclusion Standard data for 1barter.ru

Resource Scan

Scan Details

Site Domain 1barter.ru
Base Domain 1barter.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-02-28T21:40:40+00:00
Next Scan 2026-05-29T21:40:40+00:00

Last Successful Scan

Scanned2025-03-21T23:46:28+00:00
URL https://1barter.ru/robots.txt
Domain IPs 104.21.89.112, 172.67.140.249, 2606:4700:3030::ac43:8cf9, 2606:4700:3034::6815:5970
Response IP 172.67.140.249
Found Yes
Hash 62201cdb231fbe5b028e0c686465ad584a2af1c6debc5aa20c24cf6b4f6f81af
SimHash 65409c4245b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://1barter.ru/sitemap.xml

Warnings

  • `host` is not a known field.