mustfit.ru
robots.txt

Robots Exclusion Standard data for mustfit.ru

Resource Scan

Scan Details

Site Domain mustfit.ru
Base Domain mustfit.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-20T09:12:29+00:00
Next Scan 2024-11-19T09:12:29+00:00

Last Successful Scan

Scanned2024-08-29T09:06:19+00:00
URL https://mustfit.ru/robots.txt
Domain IPs 45.86.183.191
Response IP 45.86.183.191
Found Yes
Hash ef57ec095efbfec0b525e37fb705e73216d6a8197aee35216b4a9a665ec1a4b9
SimHash 6558dcc0c1b5

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60