majestic-server.ru
robots.txt

Robots Exclusion Standard data for majestic-server.ru

Resource Scan

Scan Details

Site Domain majestic-server.ru
Base Domain majestic-server.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-01T21:36:36+00:00
Next Scan 2024-05-30T21:36:36+00:00

Last Successful Scan

Scanned2023-07-13T20:35:14+00:00
URL https://majestic-server.ru/robots.txt
Domain IPs 104.21.25.26, 172.67.222.12, 2606:4700:3033::6815:191a, 2606:4700:3033::ac43:de0c
Response IP 172.67.222.12
Found Yes
Hash 9b8e8bbd15daafdbe9e403fd6fc459d1fafc5f100f6e2b26d49052303fb057d7
SimHash 67089cd7c391

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://majestic-server.ru/sitemap.xml

Warnings

  • `host` is not a known field.