avtomobil-nye-pravila-3.ru
robots.txt

Robots Exclusion Standard data for avtomobil-nye-pravila-3.ru

Resource Scan

Scan Details

Site Domain avtomobil-nye-pravila-3.ru
Base Domain avtomobil-nye-pravila-3.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-03-02T23:43:02+00:00
Next Scan 2025-05-01T23:43:02+00:00

Last Successful Scan

Scanned2024-12-10T23:19:42+00:00
URL https://www.avtomobil-nye-pravila-3.ru/robots.txt
Domain IPs 104.21.87.142, 172.67.169.226, 2606:4700:3032::6815:578e, 2606:4700:3037::ac43:a9e2
Response IP 104.21.87.142
Found Yes
Hash 99072dd6aef1dc61df7e71c779bd20fe199d250c4087d276443111d6ef26baf9
SimHash 1a0c0ce3cd93

Groups

*

Rule Path
Allow /uploads
Allow /*.js
Allow /*.css
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.gif
Allow /*.svg
Allow /*.webp
Allow /*.swf
Allow /*.pdf
Disallow /textolite/

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.avtomobil-nye-pravila-3.ru/sitemap.xml

Warnings

  • `host` is not a known field.