b2b-postavki.ru
robots.txt

Robots Exclusion Standard data for b2b-postavki.ru

Resource Scan

Scan Details

Site Domain b2b-postavki.ru
Base Domain b2b-postavki.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-03T08:09:56+00:00
Next Scan 2025-05-04T08:09:56+00:00

Last Successful Scan

Scanned2024-09-14T08:08:18+00:00
URL https://b2b-postavki.ru/robots.txt
Domain IPs 104.21.75.48, 172.67.213.196, 2606:4700:3030::ac43:d5c4, 2606:4700:3036::6815:4b30
Response IP 172.67.213.196
Found Yes
Hash 2ebd13268506a31da8d8540e9848351e404022223c619c446c85f7db0ec2946d
SimHash 9b08dd62fa00

Groups

*

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /