plainnews.ru
robots.txt

Robots Exclusion Standard data for plainnews.ru

Resource Scan

Scan Details

Site Domain plainnews.ru
Base Domain plainnews.ru
Scan Status Ok
Last Scan2024-06-30T03:35:10+00:00
Next Scan 2024-07-30T03:35:10+00:00

Last Scan

Scanned2024-06-30T03:35:10+00:00
URL https://plainnews.ru/robots.txt
Domain IPs 188.120.244.147
Response IP 188.120.244.147
Found Yes
Hash 849563681730ca444587565f04bcf126fd1ada51fd000505663b4baabfaa96ad
SimHash 390c8a52ce1a

Groups

*

Rule Path
Allow /
Disallow /user/*
Disallow /*?*

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

ntentbot-fetch

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

eracrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Warnings

  • `host` is not a known field.