Log In Sign Up

74-news.ru
robots.txt

Robots Exclusion Standard data for 74-news.ru

Resource Scan

Scan Details

Site Domain 74-news.ru
Base Domain 74-news.ru
Scan Status Ok
Last Scan4/4/2025, 4:49:05 AM
Next Scan 5/4/2025, 4:49:05 AM

Last Scan

Scanned4/4/2025, 4:49:05 AM
URL https://74-news.ru/robots.txt
Domain IPs 104.21.54.94, 172.67.137.186, 2606:4700:3031::6815:365e, 2606:4700:3035::ac43:89ba
Response IP 104.21.54.94
Found Yes
Hash e4859730f54634f5dd8c3d347cca76e1a89542fe2e0a294963690841be7e39d9
SimHash 6700dc53c3b0

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5
Back to top

Other Records

Field Value
sitemap https://74-news.ru/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top