Log In Sign Up

fark.ru
robots.txt

Robots Exclusion Standard data for fark.ru

Resource Scan

Scan Details

Site Domain fark.ru
Base Domain fark.ru
Scan Status Ok
Last Scan2024-11-06T22:45:20+00:00
Next Scan 2024-11-13T22:45:20+00:00

Last Scan

Scanned2024-11-06T22:45:20+00:00
URL https://fark.ru/robots.txt
Redirect http://www.fark.ru/robots.txt
Redirect Domain www.fark.ru
Redirect Base fark.ru
Domain IPs 104.21.8.43, 172.67.156.207, 2606:4700:3031::ac43:9ccf, 2606:4700:3037::6815:82b
Redirect IPs 104.21.8.43, 172.67.156.207, 2606:4700:3031::ac43:9ccf, 2606:4700:3037::6815:82b
Response IP 104.21.8.43
Found Yes
Hash 9b6939622cfe3ea9a9a2cd54a9e52e62bb16d9563654328b10b0481ca4b224a8
SimHash 5d409a624531

Groups

yandex

Rule Path
Disallow /cache/static_fragment/
Disallow /*area%3D
Disallow /*.html?add
Disallow *.jpeg
Disallow *.jpg
Disallow *.gif
Disallow *.png

*

Rule Path
Disallow /cache/static_fragment/
Disallow /*area%3D
Disallow /*.html?add
Back to top

Other Records

Field Value
sitemap http://www.fark.ru/sitemaps/sitemap_index.xml
Back to top

Warnings

  • 2 invalid lines.
  • `host` is not a known field.
Back to top