novaya.media
robots.txt

Robots Exclusion Standard data for novaya.media

Resource Scan

Scan Details

Site Domain novaya.media
Base Domain novaya.media
Scan Status Ok
Last Scan2024-11-14T03:58:04+00:00
Next Scan 2024-11-21T03:58:04+00:00

Last Scan

Scanned2024-11-14T03:58:04+00:00
URL https://novaya.media/robots.txt
Domain IPs 104.21.56.8, 172.67.175.34, 2606:4700:3031::6815:3808, 2606:4700:3032::ac43:af22
Response IP 172.67.175.34
Found Yes
Hash 3cad60dd2113204f00195ac5fba890f668351da78fd91a26211c6d4782eee5a6
SimHash c8145410a133

Groups

*

Rule Path
Disallow /api/
Disallow /hyper/
Disallow /preview/

twitterbot

Rule Path
Disallow

yandex

Rule Path
Disallow /api/
Disallow /hyper/
Disallow /preview/

Other Records

Field Value
sitemap https://novaya.media/feed/sitemap

Warnings

  • `clean-param` is not a known field.