kerch.news
robots.txt

Robots Exclusion Standard data for kerch.news

Resource Scan

Scan Details

Site Domain kerch.news
Base Domain kerch.news
Scan Status Ok
Last Scan2024-05-31T00:32:14+00:00
Next Scan 2024-06-30T00:32:14+00:00

Last Scan

Scanned2024-05-31T00:32:14+00:00
URL https://kerch.news/robots.txt
Redirect https://kerch.fm/robots.txt
Redirect Domain kerch.fm
Redirect Base kerch.fm
Domain IPs 109.200.132.113
Redirect IPs 104.21.37.64, 172.67.205.12, 2606:4700:3032::6815:2540, 2606:4700:3036::ac43:cd0c
Response IP 104.21.37.64
Found Yes
Hash e7c0a40ef00ef90278067f13d1f9743a95521d38cdb8c520947391b8253899e8
SimHash dd09b4718591

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*do%3Ddownload
Disallow /*do%3Dgo
Disallow /engine/
Disallow /language/
Disallow /templates/

twitterbot

Rule Path
Allow /uploads/posts

Other Records

Field Value
sitemap https://kerch.fm/sitemap.xml

Warnings

  • `host` is not a known field.