amp.spark.ru
robots.txt

Robots Exclusion Standard data for amp.spark.ru

Resource Scan

Scan Details

Site Domain amp.spark.ru
Base Domain spark.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-07-17T18:35:19+00:00
Next Scan 2024-10-15T18:35:19+00:00

Last Successful Scan

Scanned2024-02-26T04:32:39+00:00
URL https://amp.spark.ru/robots.txt
Domain IPs 89.108.82.87
Response IP 89.108.82.87
Found Yes
Hash 97f9a53a3402b24720742b3434d3eb2d868c7f28c7740b8c4a44815ce575e481
SimHash b814c5fa52bb

Groups

mj12bot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

*

Rule Path
Disallow /dontVisitMe/
Disallow /admin/
Disallow /ajax/
Disallow /search
Disallow /login
Disallow /logout
Disallow /pma
Disallow /*?*c=
Disallow /*?*promo=
Disallow /services
Disallow *%3A3000
Disallow /auth
Disallow /rules
Disallow /talk/
Disallow /user/settings
Disallow /write
Disallow /startup/*/blog$
Disallow /startup/*/wall
Disallow /user/*/comments
Disallow /user/*/blogs
Disallow /feedback/$
Disallow /feedback/new/
Disallow /feedback/popular-daily/
Disallow /feedback/popular-monthly/
Disallow /feedback/popular-weekly/
Disallow /feedback/popular/
Disallow /feedback/hot/
Disallow /feedback/best/

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://amp.spark.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.