myquotes.co
robots.txt

Robots Exclusion Standard data for myquotes.co

Resource Scan

Scan Details

Site Domain myquotes.co
Base Domain myquotes.co
Scan Status Ok
Last Scan2024-09-29T02:41:38+00:00
Next Scan 2024-10-06T02:41:38+00:00

Last Scan

Scanned2024-09-29T02:41:38+00:00
URL https://myquotes.co/robots.txt
Domain IPs 104.21.39.246, 172.67.172.45, 2606:4700:3035::6815:27f6, 2606:4700:3037::ac43:ac2d
Response IP 104.21.39.246
Found Yes
Hash 102f239b3c091c9552497ffcd8a1595265f26d21ebb9e8d3a833c07d093355b0
SimHash 296816423450

Groups

semrushbot
semrushbot-sa
mj12bot
dotbot
rogerbot
megaindex.ru
megaindex.com
megaindex.ru/2.0
alexibot
surveybot
backlinkcrawler
sistrix crawler
sistrix
sistrix
uptimerobot/2.0

Product Comment
semrushbot Semrush
semrushbot-sa Semrush technical
mj12bot Majestic
dotbot Moz
rogerbot Moz
megaindex.ru https://megaindex.com/crawler
megaindex.com https://megaindex.com/crawler
megaindex.ru/2.0 MegaIndex.ru
alexibot Alexa
surveybot Surveybot.io
backlinkcrawler http://www.backlinktest.com
sistrix crawler Block SISTRIX
sistrix Block SISTRIX
sistrix Block SISTRIX
uptimerobot/2.0 Block Uptime robot
Rule Path
Disallow /

*

Rule Path Comment
Disallow */*?page=* -
Disallow */*?filter=* -
Allow /*/*.js внутри /wp- (/*/ - для приоритета)
Allow /*/*.css внутри /wp- (/*/ - для приоритета)
Allow */*.png картинки в плагинах, cache папке и т.д.
Allow */*.jpeg картинки в плагинах, cache папке и т.д.

Other Records

Field Value
sitemap https://myquotes.co/sitemap_index.xml

Comments

  • Hi Senior SEO :)

Warnings

  • `host` is not a known field.