Log In Sign Up

techfeed.net
robots.txt

Robots Exclusion Standard data for techfeed.net

Resource Scan

Scan Details

Site Domain techfeed.net
Base Domain techfeed.net
Scan Status Ok
Last Scan2024-09-28T18:20:53+00:00
Next Scan 2024-10-05T18:20:53+00:00

Last Scan

Scanned2024-09-28T18:20:53+00:00
URL https://techfeed.net/robots.txt
Domain IPs 104.21.62.248, 172.67.141.57, 2606:4700:3030::ac43:8d39, 2606:4700:3031::6815:3ef8
Response IP 172.67.141.57
Found Yes
Hash 0697f6f3855bbe3dbbd0eeb2bfee480e7f36ae34de18022d8df1def5f7edc50a
SimHash ad6d16429450

Groups

semrushbot
semrushbot-sa
mj12bot
dotbot
rogerbot
megaindex.ru
megaindex.com
megaindex.ru/2.0
alexibot
surveybot
backlinkcrawler
sistrix crawler
sistrix
sistrix
uptimerobot/2.0

Product Comment
semrushbot Semrush
semrushbot-sa Semrush technical
mj12bot Majestic
dotbot Moz
rogerbot Moz
megaindex.ru https://megaindex.com/crawler
megaindex.com https://megaindex.com/crawler
megaindex.ru/2.0 MegaIndex.ru
alexibot Alexa
surveybot Surveybot.io
backlinkcrawler http://www.backlinktest.com
sistrix crawler Block SISTRIX
sistrix Block SISTRIX
sistrix Block SISTRIX
uptimerobot/2.0 Block Uptime robot
Rule Path
Disallow /

yandex

Product Comment
yandex Yandex
Rule Path Comment
Disallow -
Allow /*/*.js внутри /wp- (/*/ - для приоритета)
Allow /*/*.css внутри /wp- (/*/ - для приоритета)
Allow */*.png картинки в плагинах, cache папке и т.д.
Allow */*.jpeg картинки в плагинах, cache папке и т.д.
Back to top

Other Records

Field Value
sitemap https://techfeed.net/sitemap_index.xml
Back to top

Comments

  • Hi Senior SEO :)
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top