Log In Sign Up

kiwiblog.co.nz
robots.txt

Robots Exclusion Standard data for kiwiblog.co.nz

Resource Scan

Scan Details

Site Domain kiwiblog.co.nz
Base Domain kiwiblog.co.nz
Scan Status Ok
Last Scan2024-09-26T04:38:09+00:00
Next Scan 2024-10-03T04:38:09+00:00

Last Scan

Scanned2024-09-26T04:38:09+00:00
URL https://kiwiblog.co.nz/robots.txt
Redirect https://www.kiwiblog.co.nz/robots.txt
Redirect Domain www.kiwiblog.co.nz
Redirect Base kiwiblog.co.nz
Domain IPs 203.114.129.100
Redirect IPs 203.114.129.100
Response IP 203.114.129.100
Found Yes
Hash 334d818a7bf4c3810e1469d491d356c64deaf9af68f94587b88f04c4a7fc8a3d
SimHash b11cd502e828

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /
Back to top

Comments

  • <https://ahrefs.com/robot>
  • <https://developer.amazon.com/support/amazonbot>
  • <http://webmeup-crawler.com/>
  • <https://dataforseo.com/dataforseo-bot>
  • <https://moz.com/help/moz-procedures/crawlers/dotbot>
  • <https://www.determ.com/robot/>
  • <https://mj12bot.com/>
  • <https://webmaster.petalsearch.com/site/petalbot>
  • <https://www.semrush.com/bot/>
  • <https://www.trendiction.com/bot>
Back to top