skykiwi.com
robots.txt

Robots Exclusion Standard data for skykiwi.com

Resource Scan

Scan Details

Site Domain skykiwi.com
Base Domain skykiwi.com
Scan Status Ok
Last Scan2025-09-01T15:46:05+00:00
Next Scan 2025-09-08T15:46:05+00:00

Last Scan

Scanned2025-09-01T15:46:05+00:00
URL https://skykiwi.com/robots.txt
Redirect https://www.skykiwi.com/robots.txt
Redirect Domain www.skykiwi.com
Redirect Base skykiwi.com
Domain IPs 47.84.176.250
Redirect IPs 47.84.176.250
Response IP 47.84.176.250
Found Yes
Hash 96c215c921b309d6ea348846096809291ac9e4570d2ddcba10844fea1245f919
SimHash 6008417574e4

Groups

googlebot

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

bingbot

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

msnbot

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

slurp

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

yahoo-newscrawler

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

aasa-bot

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

apple-bot

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

googlebot-news

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

echoboxbot/1.0

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

grapeshot

Rule Path
Allow /
Allow /news/*
Allow /news/na/*
Allow /news/world/*
Allow /money/*
Allow /info/*

Other Records

Field Value
sitemap https://www.skykiwi.com/sitemap.xml

Comments

  • robots.txt for https://www.skykiwi.com/
  • Good Bots allowed