supplementworld.co.za
robots.txt

Robots Exclusion Standard data for supplementworld.co.za

Resource Scan

Scan Details

Site Domain supplementworld.co.za
Base Domain supplementworld.co.za
Scan Status Ok
Last Scan2026-01-28T03:14:23+00:00
Next Scan 2026-02-27T03:14:23+00:00

Last Scan

Scanned2026-01-28T03:14:23+00:00
URL https://supplementworld.co.za/robots.txt
Redirect https://www.supplementworld.co.za/robots.txt
Redirect Domain www.supplementworld.co.za
Redirect Base supplementworld.co.za
Domain IPs 154.65.98.149
Redirect IPs 154.65.98.149
Response IP 154.65.98.149
Found Yes
Hash 8076a81cbf80fef49a613b16c7e7638b0f00b7b0ab3999ed225ec28a7ea11de2
SimHash 2875d2d0c510

Groups

ahrefsbot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

teoma

Rule Path
Disallow

msnbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

slurp

Rule Path
Disallow

abachobot

Rule Path
Disallow

kit-fireball

Rule Path
Disallow

voilabot

Rule Path
Disallow

yandex

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.supplementworld.co.za/sitemap.xml

Comments

  • ahrefs
  • Alexa
  • Ask
  • Bing
  • Google
  • Yahoo!
  • Abacho
  • Fireball
  • Voila.fr
  • Yandex
  • Others