nyasamegabiz.co.za
robots.txt

Robots Exclusion Standard data for nyasamegabiz.co.za

Resource Scan

Scan Details

Site Domain nyasamegabiz.co.za
Base Domain nyasamegabiz.co.za
Scan Status Ok
Last Scan2025-04-07T17:06:35+00:00
Next Scan 2025-05-07T17:06:35+00:00

Last Scan

Scanned2025-04-07T17:06:35+00:00
URL https://nyasamegabiz.co.za/robots.txt
Domain IPs 104.21.52.195, 172.67.203.57, 2606:4700:3032::6815:34c3, 2606:4700:3037::ac43:cb39
Response IP 104.21.52.195
Found Yes
Hash 196807c89c58b03af3016aa980ce202724f9f5f1d86515b327e83dd22a189d49
SimHash 5914d013e800

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /search/
Disallow /checkout/
Disallow /account/

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

midjourney

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

keybot translation-search-machine

Rule Path
Disallow /

okhttp/3.9.1

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nyasamegabiz.co.za/sitemap.xml