nairobiwire.com
robots.txt

Robots Exclusion Standard data for nairobiwire.com

Resource Scan

Scan Details

Site Domain nairobiwire.com
Base Domain nairobiwire.com
Scan Status Ok
Last Scan2026-01-17T04:10:40+00:00
Next Scan 2026-01-24T04:10:40+00:00

Last Scan

Scanned2026-01-17T04:10:40+00:00
URL https://nairobiwire.com/robots.txt
Domain IPs 104.21.42.184, 172.67.207.126, 2606:4700:3034::ac43:cf7e, 2606:4700:3036::6815:2ab8
Response IP 104.21.42.184
Found Yes
Hash e98b9f4432c711700166e0ba92a09c033e8f56d3d858e3516c0b7a59c58ee07c
SimHash 4a3e8160eb18

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msie

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30.0