rwandatoday.africa
robots.txt

Robots Exclusion Standard data for rwandatoday.africa

Resource Scan

Scan Details

Site Domain rwandatoday.africa
Base Domain rwandatoday.africa
Scan Status Ok
Last Scan2024-11-15T13:11:59+00:00
Next Scan 2024-11-22T13:11:59+00:00

Last Scan

Scanned2024-11-15T13:11:59+00:00
URL https://rwandatoday.africa/robots.txt
Domain IPs 104.21.34.43, 172.67.197.156, 2606:4700:3037::6815:222b, 2606:4700:3037::ac43:c59c
Response IP 104.21.34.43
Found Yes
Hash 758c184649fef4d89a140127b67566150c247798ed3d492ee878d4348f99c9dd
SimHash 20540bf16d73

Groups

*

Rule Path
Disallow /bd/
Disallow /uganda/
Disallow /mw/
Disallow /tanzania/
Disallow /tea/
Disallow /ke/
Disallow /kenya/
Disallow /ms/
Disallow /ug/
Disallow /resource/crblob/
Disallow /resource/themes/
Disallow /cdn-cgi/
Disallow /service/
Disallow /nakuru/
Allow /

Other Records

Field Value
sitemap https://rwandatoday.africa/rwanda/sitemap.xml

Comments

  • robots.txt for https://rwandatoday.africa/ -- Rwanda Today