africavoting.com
robots.txt

Robots Exclusion Standard data for africavoting.com

Resource Scan

Scan Details

Site Domain africavoting.com
Base Domain africavoting.com
Scan Status Ok
Last Scan2025-10-19T03:56:56+00:00
Next Scan 2025-11-18T03:56:56+00:00

Last Scan

Scanned2025-10-19T03:56:56+00:00
URL https://africavoting.com/robots.txt
Domain IPs 104.21.52.123, 172.67.199.1, 2606:4700:3031::ac43:c701, 2606:4700:3035::6815:347b
Response IP 172.67.199.1
Found Yes
Hash e5e30c007553be31fada71d839fac48aba19f455725961c7bf4bf8229533c8c9
SimHash 6617c277d5f3

Groups

googlebot

Rule Path
Disallow /private/

Other Records

Field Value
crawl-delay 10

googlebot-image

Rule Path
Disallow /images/private/

googlebot-news

Rule Path
Disallow /news/private/

googlebot-video

Rule Path
Disallow /videos/private/

googlebot-mobile

Rule Path
Disallow /mobile/private/

googlebot-adsbot

Rule Path
Disallow /ads/private/

bingbot

Rule Path
Disallow /private/

Other Records

Field Value
crawl-delay 8

duckduckbot

Rule Path
Disallow /private/

Other Records

Field Value
crawl-delay 5

baiduspider

Rule Path
Disallow /private/

Other Records

Field Value
crawl-delay 12

yandex

Rule Path
Disallow /private/

Other Records

Field Value
crawl-delay 15

facebookexternalhit

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://africavoting.com/sitemap.xml
sitemap https://africavoting.com/sitemap.xml
sitemap https://africavoting.com/sitemap.xml
sitemap https://africavoting.com/sitemap.xml
sitemap https://africavoting.com/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.