zifmstereo.co.zw
robots.txt

Robots Exclusion Standard data for zifmstereo.co.zw

Resource Scan

Scan Details

Site Domain zifmstereo.co.zw
Base Domain zifmstereo.co.zw
Scan Status Ok
Last Scan2024-09-25T00:34:15+00:00
Next Scan 2024-10-02T00:34:15+00:00

Last Scan

Scanned2024-09-25T00:34:15+00:00
URL https://zifmstereo.co.zw/robots.txt
Domain IPs 104.21.30.193, 172.67.173.141, 2606:4700:3031::6815:1ec1, 2606:4700:3035::ac43:ad8d
Response IP 172.67.173.141
Found Yes
Hash 545aeb04c150c972f56092d08a5cf6386df0791d84345fee2f619a56f72d7701
SimHash 426848ca33ba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole

Other Records

Field Value
crawl-delay 20

*

Rule Path
Allow /wp-includes/js/

*

Rule Path
Disallow /wp-admin/

*

Rule Path
Disallow /wp-includes/

*

Rule Path
Disallow /xmlrpc.php

*

Rule Path
Disallow /profile

*

Rule Path
Disallow /cgi-bin/

*

Rule Path
Disallow /wp-content/cache/

*

Rule Path
Disallow /trackback/

*

Rule Path
Disallow /comments/

*

Rule Path
Disallow /administrator/

*

Rule Path
Disallow */trackback/

*

Rule Path
Disallow */comments/

*

Rule Path
Disallow /license.txt

*

Rule Path
Disallow /*.php$

*

Rule Path
Disallow *?filter

*

Rule Path
Disallow /wp-content/themes/

*

Rule Path
Disallow /readme.html

adidxbot
ahrefsbot
aihitbot
alphaseobot
alphaseobot-sa
baiduspider
bingpreview
blexbot
careerbot
cliqzbot
dotbot
grapeshot
ichiro
icjobs
linkdexbot
magpie-crawler
megaindex
mj12bot
moget
naverbot
owlin
owlin bot
owlin bot v. 3.0
proximic
queryseekerspider
scrapy
scrapybot
semrush
semrushbot
sentibot
seokicks-robot
sogou
sogou spider
tkbot
trendkite-akashic-crawler
vagabondo
wbsearchbot
yandex
yandexbot
yeti
youdaobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://zifmstereo.co.zw/sitemap.xml
sitemap https://zifmstereo.co.zw/news-sitemap.xml

Comments

  • Horrible bandwidth eating robots