kuaivideodownloader.com
robots.txt

Robots Exclusion Standard data for kuaivideodownloader.com

Resource Scan

Scan Details

Site Domain kuaivideodownloader.com
Base Domain kuaivideodownloader.com
Scan Status Ok
Last Scan2026-02-12T10:11:12+00:00
Next Scan 2026-02-19T10:11:12+00:00

Last Scan

Scanned2026-02-12T10:11:12+00:00
URL https://kuaivideodownloader.com/robots.txt
Domain IPs 145.79.211.14, 2a02:4780:11:2092:0:1367:fa8:3
Response IP 145.79.211.14
Found Yes
Hash bfbebcf64ec0508def71ad2d3eaf165110c822fd5f5cb5288b9320ba1809919c
SimHash 0018dff276b3

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://kuaivideodownloader.com/sitemap_index.xml

Comments

  • robots.txt for example.com
  • Allow Google bots
  • Block known bad crawlers
  • Slow down generic crawlers