Log In Sign Up

clipsconvert.com
robots.txt

Robots Exclusion Standard data for clipsconvert.com

Resource Scan

Scan Details

Site Domain clipsconvert.com
Base Domain clipsconvert.com
Scan Status Ok
Last Scan2024-11-14T05:53:58+00:00
Next Scan 2024-11-21T05:53:58+00:00

Last Scan

Scanned2024-11-14T05:53:58+00:00
URL https://clipsconvert.com/robots.txt
Domain IPs 104.21.53.128, 172.67.212.216, 2606:4700:3033::6815:3580, 2606:4700:3035::ac43:d4d8
Response IP 172.67.212.216
Found Yes
Hash 50c15ad3683d42dfcfc6e7bda638465a1b552015df28dd944b136d0689df67ac
SimHash 051cce20e792

Groups

*

Rule Path
Disallow /
Disallow /ads/
Disallow /api/

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandex

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Comments

  • Block all user-agents by default
  • Allow major search engines
  • Disallow common bad bots
  • Specify the preferred host
Back to top

Warnings

  • `host` is not a known field.
Back to top