The main reason to use quantum computing is that it allows us to write algorithms that exhibit different complexity characteristics compared to classical computing. Simply put: you can do a computation in less steps. The fact that it is non-deterministic is rather a side-effect.