Certainly, Netlify provides a great service. In fact, there are other commercial solutions, too: https://blog.bitsrc.io/8-react-application-deployment-and-hosting-options-for-2019-ab4d668309fd

But as far as I know, none of these is open source. None of these let you use your own AWS account.

And: none of these (including infrastructure-components) is built into create-react-app.