How can I add new html files to react app

I am creating a new react app using create-react-app and I get all the setup but I don't know how to add new html files and render components to those files , is there a guide where I can check how to do it because I've searched on internet and asked on stackoverflow but no help yet ? Thanks #myfirstpost

Edit : I don't want to have a single page app where I can change the content of the page , I want to render components to new pages , hope this makes it clear