I had lots of problems on Saturday but it wasn't bad yesterday and today, only very rarely does it go back to the Home screen now.
FYI, to close out apps, go to your Home screen, move the cursor over what you want to close, press the 3 lines button (where the old start was) and select Quit. Also, to hard reset the Xbox One itself, hold the button on the console for a few seconds.