Performing a clean uninstall of ArcGIS Desktop

There comes a time, when you may get persisting issues with your ArcGIS Desktop software and a clean uninstall is the only solution left on the table. But what exactly is the best workflow to follow and how do you go about executing it?