Component Server role will stay for another and show grey on right click stopping you from deleting it even if you have uninstalled all other roles.
To force a removal of Component Server, all you need to do is to restart SMS_SITE_COMPONENT_MANAGER service and then come back to SCCM console and refresh the window. Component Server will be gone.