Regé-Jean Page speaks out as it's confirmed he won't return for 'Bridgerton' season 2