A pregnant Hilary Duff was heavily criticised on social media for eating sushi