Justin Timberlake responds after his manager tells Janet Jackson to forgive him