Was the frontman’s voice supposed to be drastically different when he wore the mask?

I’m not great at separating different voices in kdramas so I may be wrong here, but how is it that no one ever recognised him by his voice? There were scenes in season 1 when his brother heard him speak but didn’t recognise him and the same happened at the end of season 2 when he was talking to gi hun before killing his friend.