Yeah, quite a few people had problems with that mechanic, it wasn't well communicated by the game. Thanks for playing :)
