Hate to disappoint you guys but the idea is actually provided for in the rulebook
47.3 When deciding on a personal contact or violation, the officials shall, in each
instance, have regard to and weigh the following fundamental principles:
• The spirit and intent of the rules and the need to uphold the integrity of the
game.
• Consistency in the application of the concept of 'advantage/disadvantage',
whereby the officials should not seek to interrupt the flow of the game
unnecessarily in order to penalise personal contact that is incidental and which
does not give the player responsible an advantage nor place his opponent at a
disadvantage.
• Consistency in the application of common sense to each game, bearing in mind
the abilities of the players concerned and their attitude and conduct during the
game.
• Consistency in the maintenance of a balance between game control and game
flow, having a 'feeling' for what the participants are trying to do and calling
what is right for the game.
Also, how many times have you complained at a ref because a call was 'soft'? You're saying you want everything called - if that were the case it would become similar to netball! That would also mean that 3 seconds would be called every time down to a knife edge, and even travelling in the back court when there is no defence to be seen would also be called.
Not only that, think of this scenario: You are dribbling on a fast break or an ordinary drive to the basket, you are fouled as you stop dribbling or just before but it's only a minor knock and you manage to finish the shot and make the basket. Should the ref cancel the basket and give you the ball on the sideline? He can't give you 2 shots as you weren't in the act of shooting, but he's not allowed to let the contact go under the idea that there was "no disadvantage". This is also the same for situations where you get fouled on the rebound or the dish and then get a wide open, easy shot after that.