Yeah I agree with that. One mainly tends to notice it more with one's own ruckmen though naturally.
What seems to happen is they generally get called a HTA when it's an absolute advantage, eg ruckman at centre square hits it to player who kicks the ball into the 50, with the ruckman usually getting 3 points for it. However then there is what I would call a semi to advantage tap, eg the ruckman clearly it it to another player who takes possession but that player takes a split second too long so their handball gets smothered/sharked etc. It's this hit out that I think should at least get a point but often gets 0.
Anyway can't complain as long as all ruckmen get judged the same (But I sometimes wonder!)