Moshe hitting the rock conveyed a false message from Hashem to Klal Yisroel and that is why hitting the rock was such a grave sin.