If you and I hit a rock it may not be a big deal, even if G-d tells us to speak to it. But the standards of behavior expected of a leader, especially one as great as Moses, are considerably higher. Hence his punishment was that much more severe.