Well, badges are important because they allow you to use HMs outside of battle.

As for gym battles...yeah, they're supposed to be tough. The gym leaders are skilled trainers in their chosen type, so they're challenging for their levels. But they can be beaten with strength and skill.