Do all stars explode?

No. Only stars with a great deal of mass will ever become unstable enough to explode. Smaller stars, like our Sun, do not generate enough internal gravitational energy to go supernova. They simply contract after they reach a certain stage in their development, and become white dwarfs.