Nope, I definitely also feel it in my glutes. Because of the posterior chain, from calf muscles, which I keep my knees locked and that places stress on my hamstring and that connects to my glutes, which gets sore too.
So you are not alone. But since its body weight calf raises, it makes sense for the glutes to fatigue quicker as the calf muscle has high endurance rate then the glutes.