I would have ZERO issues with the wacky episodes if and only if we were back to the 20-ish episodes per season format. Then sure, do a puppet show. Musical episodes (for how much I HATE musicals, it was decently enjoyable, Klingon boy band was super unexpected).
But when you only have half a dozen-ish episodes per season, you can't afford filler.
But when you only have half a dozen-ish episodes per season, you can't afford filler.