Probably the biggest barrier to ending daylight saving time is... do you go to year-round winter time or summer time?
And that's kind of the upside of daylight saving time: in winter, when days are short, you really want to get the daylight in the morning not in the evening; but in summer, when days are long, you want to move the extra morning daylight to the evening. So DST is kind of a compromise where we suffer the negative results of the changeover to get the positive results of morning light in winter and the positive results of extra evening light in summer.
And that's kind of the upside of daylight saving time: in winter, when days are short, you really want to get the daylight in the morning not in the evening; but in summer, when days are long, you want to move the extra morning daylight to the evening. So DST is kind of a compromise where we suffer the negative results of the changeover to get the positive results of morning light in winter and the positive results of extra evening light in summer.