In a direct democracy it can't be vague generalizations that the actual rulers, who are distinct from the electorate, get to choose whether and how to apply and whether or not the electorate can reconsider it, because if there are actual rulers distinct from the electorate it's not a direct democracy.
Brexit is not a failure of direct democracy.