I wonder about the accuracy of critical text methods like the ones that have been used to putatively reconstruct the Q document and to argue about authorship and dates. Have these methods ever been validated against a ground truth that the arguers didn't know about beforehand? Like, have we ever philologically reconstructed a text from other texts, and then found exactly that text buried somewhere? Or even something close to it?
In the case of Q, you could argue that the Gospel of Thomas validates that there were texts of that kind (sayings gospels) floating around, but Thomas doesn't match the content of Q.
Outside biblical scholarship, another area where people have tried to reconstruct what is going on in ancient texts is the Chinese classics, especially the really cryptic ones like the Yijing. But whenever some actual ancient manuscript gets dug out of an old grave or a bog, it seems like it just brings up more questions and complications, instead of validating anyone's theories.
Compare to the philology methods that people use to reconstruct ancient languages. These have been validated pretty well. For example in the 19th century linguists were able to deduce that the Proto-Indo-European language must have had guttural consonants not found in any extant language, and then later when the Hittite language was decoded, the guttural consonants were right there. The theory was validated on held-out data. Has this ever happened for critical methods for discerning authorship and sources and missing texts?
In the case of Q, you could argue that the Gospel of Thomas validates that there were texts of that kind (sayings gospels) floating around, but Thomas doesn't match the content of Q.
Outside biblical scholarship, another area where people have tried to reconstruct what is going on in ancient texts is the Chinese classics, especially the really cryptic ones like the Yijing. But whenever some actual ancient manuscript gets dug out of an old grave or a bog, it seems like it just brings up more questions and complications, instead of validating anyone's theories.
Compare to the philology methods that people use to reconstruct ancient languages. These have been validated pretty well. For example in the 19th century linguists were able to deduce that the Proto-Indo-European language must have had guttural consonants not found in any extant language, and then later when the Hittite language was decoded, the guttural consonants were right there. The theory was validated on held-out data. Has this ever happened for critical methods for discerning authorship and sources and missing texts?