Comment by Lanz

This is an incredibly important idea. The scientific process has been corrupted by far too much pseudoscience and not near enough actual science. If the data say you are wrong, you are wrong. That doesn't mean finagle the data until you get the result you want, perform endless subgroup analyses, etc. If a theory is wrong, throw it out and start again. Quit salvaging the corpse of broken theory.