Comment by jawarner

Yes, the possible programs are enumerable, and you can start searching with the least complex programs and work your way up in complexity. Once you find a program that explains the available data, you cannot guarantee it will continue to explain possible future data, unless, like you mention, you constrain the program space to a finite set. What you're describing is generally how people make models of the external world.