As the title implies, MJTest seems to ignore .java.out files. Instead it just tests whether the compiled program has the same output as the equivalent javac-compiled program.