Is Empty .java file name a valid source file name?

YES.

• Save a java file as ".java" 
• Compile it as "javac .java"
• Run it as "java className" [where className is the name of your java class within the file .java]