Nice evaluation of Java & JVM,
Yes, if we are going to find the best possible solution & technology for core banking  field ( mission-critical systems ) exactly for financial calculation side maybe you mention directly to erlang to support & compensate most of following deficiencies and i think yes it is abstractly one of the best choice for this side.
But i think the major problem in this discussion is definition of a Core Banking system or service boundary which can help  us to find out Java EE or something like that is in Central view of banking project or some technologies  & languages like ESB, Rule Engines , BPM/BPEL , Scala or erlang are there.

In my point of view Java EE is a big umbrella which can cover most of other technologies under itself, so you can use some technologies & languages around of Java EE technology to gain the best result.