GPS Visualizer has a drop down menu to switch between maps:
I think you might to experiment with that site a bit further. You seem to have jumped to at least one unwarranted conclusion. No matter what type of map tiles you choose (like OSM), the resulting page is still a Google map, requiring a Google API key.
On that site, only if you want to produce just a simple JPG map can you dispense with Google. At that point, of course, you have a map that is not interactive in any way. As if that weren't enough, there doesn't appear to be any way to specify the zoom level you want when you're generating a JPG map, which often renders the result useless.
Thus you can do it and you can ask jAlbum to have it too.
If all you want is an inflexible JPG of a map, perhaps the jAlbum core could produce it, though I question the utility of the development time that it would require. There doesn't appear to be any way to incorporate the "visualizer" into an application - it would require Java programming, starting from a clean slate.
And if you want an actual HTML page, it pays to remember that the jAlbum core, on its own, does not currently produce a single line of HTML, CSS, or Javascript. The existing skins that provide map support already accomplish that - there's no need for the jAlbum core to reinvent the wheel.