Hi,
Thanks for the interest in our plugins.
I can help out here.
The Map View shows the Events in the list below it on the map so it does not have a way to show venues without events.
For your work around I do not think that would work as you need the events in the list below it to show in the map. So if you removed them it would not show.
You might be able to hide those events with css, but you would want to increase the amount of events shown per page to get them all in.
Let me know if you have any follow up questions.
Thanks