Hi,
Thanks for using our plugins.
Unfortunately, there is no setting to refine the search. The Google API is suppose to return results closest to your events address, but Google is returning results from farther away.
We have a bug report to look into the issue and see if we can resolve it before the next release.
There has been a similar thread to this where the customer came up with their own solution to the issue for now:
Google maps 'Near' search – UK locations
Let me know if you have any follow up questions.
Thanks