Recently upgrade to J6, although not sure if this issue predated this. Joomla and SP Page Builder are latest builds and Google API is setup correctly. During a walkthrough of the site after upgrading to J6 we noticed that our Google Map takes seconds to load.
Seeing this in the Console:
Google Maps JavaScript API has been loaded directly without loading=async. This can result in suboptimal performance. For best-practice loading patterns please see https://goo.gle/js-api-loading
Note: Joomla caching is disabled as I had problems with dynamic content and caching in the past, although that may have been fixed. Please advise if caching can be enabled now.