If you want to disable it from all views, not just List View: wp-admin > Events > Settings > Display tab > “Disable the Event Search Bar” option — check it and see if things work better for you.
You can do a Template Override for /wp-content/plugins/the-events-calendar/src/views/modules/bar.php and just override it with an empty PHP file.
Then the Bar, Date Filter, and View Switcher would all be gone regardless of the “Disable the Event Search Bar” option being checked and regardless of how many views you have enabled.