You can press tab which changes the focus of the window to the instrument/fx field where you can use the arrow keys to navigate further and then press enter to load the plugin.
It’s still not perfect but you can do what you want without using the mouse!