How much of that latency is down to DWM (the compositor) doing fancy transitions? It seems like there's at least a 1/4 second dedicated to the grow/fade in.
If you search the startmenu for "advanced system settings" it will pull up a control panel era System Properties app with an Advanced > Performance option. Turning off visual effects there dramatically increases responsiveness.