keyboard shortcut issues

I'm having constant issues with the keyboard shortcut where it toggles between double press and single hold to activate the microphone. For example, if I freshly boot up a computer, double tap as intended works fine, and then as the hours go by, all of a sudden that doesn't work anymore, and the only way I can get the microphone on is to hold for 3 seconds. Has anyone else had this issue and knows the solution?

I have a M4 Pro with an external USB C keyboard using right control as the keybind.

Thanks!