Wayland enforces security to stop one process sniffing or injecting input into another. X11 basically has zero security boundaries. So certain things are easier in X11, but then again the price to pay is too much.
So things like virtual mouse positioning, autohotkey, screen capture are harder to do but not insurmountable. It requires protocols that the client / desktop understand and which are fit for purpose. Big desktops like GNOME & KDE Plasma do support xdg-desktop-portal which allows hotkeys to be registered with the desktop, and could potentially be what you need.
Stuff like ydotool, wtype exist and presumably there are others for this. Search on automation testing on Wayland and see.
Since it is a niche I’m not surprised if it wasn’t a critical path for Wayland adoption but clearly there are solutions that work for certain compositors and I assume people working on a more robust solution. But allowing one piece of software to sniff or inject input, or capture its content is an obvious security flaw and Wayland devs are right to put it front and centre. If a desktop is to allow those things then it should be through a security model instead of in the absence of one.
I have ydotool, it is unable to do anything but put the mouse at 0,0
I have tried every product, got all the way into python before I was able to even do relative.
edit: just tried again because it’s been a while. The best I can do with ydotool is move the mouse cursor to -99999,-99999 to get it ot go to 0,0 then go to 100,100. It is, to this day, unable to to an absolute position, but is able to do relative.
I just tried espanso too, doesn’t work in kate or konsole, or web browsers.
I’m running in to the same stuff i’ve been running into for 3 years, none of the apps that are intended to do this actually do it in Wayland.
I just want to be able to use mouse automation and test replacement, i don’t think that’s a big ask.
Wayland enforces security to stop one process sniffing or injecting input into another. X11 basically has zero security boundaries. So certain things are easier in X11, but then again the price to pay is too much.
So things like virtual mouse positioning, autohotkey, screen capture are harder to do but not insurmountable. It requires protocols that the client / desktop understand and which are fit for purpose. Big desktops like GNOME & KDE Plasma do support xdg-desktop-portal which allows hotkeys to be registered with the desktop, and could potentially be what you need.
I need mouse and keyboard control to do testing automation.
I want keyboard interception so i can make dozens of !faxnumber, !address, !bashloop, !bashwhile macros to use text replacement on
You can do this in every other OS. It wasn’t even a primary exploit, just something some devs decided to die on a hill over.
Wayland has been reasonably used for a decade, at what point would you consider unreasonbly difficult to transition into insurmountable
Stuff like ydotool, wtype exist and presumably there are others for this. Search on automation testing on Wayland and see.
Since it is a niche I’m not surprised if it wasn’t a critical path for Wayland adoption but clearly there are solutions that work for certain compositors and I assume people working on a more robust solution. But allowing one piece of software to sniff or inject input, or capture its content is an obvious security flaw and Wayland devs are right to put it front and centre. If a desktop is to allow those things then it should be through a security model instead of in the absence of one.
I have ydotool, it is unable to do anything but put the mouse at 0,0
I have tried every product, got all the way into python before I was able to even do relative.
edit: just tried again because it’s been a while. The best I can do with ydotool is move the mouse cursor to -99999,-99999 to get it ot go to 0,0 then go to 100,100. It is, to this day, unable to to an absolute position, but is able to do relative.
I just tried espanso too, doesn’t work in kate or konsole, or web browsers.
I’m running in to the same stuff i’ve been running into for 3 years, none of the apps that are intended to do this actually do it in Wayland.
I just want to be able to use mouse automation and test replacement, i don’t think that’s a big ask.