15

I'd like to display a popover right above where the user is typing, in any Linux app (GTK, Qt, Electron, etc.), running on X.

I figured out creating the popover, now I'm trying to figure out how to get the coordinates of the input text cursor (what blinks while you type, not sure if it's called "caret"?) relative to the screen.

I know I can get info on where the mouse with xdotool:

xdotool getmouselocation

I would need the same thing but for the text cursor, in the currently focused window.

I have no idea how to achieve this. I would love if someone could point me in the right direction.

8
  • X has no idea where the text input caret is. I don't think your idea is implementable (without co-operation from the application or toolkit). Nov 17, 2018 at 13:36
  • I agree with @jku, X doesn't know anything particular about that, just that you clicked somewhere (if even a click is needed) and that it has been handled by an application. It doesn't know at all whether you're typing text or not! Also, I think it's called a cursor
    – Jaffa
    Nov 26, 2018 at 8:47
  • Right. I was told one way would be witha GTK module.
    – nkkollaw
    Nov 27, 2018 at 10:24
  • Sounds interesting. What is the program for? Just out of curiosity, is it like an open-source grammarly or something?
    – kettle
    Mar 22, 2021 at 4:35
  • I don't know what Grammarly is @linux_kettle, but I was trying to implement a tooltip with accented letters like macOS or mobile OSes, that would activate by keeping a key pressed and insert the accented letter on click.
    – nkkollaw
    Mar 28, 2021 at 21:37

1 Answer 1

0

So, after doing some research I was able to figure out one way to implement this:

  • use xdotool to paste some random string
  • use OCR to find coordinates of the random string
  • use xdotool to remove random string

The problem is that this approach is pretty slow (up to 10 seconds depending on how much text there is on the screen).

I'v also tried comparing screenshots (before/after inserting text) and it's much faster, but a lot less precise.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.