I have only witnessed this in Jira but have not gone looking to replicate anywhere else yet.

If you are editing a rich text input area which has a link in it, it is marked up with a rango hint bq

If you then submit the form the hint letters end up in the saved content - bq

I'm using firefox 106.0.1 (64-bit) on ubuntu 22.04 LTS. It was working for some time but stopped working sometime around when the new firefox update came out. However, it does work if you're in keyboard mode and you use the prefix press or upper case but this only works for the alphabet to click links/hints and not for voice commands or the knausj_talon alphabet in text fields, the address bar, etc. The hot keys don't seem to be the issue because I didn't have problems in the beginning after installing but the default configuration is Ctrl+Shift+3 to get the talon request and Ctrl+Shift+Insert to get the talon request (legacy). Below is the output in REPL console of talon when I say, "x", "ab", and "crown af":

thread<139625494476352> | grammar.cfg_compile 0.097865s thread<139625494476352> | grammar.cfg_list user.rango_hint_styles: 0.000110s thread<139625494476352> | grammar.cfg_list user.rango_hint_weights: 0.000086s thread<139625494476352> | grammar.cfg_list user.rango_hints_toggle_levels: 0.000089s thread<139625494476352> | grammar.cfg_list user.rango_page_location_property: 0.000092s thread<139625494476352> | grammar.cfg_compile_and_link 0.098478s main | engine.phrase plex talon_plugins.subtitles | action speech.enabled() user/knausj_talon/apps/vscode/command_client/command_client.py | action user.emit_pre_phrase_signal() user/knausj_talon/plugin/command_history/command_history.py | action user.history_transform_phrase_text(['plex']) user/knausj_talon/plugin/command_history/command_history.py | action speech.enabled() main | action core.run_phrase(C(None, ['x'])) core | action core.run_command(CommandImpl(Rule("<user.rango_target>")), C(_la_ltuser_2erango_5ftarget_gt_ra, ['x'])) core | action core.run_talon_script(ResourceContext("user.rango-talon.rango_direct_clicking.talon"), TalonScript(code='user.rango_command_with_target("directClickElement", rango_target)'), C(_la_ltuser_2erango_5ftarget_gt_ra, ['x'])) user/rango-talon/rango_direct_clicking.talon | action user.rango_command_with_target('directClickElement', ['x']) user/rango-talon/rango.py | action key('ctrl-shift-insert') main | engine.phrase air bat talon_plugins.subtitles | action speech.enabled() user/knausj_talon/apps/vscode/command_client/command_client.py | action user.emit_pre_phrase_signal() user/knausj_talon/plugin/command_history/command_history.py | action user.history_transform_phrase_text(['air', 'bat']) user/knausj_talon/plugin/command_history/command_history.py | action speech.enabled() main | action core.run_phrase(C(None, ['ab'])) core | action core.run_command(CommandImpl(Rule("<user.rango_target>")), C(_la_ltuser_2erango_5ftarget_gt_ra, ['ab'])) core | action core.run_talon_script(ResourceContext("user.rango-talon.rango_direct_clicking.talon"), TalonScript(code='user.rango_command_with_target("directClickElement", rango_target)'), C(_la_ltuser_2erango_5ftarget_gt_ra, ['ab'])) user/rango-talon/rango_direct_clicking.talon | action user.rango_command_with_target('directClickElement', ['ab']) user/rango-talon/rango.py | action key('ctrl-shift-insert') main | engine.phrase crown air fine talon_plugins.subtitles | action speech.enabled() user/knausj_talon/apps/vscode/command_client/command_client.py | action user.emit_pre_phrase_signal() user/knausj_talon/plugin/command_history/command_history.py | action user.history_transform_phrase_text(['crown', 'air', 'fine']) user/knausj_talon/plugin/command_history/command_history.py | action speech.enabled() main | action core.run_phrase(C(None, crown ['af'])) core | action core.run_command(CommandImpl(Rule("crown <user.rango_target>")), C(crown___ltuser_2erango_5ftarget_gt, crown ['af'])) core | action core.run_talon_script(ResourceContext("user.rango-talon.rango.talon"), TalonScript(code='user.rango_command_with_target("scrollElementToTop", rango_target)'), C(crown___ltuser_2erango_5ftarget_gt, crown ['af'])) user/rango-talon/rango.talon | action user.rango_command_with_target('scrollElementToTop', ['af']) user/rango-talon/rango.py | action key('ctrl-shift-insert') user/knausj_talon/plugin/mouse/mouse.py | action tracking.control_enabled() user/knausj_talon/plugin/mouse/mouse.py | action tracking.control1_enabled() user/knausj_talon/plugin/mouse/mouse.py | action tracking.control_enabled() user/knausj_talon/plugin/mouse/mouse.py | action tracking.control1_enabled() user/rango-talon/rango.py | context.refresh user.rango-talon.rango (tags)

Disclaimer: this is a bit of a mess of a PR, pushing this only to show progress and as a proof of concept. I will clean a lot of this up if you would like to proceed with it.

Goal

Typically when scrolling the number of elements and their index position in the intersectors array changes, meaning their hint changes.

Stablise hints - so that if a link has the hint af, after a scroll event or resize and the link is still in the viewport regardless of what other clickable elements come and go then its hint should remain af.

If the link is no longer in the viewport then the hint af is released and is free for another clickable element to use.

Why

I love rango but one thing I thought would be cool to try is to stablise the hints upon scrolling to reduce distractions when navigating the webpage. The hints changes now are subtle but removing them completely seemed like a nice thing to try.

As I have been developing this I really notice the difference when going back to rango without this stablisation. 😅

Other than the visual improvements I think it could be a better UX, you can see a link you want to click and then as long as you don't scroll it out of view you can use the same hint.

Why not

This does introduce significantly more complexity, so it is arguable if it is worth it. If you like I could look at hiding this functionality behind an option in the extension.

Other considerations

• Preferring one character hints when they are available seems like it would be nice. This might necessitate two stacks which can be used, preferring the single char one when it has elements in it.

Status

It seems to be working okay-ish, there is a weirdness when it alternates between showing 1 set of hints, and hiding another set of hints, both sets which are on the screen at all times, but at some point during the scroll event elementIsObscured is true. I think one set of hints is hiding the others and so you get this alternate effect. It is pretty easy to replicate on this page when scrolling down the list of files: https://github.com/david-tejada/rango/find/main I have not seen it on other pages yet.

I think possibly hiding hints on scroll and then reshowing the same hints with the same letters could help. Not 100% sure I am on the right track with that though.

Other Approaches

I am probably missing something a little more elegant so please point that out if can think of anything.

What do you think of the feature and/or approach @david-tejada? Throwing this up for early feedback.

Wrap Rango as a Safari web extension. Implements clipboard support in the native app.

Update CONTRIBUTING.md with Safari instructions.

Here's the app's main window:

Having seen the recent change where you demonstrated clicking a link while focussed on an input field I tried it out. Though when I do, it doesn't quite work, when focussed on an input and saying the letter for a hint the request is sent to rango, the letter Å is typed into the input field, and then Talon reports a timeout waiting for response.

I'm on macos 12.3.1, using up-to-date Firefox.

• [x] A command for scrolling an specific element: We will need to find the closest ancestor with overflow.
• [x] Add commands for scrolling an element to a certain position (top, center , bottom)

https://github.com/david-tejada/rango/issues/20 means that I frequently have to hide/show rango hints when jumping around tabs as I spend a lot of time in Confluence and Jira where this is a problem. It would be great if I could toggle the hints per tab to not have to deal with that.

Also a sidenote, I find when I toggle the rango hints it seems to cause some significant work for my browser and it lags for a bit. I wonder if this is due to having multiple tabs open and rango having to do a lot of work to show all the hints after them being toggled off? Being able to toggle per tab would also help with that.

This explains how to get up and running to debug rango. Including adding web-ext as an explicit dev dependency.

This is mostly for my own convenience as it took me a while to realise how easy it was and I forgot how to do this after having done it the first time. I thought others may also find this useful. Also, this may not be totally right so please correct me if not, I figured this out from reading the package.json and some googling.

NOTE: this also includes what seems to be a lot of changes to the package-lock.json, I am not sure if main is missing these changes or if my local set up isn't quite right.

I haven't noticed this anywhere else yet but I have problems selecting the checkbox in the top left of google mail to select all unread mail. Saying the letter hint performs the animation of the hint but the checkbox is not selected. This does work with Vimium but I haven't looked at what could be the difference yet.

Another thing I saw was that in the google mail UI some clickable elements with Vimium aren't marked up with hints in rango

Rango:

Vimium:

Example of this is view replies for 9gag comments

Possible solutions https://stackoverflow.com/questions/9046741/get-event-listeners-attached-to-node-using-addeventlistener

I think this means being able to set the selected value https://developer.mozilla.org/en-US/docs/Mozilla/Add-ons/WebExtensions/API/tabs/create when creating the tab here https://github.com/david-tejada/rango/blob/b90edaa346db93cf29423ef91b28450e6aa0e39d/src/background/tabs-messaging.ts#L90 as it defaults to true.

I am unsure what to suggest for the Talon command, and whether or not it should share the existing blank ... command with an extra qualifier or if it should get a new one. I think I'm leaning towards a new word, some for consideration:

stash air
load air
set air
store air
pack air

Trying to think of words which invoke imagery of stashing something away for later use as is common with opening links in new tabs

Currently to attach the URL to the title when there is no navigation event (the page uses History.pushState or History.pushState to change the url) I add a mutation observer to the document.head to see if the title has changed. The problem with this approach is that if the page doesn't change the title and there is some other change to the head I keep attaching the new url after the previous ones.

Opening a new tab with blank, stash or clicking multiple elements should follow the settings of the browser.

https://developer.mozilla.org/en-US/docs/Mozilla/Add-ons/WebExtensions/API/browserSettings/newTabPosition

paste to <hint>: pastes clipboard into input/textarea clearing its contents beforehand copy <hint>: copies text in input/text area to clipboard

For example, when you right click something and open the 'save as' dialog window, commands to write one or more keys are still consumed by rango. This makes it a little bit more difficult to write a file name in the dialog window as you can't use the single letter commands there.

For example, in this page if you try to select the text of the element with the hint "ax":