Advice for efficient navigation using the jump list

Hi,

I like navigating the jump list using ctrl-o and ctrl-i. The problem
is that I also prefer to use relativenumber. Both settings,
unfortunately, do not match very well.

If I have relativenumber set, I navigate to the visible text parts
using e.g. 15k or 22j. However, these jumps are not recorded in the
jump list. This basically means using relativenumber entirely
invalidates the usefulness of the jump list.

If I use number instead of relativenumber, navigation by line
numbers gets really painful. I then navigate using e.g.
12843gg or 1937gg

As a consequence I either use the search (/, ?) instead of direct
jumps or the change list (g;, g,). But I feel that both are sort-of
unpredictable and not suitable in all cases or even slower compared
to e.g. 15k.

Any suggestions about how to improve my workflow or even a solution
for relativenumber and the jump list to be friends? Maybe there is a
setting which adds j and k jumps which are preceded by a count to
the jump list.

Marco