Which worked brilliantly on mine Fido - 400+ kilometres this weekend, from slow country lanes to dual carriageways, and NOT a drop of oil from anywhere, top, bottom, primary case, speedo drive . . . Huge outbreak of pride - but sure to be temporary!
Except for one remaining thing . . . the small weep from the kickstart shaft.
However, the answer to the original Q has to be, if the oil level is dropping noticeably and fast, Yes, get the tool and do the thing up so at least it's just the semi-normal dribble rather than a flood! And best check at same time the oil isn't actually leaking from somewhere else and then trickling across and along and whatever, to make you think it's coming from the speedo drive box. At the final drive end, the small allen screw that locates the selector rod can be a source of leaks, and so can the mainshaft/sleeve-gear itself, as well as the obvious gasketed joints, the felt seal on the inner chaincase (esp if the chaincase is overfilled), the cam-plate plunger assembly on the bottom, etc etc. It often looks as if it's 'just the primary chaincase, as usual', when it's actually a bit more complicated . . . Hopefully not in this case though.