Yes, but i have very often the widget off when modeling. And then you cannot drag the selected elements, like vertices, around anymore in edit mode. Instead it paints a select rectangle. Modeling impossible.
I feel your pain. It’s just i cannot find a good solution here, sorry.