Some tasks are easy to plan for, so it's very worthwhile.
For instance farmers outfit and boots since you are going to do all your harvesting at once, in your base at least.
Enforcer glasses for bartering is another.
Setting out on a trip for a specific task, like mining or woodcutting, maybe even salvage. Sure.
Swapping back and forth in quests is madness. I mean don't get me wrong, I used to do it a lot before 1.0, looter goggles, open stuff, swap nerd back on otherwise...it got to be a real pain in the ass. Some of us really can't help ourselves. I am probably borderline OCD.
I have really tried not to do it now, but I've already caught myself carrying around a t6 nerd outfit for book reading. I'm really trying to stop. I also just put my cigar in and left it, trying to forget the other headpiece exists.
It is hard, min/maxing is a disease. We need a support group!