I find most times that bump steer only becomes a problem when lowering cars as the tie rod arm arc becomes neutral or reversed somewhat after lowering.In the case of rear steering linkage ( original Holden ) setup ( after lowering ),the arc tends to want to pull the wheel to toe out on bump and front setup ( ie front mount rack and pinion )seems to tend to want to pull the wheel to toe in on bump.
In standard height suspension the tie rod arc under movement tends to move to neutral and gives you toe in under travel.
It's been 18 years since I've work in wheel alignment so hope my memory isn't failing me on what I've written above
happy to be corrected on anything I've written if it's wrong
I've just lowered my FB sedan 2 1/2 inches at the front ( original kingpin front end ) and I'm not suffering from bump steer.Had to cut and reshape bump rubbers to get some suspension travel though.
Only problem I have is steering wander due to wear or adjustment needed.Either adjustment or steering box rebuild will ease that.
Seems like your problem ( at least part of it ) is due to steering box wear.If worn and or needing adjustment, the car will have wandery steering and you will always be correcting it.And if steering geometry is out ( as Effcee describes ) then that also adds to your wandering woes and could be a big contibutor to the problem.
Effcee's description of how to check your front end is very good and I'd be checking the front end for wear as he has described.