Lower north shore residents will be hit hard in the hip pocket if the Minns government imposes two-way tolls across the Sydney Harbour Bridge.