Define both fits
The housing holds the bushing while the bore controls shaft clearance. Specify the assembled fit for each interface rather than applying one nominal tolerance to the entire sleeve.
Thermal expansion and compression from the housing can alter the running bore. Give the operating temperature and installation method when these effects control clearance.