I have driven many thousands of miles on noisy wheel bearings without incident, its unlikely to cause you a problem ..... although there's always a first time of course.