only stupid question is the one you didnt ask (just don't tell some blokes around here)
shouldn't cause any major issues, your axle seal should stop any oil leaking past to your wheel bearing, but if thats gone your brakes will see some oil, but not before you bearing gets flogged out :)
In short, shouldnt be an issue, but do double check the condition of your axle seals while you have them out.