it's done all the time "war driving", cruising around to find adhoc wireless networks and checking to see what's for the takin
http://en.wikipedia.org/wiki/Wardriving
if your machine has a firewall of any sort youre pretty much ... umm, good to go regarding attacks from his side. unless...