Uhm. I'm still pretty young, so I can't empathize with the parent's side of things, but here goes...
For me, school isn't just a place to learn acedemia and whatnot. It's also a place to learn how to socialize. To interact with society.
If you raise your kid homeschooled for most of his life...