Maybe I missed something above, but I think the main obstacle would be scalability. How do you prevent abuse of scale, also, how does this effect fighter-sized ships, anything too small to have much more than a cockpit?
Edit: I like this idea from what you've said so far, I'm nitpicking...