If it'll keep the game snappy, just maintain an invisible "bounding box" which interacts as a physical box object, even when the model is much smaller. Physical objects will bounce off "air", so it'll look a little funny, but mostly, it won't matter. It'll be frustrating for people when they...