First the tires physics should be fixed (longitudinal grip at least). It will give strong basement.
Then devs can play with damage, but I'm talking about engine, brakes, aero-parts, plus more suspension damages, which for me are more important than mirrors and bumpers falling off the car.