Update 10.02.2017:
I upgraded the firmware to 01.03.0200 firmware. This seems to fix my problem. Mavic was below freezing when I tested again, and is stable even if I zoom in 2X on the camera. (Only ground testing done at the moment, but issue was clearly seen)
Indoor there is no problems with vibration, but outdoors the issue is clear. Vind about 3-5 meter pr sec.
Calibrated gimbal and it helped a little, but is coming back.
After some more testing it seems to be related to cold weather.