Laser vacuum acceleration can be optimized significantly by applying a static magnetic field which is along the direction of laser magnetic field. This setup can cause a charged particle to be of a periodic, oscillatory-rising velocity, and significantly high kinetic energy. Moreover, the contribution from the motion vertical to accelerating electric field is fully taken into account and is found to be essential to efficient acceleration.