Soft fingers play an increasingly important role in robotic grippers to achieve adaptive grasping with variable stiffness features. Previous studies of soft finger design have primarily focused on the optimization of the structural parameters of existing finger structures, but limited efforts have been put into the design methodology from fundamental grasping mechanisms to finger structures with desired grasping force features. To this aim, a fundamental architecture of soft fingers is proposed for analyzing common soft finger features and the influence of the internal structures on the overall grasping performance. In addition, three general performance metrics are introduced to evaluate the grasping performance of soft finger designs. Then, a novel method is proposed to combine the variable stiffness structure with the fundamental architecture to compensate for the grasping force of the finger and linearization. Subsequently, an embodiment design is proposed with a cantilever spring-based variable stiffness (CSVS) mechanism based on the method, and a multi-objective optimization method is employed to optimize the design. Besides, the CSVS features are analyzed through finite element analysis (FEA), and by comparing the grasping performance between the V-shape finger and the CSVS finger, it is demonstrated that the design method can effectively shorten the pre-grasp stage and linearize the grasping force in the post-grasp stage while reducing the likelihood of sliding friction between the finger and the grasped object. Finally, experiments are conducted to validate the accuracy of the FEA model, the effectiveness of the design methodology, and the adaptability of the CSVS finger.