Mobile device applications can be used to manage health. However, healthcare providers hesitate to use them because selection methods that consider the needs of health consumers and identify the most appropriate application are rare. This study aimed to create an effective method of identifying applications that address user needs. Women experiencing dysmenorrhea and premenstrual syndrome were the targeted users. First, we searched for related applications from two major sources of mobile applications. Brainstorming, mind mapping, and persona and scenario techniques were used to create a checklist of relevant criteria, which was used to rate the applications. Of the 2784 applications found, 369 were analyzed quantitatively. Of those, five of the top candidates were evaluated by three groups: application experts, clinical experts, and potential users. All three groups ranked one application the highest; however, the remaining rankings differed. The results of this study suggest that the method created is useful because it considers not only the needs of various users but also the knowledge of application and clinical experts. This study proposes a method for finding and using the best among existing applications and highlights the need for nurses who can understand and combine opinions of users and application and clinical experts.