Herbaceous peony (Paeonia lactiflora Pall.) has emerged in the cut flower market due to its beautiful appearance. The bending flower stems caused by a lack of mechanical strength is the main problem restricting the development of the cut P. lactiflora industry. So it is of great worth to reveal the basis of stem development changes in P. lactiflora to improve its cut flower quality. Quantitative research on gene expression characteristics can provide clues for understanding their biological functions, and the screening of relatively stable expression genes is a prerequisite for the quantitative study of gene expression characteristics. Thus, it is necessary to find appropriate genes during stem development so as to analyze the qRT-PCR results. In this study, 10 genes were screened, and these genes expressed stably in stems of different stem strengths at three different developmental stages. Then, their expressions were evaluated by RefFinder, BestKeeper, NormFinder, and GeNorm programs. The results demonstrated that gamma-tubulin (gamma-TUB) was the most suitable gene, followed by alpha-tubulin (alpha-TUB) and beta-D-glucosidase (beta-GUS), whereas histone H3 (His) was the least suitable gene. Besides, the temporal and spatial expression characteristics of PlCOMT1, the key gene concerned with the synthesis of cell wall fillers in P. lactiflora, were also used to evaluate the suitability of genes. Consequently, gamma-TUB and alpha-TUB are the two best combinations during stem development, and their combination can be used for the stem development of P. lactiflora. These findings will provide a reference for the selection of genes related to stem development and the study of molecular mechanisms related to stem development in P. lactiflora.