The problem of classification efficiency analysis in speech signals for speaker identification using a machine learning approach has been a challenge for several years. The classification using the machine learning approach maps the speaker’s data of attention into several segments. For the speaker’s classification system, segments represent a unique speaker. This manuscript used the principal component analysis (PCA) technique used in which speech signals are converted into a set of vectors by using feature extraction. Once this is done, a speaker model can be developed for use in further speaker classification. Here dual classifiers using machine learning approaches like support vector machine (SVM) and k- nearest neighbour (k-NN) are proposed and utilized to determine the relationship between the speaker voice in the model and the input test voice. It has been discussed about the SVM and k-NN, algorithms that have been shown the better classification efficiency in speaker identification. The k-NN classifier has considerably higher detection rates compared to the SVM classifier. The proposed result on k-NN may be inconsistent with some other assessments concerning to SVM. Here advantages of k-NN is presented over other machine learning algorithm as it has attained an outstanding classification efficiency of 94.45% using the k-NN classifier and a significantly lower identification rate of 92.90% using SVM. The proposed time-frequency changing averaging factor in conventional subtraction procedures improves voice quality metrics for diverse noise kinds and signal-to-noise ratio (SNR) levels. This manuscript also enhances voice classification efficiency in terms of Accuracy, sensitivity, specificity, precision, recall, and F-1 measure using machine learning. The authentication results for identified features such as accuracy, sensitivity, and specificity were calculated as 55.59%, 61.11%, and 52.55% respectively. Precision, recall, and F1-measure derived the result 57.14%, 61.11%, and 57.33% respectively. Existing approaches were thoroughly examined to build a better classification system.