This paper introduces a combined one-dimensional model for thermoviscoplastic behavior under solid-solid phase transformations that incorporates the occurrence of hysteresis effects in both the strain-stress law and the phase transition described by the evolution of a phase-field (which is usually closely related to an order parameter of the phase transition). Hysteresis is accounted for using the mathematical theory of hysteresis operators developed in the past thirty years. The model extends recent works of the first two authors on phase-field models with hysteresis to the case when mechanical effects can no longer be ignored or even prevail. It leads to a strongly nonlinear coupled system of partial differential equations in which hysteresis nonlinearities occur at several places, even under time and space derivatives. We show the thermodynamic consistency of the model, and we prove its well-posedness.