Intelligent reflecting surface (IRS) is expected to play a pivotal role in future wireless sensing networks owing to its potential for high-resolution and high-accuracy sensing. In this letter, we investigate a multi-target direction-of-arrival (DoA) estimation problem in a semi-passive IRS-assisted sensing system, where IRS reflecting elements (REs) reflect signals from the base station to targets, and IRS sensing elements (SEs) estimate DoA based on echo signals reflected by the targets. First, instead of solely relying on IRS SEs for DoA estimation as done in the existing literature, this letter fully exploits the DoA information embedded in both IRS REs and SEs matrices via the atomic norm minimization (ANM) scheme. Subsequently, the Cram & eacute;r-Rao bound for DoA estimation is derived, revealing an inverse proportionality to MN3 + NM3 under the case of identity covariance matrix of the IRS measurement matrix and a single target, where M and N are the number of IRS SEs and REs, respectively. Finally, extensive numerical results substantiate the superior performance of the proposed method over representative baselines.