We report the detailed multi-scale and multi-directional geometric study of both evolving Lagrangian and instantaneous Eulerian structures in turbulent channel flow at low and moderate Reynolds numbers. The Lagrangian structures (material surfaces) are obtained by tracking the Lagrangian scalar field, and Eulerian structures are extracted from the swirling strength field at a time instant. The multi-scale and multidirectional geometric analysis, based on the mirror-extended curvelet transform, is developed to quantify the geometry, including the averaged inclination and sweep angles, of both structures at up to eight scales ranging from the half-height delta of the channel to several viscous length scales delta(nu). Here, the inclination angle is on the plane of the streamwise and wall-normal directions, and the sweep angle is on the plane of streamwise and spanwise directions. The results show that coherent quasi-streamwise structures in the near-wall region are composed of inclined objects with averaged inclination angle 35 degrees-45 degrees, averaged sweep angle 30 degrees-40 degrees and characteristic scale 20 delta(nu), and 'curved legs' with averaged inclination angle 20 degrees-30 degrees, averaged sweep angle 15 degrees-30 degrees and length scale 5 delta(nu)-10 delta(nu). The temporal evolution of Lagrangian structures shows increasing inclination and sweep angles with time, which may correspond to the lifting process of near-wall quasi-streamwise vortices. The large-scale structures that appear to be composed of a number of individual small-scale objects are detected using cross-correlations between Eulerian structures with large and small scales. These packets are located at the near-wall region with the typical height 0.25 delta and may extend over 10 delta in the streamwise direction in moderate-Reynolds-number, long channel flows. In addition, the effects of the Reynolds number and comparisons between Lagrangian and Eulerian structures are discussed.