In polynomial regression modeling, the use of a second order orthogonal Latin hypercube design guarantees that the estimates of the first order effects are uncorrelated to each other as well as to the estimates of the second order effects. In this paper, we prove that such designs with n runs and k > 2 columns do not exist if n equivalent to 4 mod 8. Furthermore, we prove that second order Latin hypercube designs with k >= 4 columns that guarantee the orthogonality of two -factor interactions which do not share a common factor, do not exist for even n that is not a multiple of 16. Finally, we investigate the class of symmetric orthogonal Latin hypercube designs (SOLHD), which are a special subset of second order orthogonal Latin hypercube designs. We describe construction techniques for SOLHDs with n runs and (a) k <= 4 columns, when n equivalent to 0 mod 8 or n equivalent to 1 mod 8, (b) k <= 8 columns when n equivalent to 0 mod 16 or n equivalent to 1 mod 16 and (c) k = 4 columns when n equivalent to 0 mod 16 or n equivalent to 1 mod 16, that guarantee the orthogonality of two-factor interactions which do not share a common factor. Finally, we construct and enumerate all non-isomorphic SOLHDs with n <= 17 runs and k >= 2 columns, as well as with 19 <= n <= 20 runs and k = 2 columns. (C) 2016 Elsevier Inc. All rights reserved.