Polystability in positive characteristic and degree lower bounds for invariant rings

We develop a representation theoretic technique for detecting closed orbits that is applicable in all characteristics. Our technique is based on Kempf's theory of optimal subgroups and we make some improvements and simplify the theory from a computational perspective. We exhibit our technique in many examples and in particular, give an algorithm to decide if a symmetric polynomial in n-variables has a closed SLn-orbit. As an important application, we prove exponential lower bounds on the maximal degree of a system of generators of invariant rings for two actions that are important from the perspective of Geometric Complexity Theory (GCT). The first is the action of SL(V) / on S-3(V)(circle plus 3), the space of 3-tuples of cubic forms, and the second is the action of SL(V) x SL(W) x SL(Z) on the tensor space (V circle times W circle times Z)(circle plus 5). In both these cases, we prove an exponential lower degree bound for a system of invariants that generate the invariant ring or that define the null cone.