We analyze discrete optimal control problems and their connection with back propagation and deep learning. We consider in particular the symmetric representation of the discrete rigid body equations developed via optimal control analysis and optimal flows on adjoint orbits