We present a non-intrusive gradient algorithm for parameter estimation problems in non-stationary elasticity. To avoid multiple (and potentially expensive) solutions of the underlying partial differential equation (PDE), we approximate the PDE solver by a neural network within the gradient algorithm. The network is trained offline for a given set of parameters. The algorithm is applied to an unsteady linear-elastic contact problem; its convergence and approximation properties are investigated numerically.