A new action principle, in which the only gravitational variables are an SL(2,C) connection and a scalar density, is derived for general relativity (GR) coupled to matter and for supergravity. In this form, GR appears as a non-metric, generally covariant gauge theory, the metric being reconstructed from the other fields in a solution. A similar non-metric action with a real SO(3,1) connection is also derived, however it involves an independent fourth rank tensor field representing the curvature.