Higher derivative generalizations of translation symmetries (i.e. higher-spin-like symmetries) are utilized in this work in a novel approach to gauging, leading to a Yang-Mills-like theory defined over a symplectic manifold dubbed ”master space”. The developed theory incorporates the starting symmetries by using the Moyal product, has a weakly non-local action functional, it is perturbatively stable and admits a description in terms of an L∞ algebra. The spectrum of the theory is analyzed in terms of Wigner’s classification and to that purpose a novel unitary representation of the Lorentz group is built on the space of Hermite functions. The formulated field is massless and contains arbitrarily high helicities, while the square of the Pauli-Lubanski vector does not necessarily vanish, indicating that the model contains continuous spin field degrees of freedom. The master space and the discovered symmetry can serve to build additional gauge field models, and we explicitly provide such candidate theories. In the Yang-Mills-like model we find an additional tower of conserved currents. Further, we display how matter fields can be modeled in the master space with coupling to the Yang-Mills like model and calculate scattering amplitudes for the simplest processes. Finally, we turn our attention to the lowspin sector of the theory and find a geometric description reminiscent of teleparallelism, with the induced linear connection related to Weitzenböck’s. We apply the low-spin results to find additional general background solutions of the complete theory.