To describe dynamics of bulk and fluctuations near the QCD critical point we develop general relativistic fluctuation formalism for a fluid carrying baryon charge. Feedback of fluctuations modifies hydrodynamic coefficients including bulk viscosity and conductivity and introduces nonlocal and non-instantaneous terms in constitutive equations. We perform necessary ultraviolet (short-distance) renormalization to obtain cutoff independent deterministic equations suitable for numerical implementation. We use the equations to calculate the universal non-analytic small-frequency dependence of transport coefficients due to fluctuations (long-time tails). Focusing on the critical mode we show how this general formalism matches existing Hydro+ description of fluctuations near the QCD critical point and nontrivially extends it inside and outside of the critical region.