An apparatus and system is described for storing high-pressure fluids such as hydrogen. An inner tank and pre-stressed concrete pressure vessel share the structural and/or pressure load on the inner tank. The system and apparatus provide a high performance and low cost container while mitigating hydrogen embrittlement of the metal tank. System is useful for distributing hydrogen to a power grid or to a vehicle refueling station.