All-solid-state lithium batteries using nonflammable solid electrolytes are widely recognized as promising candidates for next-generation energy storage because of their superior safety and fast-charging capability. However, widely studied oxide-based solid electrolytes contain heavy elements such as lanthanum and zirconium, resulting in high densities (e.g., 5.12 g/cm3) that limit improvements in overall battery gravimetric energy density.