Utilizing phosphate more efficiently is crucial for sustainable crop production. Highly efficient rice (Oryza sativa) cultivars have been identified and this study aims to identify metabolic markers associated with P utilization efficiency. P deficiency generally reduced leaf P concentrations and CO2 assimilation rates but efficient cultivars were reducing leaf P concentrations further than inefficient ones while maintaining similar CO2 assimilation rates. Adaptive changes in carbon metabolism were detected but equally in efficient and inefficient cultivar groups. Groups furthermore did not differ with respect to partial substitutions of phospholipids by sulfo- and galactolipids. Metabolites significantly more abundant in the efficient group, such as sinapate, benzoate and glucoronate, were related to antioxidant defense and may help alleviating oxidative stress caused by P deficiency. Sugar alcohols ribitol and threitol were another marker metabolite for higher phosphate efficiency as were several amino acids, especially threonine. Since these metabolites are not known to be associated with P deficiency, they may provide novel clues for the selection of more P efficient genotypes. In conclusion, metabolite signatures detected here were not related to phosphate metabolism but rather helped P efficient lines to keep vital processes functional under the adverse conditions of P starvation.