Arbuscular mycorrhizal fungi (AMF) provide essential nutrients to crops and are critically impacted by fertilization in agricultural ecosystems. Understanding shifts in AMF communities in and around crop roots under different fertilization regimes can provide important lessons for improving agricultural production and sustainability. Here, we compared the responses of AMF communities in the rhizosphere (RS) and root endosphere (ES) of wheat ( Triticum aestivum ) to different fertilization treatments: Non-fertilization (Control), mineral fertilization only (NPK), mineral fertilization plus wheat straw (NPKS), and mineral fertilization plus cow manure (NPKM). We employed high-throughput amplicon sequencing and investigated the diversity, community composition, and network structure of AMF communities to assess their responses to fertilization. Our results elucidated that AMF communities in the RS and ES respond differently to fertilization schemes. Long-term NPK application decreased the RS AMF alpha diversity significantly, whereas additional organic amendments (straw or manure) had no effect. Contrastingly, NPK fertilization increased the ES AMF alpha diversity significantly, while additional organic amendments decreased it significantly. The effect of different fertilization schemes on AMF network complexity in the RS and ES were similar to their effects on alpha diversity. Changes to AMF communities in the RS and ES correlated mainly with the pH and phosphorus level of the rhizosphere soil under long-term inorganic and organic fertilization regimes.