Arbuscular mycorrhizal and ectomycorrhizal symbioses are among the most important drivers of terrestrial ecosystem dynamics. Historically, the two types of symbioses have been investigated separately because arbuscular mycorrhizal and ectomycorrhizal plant species are considered to host discrete sets of fungal symbionts (i.e., arbuscular mycorrhizal and ectomycorrhizal fungi, respectively). Nonetheless, recent studies based on high-throughput DNA sequencing technologies have suggested that diverse non-mycorrhizal fungi (e.g., endophytic fungi) with broad host ranges play roles in relationships between arbuscular mycorrhizal and ectomycorrhizal plant species in forest ecosystems. By analyzing an Illumina sequencing dataset of root-associated fungi in a temperate forest in Japan, we statistically examined whether co-occurring arbuscular mycorrhizal (Chamaecyparis obtusa) and ectomycorrhizal (Pinus densiflora) plant species could share non-mycorrhizal fungal communities. Among the 919 fungal operational taxonomic units (OTUs) detected, OTUs in various taxonomic lineages were statistically designated as “generalists,” which associated commonly with both coniferous species. The list of the generalists included fungi in the genera Meliniomyces, Oidiodendron, Cladophialophora, Rhizodermea, Penicillium, and Mortierella. Meanwhile, our statistical analysis also detected fungi preferentially associated with Chamaecyparis (e.g., Pezicula) or Pinus (e.g., Neolecta). Overall, this study provides a basis for future studies on how arbuscular mycorrhizal and ectomycorrhizal plant species interactively drive community- or ecosystem-scale processes. The physiological functions of the fungi highlighted in our host-preference analysis deserve intensive investigations for understanding their roles in plant endosphere and rhizosphere.