Examining how historical and contemporary geographic and environmental factors contribute to genetic divergence at different evolutionary scales is a central yet largely unexplored question in ecology and evolution. Here, we examine this key question by investigating how environmental and geographic factors across different epochs have driven genetic divergence at deeper (phylogeographic) and shallower (landscape genetic) evolutionary scales in the Chinese Tertiary relict tree Emmenopterys henryi. We found that geography played a predominant role at all levels phylogeographic clades are broadly geographically structured, the deepest levels of divergence are associated with major geological or pre-Quaternary climatic events, and isolation by distance (IBD) primarily explained population genetic structure. However, environmental factors are clearly also important climatic fluctuations since the Last Interglacial (LIG) have likely contributed to phylogeographic structure, and the population genetic structure (in our AFLP dataset) was partly explained by isolation by environment (IBE), which may have resulted from natural selection in environments with divergent climates. Thus, historical and contemporary geography and historical and contemporary environments have all shaped patterns of genetic structure in E. henryi, and, in fact, changes in the landscape through time have also been critical factors.