Marine fjords with active glacier outlets are hot spots for organic matter burial in the sediments and subsequent microbial mineralization, and will be increasingly important as climate warming causes more rapid glacial melt. Here, we investigated controls on microbial community assembly in sub-arctic glacier-influenced (GI) and non-glacier-influenced (NGI) marine sediments in the Godthabsfjord region, south-western Greenland. We used a correlative approach integrating 16S rRNA gene and dissimilatory sulfite reductase (dsrB) amplicon sequence data over six meters of depth with biogeochemistry, sulfur-cycling activities, and sediment ages. GI sediments were characterized by comparably high sedimentation rates and had 'young' sediment ages of <500 years even at 6 m sediment depth. In contrast, NGI stations reached ages of approximately 10,000 years at these depths. Sediment age-depth relationships, sulfate reduction rates, and C/N ratios were strongly correlated with differences in microbial community composition between GI and NGI sediments, indicating that age and diagenetic state were key drivers of microbial community assembly in subsurface sediments. Similar bacterial and archaeal communities were present in the surface sediments of all stations, whereas only in GI sediments were many surface taxa also abundant through the whole sediment core. The relative abundance of these taxa, including diverse Desulfobacteraceae members, correlated positively with sulfate reduction rates, indicating their active contributions to sulfur-cycling processes. In contrast, other surface community members, such as Desulfatiglans, Atribacteria and Chloroflexi, survived the slow sediment burial at NGI stations and dominated in the deepest sediment layers. These taxa are typical for the energy-limited marine deep biosphere and their relative abundances correlated positively with sediment age. In conclusion, our data suggests that high rates of sediment accumulation caused by glacier runoff and associated changes in biogeochemistry, promote persistence of sulfur-cycling activity and burial of a larger fraction of the surface microbial community into the deep subsurface.