High incidences of the foodborne pathogen Listeria monocytogenes have been reported on smear cheeses, and despite increased hygiene efforts, this incidence has remained stable in recent years. Applying antilisterial strains may increase the safety of smear cheeses. To find and test antilisterial strains, we inoculated fresh soft cheeses from nine dairies with the surrogate species Listeria innocua and assessed its growth under standardized ripening conditions. Acetic acid at day 23 (r = −0.66), lactose in fresh cheese (r = −0.63), and glucose at day 10 (r = −0.62), as well as seven amplicon sequence variants (ASVs), were negatively correlated with L. innocua growth. Two of these ASVs were assigned to the genus Leuconostoc of Lactobacillaceae (r = −0.82 and −0.71). Isolates from this family, from Aerococcaceae, and Carnobacteriaceae were characterized according to their inhibitory properties, and those showing antilisterial properties were applied as protective cultures in challenge tests. The combined application of strains of Leuconostoc mesenteroides, Aerococcaceae, and Carnobacteriaceae successfully eliminated low levels of L. innocua in the final products. This is likely explained by antimicrobial compounds, including mesentericin Y105 and acetate, and competition for carbon sources and iron. This study shows a promising way to improve the safety of soft smear cheeses by applying defined protective cultures.