Congenital heart defects (CHD) represent the most frequent congenital anomalies among newborns, as well as the leading cause of spontaneous abortion, stillbirth, neonatal and infant death. CHD have been recognized as multifactorial diseases, with environmental contaminants as potential contributors to the etiopathogenesis of CHD. Toxic elements, such as arsenic (As), cadmium (Cd), lead (Pb), and mercury (Hg) are known to be associated with adverse reproductive outcomes and certain congenital anomalies, however their association with the risk for CHD remains inconsistent. This review summarizes the updated evidence on the CHD-associated risk related to exposure to As, Cd, Hg, Pb during pregnancy, reporting the main findings from epidemiological and experimental studies and the underlying molecular mechanisms. Additionally, being diet the major source of these elements in the general population, after having identified the main vectors of toxic metals in food, possible remediation strategies to reduce diet-related risks are also described. Among these, a novel, consumer-centered approach in developing new foods is discussed, considering not only the nutritional characteristics of edible compounds foods are made up of, but also their organoleptic features, making the food even more appealing to the consumer. Overall, current data support the association of maternal exposure to As and Pb with increased risk for CHD, although significant associations have only been observed for total and/or specific subgroups. On the other hand, the evidence of association for Cd and Hg exposure in pregnancy with CHD in the offspring remains, yet, quite speculative. Further large prospective cohort studies and insights into the molecular and biomolecular processes of these relationships are warranted to further explore and/or verify these findings.