Novel biodegradable and low cytotoxic poly(ester amide)s (PEAs) based on α-amino acids and (L)-lactic acid (L-LA) oligomers were successfully synthesized by interfacial polymerization. The chemical structure of the new polymers was confirmed by spectroscopic analyses. Further characterization suggests that the α-amino acid plays a critical role on the final properties of the PEA. L-phenylalanine provides PEAs with higher glass transition temperature, whereas glycine enhances the crystallinity. The hydrolytic degradation in PBS (pH = 7.4) at 37 °C also depends on the α-amino acid, being faster for glycine-based PEAs. The cytotoxic profiles using fibroblast human cells indicate that the PEAs did not elicit an acute cytotoxic effect. The strategy presented in this work opens the possibility of synthesizing biodegradable PEAs with low citotoxicity by an easy and fast method. It is worth to mention also that the properties of these materials can be fine-tuned only by changing the α-amino acid.