soil contaminants shouldnt be an issue with trees. that is verified by my program existing because the government doesnt mess around with risk. we have very strict protocols requiring testing, remediation plans, and/ or circumvention (like raised beds) for anyone trying to garden.
im mostly tasked with planting "natives", so paw paw, american persimmon, serviceberry, hazelnuts, etc which largely don't need sprayed. higher maintenance species like apples, peaches and soforth get care until fruiting and then we let them go. generally they do fine, we dont need to make grocery store quality. usually non profit groups do big harvests and process them into products to donate to food banks.
i also plant a lot of elderberry by request. thats the exception because people need to know about the trace amounts of cyanide that needs cooked out before eating. i tell them, but no one listens.
im on the east coast.