The soil needs improving, Mary. Struggling, weak plants are vulnerable to aphids. Ants can destroy the roots. Add as much compost and rotted manure to the soil as you can, every year.
When I began gardening, years ago, the ground was heavy clay which cracked and set like iron in dry weather. Out of every three newly purchased plants, one would just about survive. I learned eventually that it was better to buy only one plant plus a grow bag. The whole grow bag compost was added to the area where the one plant was to live.
Buy/make as much compost as you can, perhaps you can get hold of free manure - it's often possible. Stables are usually only too glad to give it away. Not a measly thin layer, you need about six inches all over every year for several years. Worms will return and soon you'll find you have wonderful, crumbly soil where plants can thrive. Given the dire condition of your soil, best to apply compost now and again in the spring to get off to a good start next season.
For the ants, there are biological remedies - nematodes. I have used nematodes for controlling slugs before - excellent results - so assume they would be equally effective for ants. Nematodes are pest specific so you'll need to order the right sort (online). Probably better to apply next year now because they don't thrive in cold temperatures.
Birds don't usually eat ants but love fat juicy ant larvae. However, these are hidden underground so are usually safe from birds.