I always put both together as I find apricots on their own are quite sweet and the ginger takes that away and adds another dimension.
In fact I use ginger a lot in cooking/drinks/etc or just to nibble, but I buy 'naked' or UNcrystallised ginger as doesn't have the sugar coating, so if you use regular crystallised ginger you might need to reduce some of the sugar, or other sweeteners.
Have you thought of adding some walnuts, almonds or pecan nuts as well? When I make fruit bread, sometimes I make a ginger and walnut loaf, other times I use various dried fruits, but always add ginger and either walnuts or almonds.
;-)