I live in Herefordshire and would never go near the Saracens Head - I am sure it is a lovely pub (we had a great meal there) but it was on the rope ferry outside this pub 3 years ago that I fell and sustained a very complicated fracture of my foot that has never healed and means I walk with a stick - so I never go near Symonds Yat!! And when I tried to make a claim, the people in the pub lied through their teeth in order to wriggle out of their responsibility. So.....not my favourite place!!
For self-catering try: www.farrcottages.co.uk/ or treago.co.uk/ (a castle with cottages in the grounds and a swimming pool.
For B&B try: www.bedandbreakfastinherefordshire.info/Profile_HR172-Dippersmoor-Manor-Accommodation-in-Kilpeck-Hereford or www.garwaymooninn.co.uk/
Personally I would not go for Ross-on-Wye. I know it has been bigged up, but as a local, who worked there at one time, I have to say that it does not impress me - and it has a huge drugs problem hidden beneath the chocolate box image.
Might I suggest that you widen your scope to include Hay-on-Wye - it is itself an interesting town - as you will probably know it is one vast second hand bookshop; it has a castle; and, above all else, the surrounding scenery is astounding - you have instant and easy access to the Black Mountains, whose scenery is quite stunning.
I hope you find something you like and wish you a happy holiday.