Yes DH and I did 25 years ago when I was in my 40's and we are still going strong. If you have a good product then go for it! The main problems arise, I've found over the years, are when you take on staff and have all the regulations to contend with - very time consuming.
I would suggest joining a local business club or Chamber of Commerce. I found these to be very helpful and supportive. I knew absolutely nothing about business when I started - and 90% was export - but you soon learn and that's part of the fun of running your own company. Our roles shared out naturally with me dealing with all the admin - and I mean all - and DH doing the technical stuff as ours are high tec products. I don't think there isn't a job in admin I've not done myself - including cleaning when we moved into premises because our boxes were taking up the stairs! - and it makes me very irritated when employees think something is not their job.
At first we worked from home so you have to be very disciplined to do that - shutting the office door at night however tempting it might be to send that last email - otherwise it will take over your life!