Welcome to the forum!
You are not alone - just the idea of driving makes me anxious!
I am a 22 year old female, and I sat my Learner's test for the first time (and thankfully passed) about three months ago. I have been for one 15 minute drive with my Dad, and I use the word "driving" loosely. It was more familiarising myself with being behind the driver's wheel! I was so nervous and would only drive really slowly in this empty byroad attached to a car park, and kept to the middle of the road. My boyfriend was encouraging and positive, and that's the reason I sat for my first written driving test. After my exams are done later this month, I have promised my Dad I will go for a weekly drive with him. I really fear the idea of driving on roads with other cars. I just don't trust myself, even though I'm cautious and sensible. I worry most about doing something wrong or hurting someone on the road. I think this may connect to my OCD, at least in part.
I also have the dilemma of needing to drive for a job I got accepted for a few weeks ago. After three months of training, I will need to get to client's houses (young kids with Autism and their parents) to run therapy sessions. At the end of the group job interview, I actually approached the lady and admitted that I didn't have my driver's licence. She said that wasn't ideal, but not the end of the world. I hope I will start to make progress with driving, but realistically I know it's going to be a slow process. I know I will get really anxious when I first drive on a road with other cars, let alone on a busy road or in heavy traffic. My parents don't push me too much, as I thankfully have made good progress in other areas of my life, despite my anxiety.
I just wanted to let you know that you are not the only person who has this problem or who fears driving. I used to feel that there were hardly any others with this problem. Last year I met a girl who was about 23 and has never sat the test for her L's. She was a friendly and responsible person, but just didn't like the idea of driving, for whatever reason.
I don't actually know of a solution to this problem. I am yet to find one! Confronting the fear in small steps is often helpful, but you have already been doing this. If you really want to overcome this, perhaps you could have a few appointments with a counsellor. Talking things through, like you have here, can really help on an emotional level.