I feel that. I've had it happen a few times via uber. It's creepy and scary to have a guy hitting on you, asking for your number. I'm always alone, and essentially my life is in his hands if I piss him off. He can easily kick me onto the highway or crash, etc. No phone call to police can save me. I just play along and pretend until I get to my destination, then report them.
My worst experience was when I took the cab, it was dark by then, and like usual the cab came except this time the driver insisted on taking shortcuts through unknown alleys and streets. All the while my mind was making the worst possible scenarios. Then he dropped me off 3 turns away from my local street saying I put in the wrong location(which by the way never happened. I'd had booked cabs before too).
So I was dropped at a remote crossroad. I even told him that I'd pay more just drop me at my address but he was adamant. Then he pointed out at the wrong direction from my address(a street with rarely had any pedestrians) saying I should walk there to get an auto to go back. By that point I was so scared that I just grabbed my book bag and walked to some crowded street with decent traffic to hire an auto back home