You have to play Driver: San Francisco. Only problem is actually getting it, you can't get it legally anymore, although I know a friend who knows a friend on the seven seas.To me the entire Driver series is kinda like that, with most people never making it past the first mission (and free mode being horrible in D1 as you can't lose cops or repair at all), second was too easy since wanted status reset on swapping cars, and third was broken on release.
There's also San Francisco and Parallel Lines that I never played, those have mostly positive reviews.
Driver was Grand Theft Auto before GTA 3. And sometimes less is more because minigames and shooting in GTA distract from the driving, often too much... I recently finished that garage trials several times and the first Driver keeps being hard after, it was the PS1 Battletoads, everybody wanted to play it, very few people could progress.
As for the original Driver, I haven't really played it, but Driver 2, oh man, that game is tough, although the recent ReDriver2 Decompliation did make it so much more playable, if you get that set up, then you'll have the certified 60fps ps1 style game everyone is always clamoring for! (that's what everyone clamors for, right?)
Driv3r was broken on release, yeah. Again, the mod fixes most of the bad bugs and the pc version is usually considered to be the best vanilla version afaik. Driv3r was so broken it started it's own "gate" with Driv3rgate about well, game journos being bought. (man, between driv3r, kane and lynch and a whole bunch of lesser known cases, it does make you wonder why people even had game journos up in high regards)