I have been here many times and it can be busy, especially at the weekend.
Ride it early in morning if you can and then go and enjoy the less busy surrounding roads.
To be fair I have always found it less busy than the roads of southern England but compared to most of France and the passes in the Alps it is very busy.