The biggest risk to driving, whether it's an RV, car, or motorcycle, is just being on the highways these days. So... if you accept that risk, then the other risk add-ons aren't so significant... assuming the weather, highway condition, and the RV's drive train, tires, and brakes are in good shape.
I find that cars usually pass me, half the trucks pass me and I pass half of them, and most other RVs I pass when on a two-lane road with both lanes going my way or in uphill passing lanes. Freightliner RVs blow by me.
As to stopping frequently, count me in that group. I am sure glad to be carting my bathroom with me. Sometimes those rest area stops are too far apart!