Really shouldn't be any issues. The actual off-road parts are limited to dirtbikes anyway (was originally designed as a motorcycle trail, but there's a full-size vehicle version too).
The parts I've been on are very much just country/park/forest service roads. I was in a 2WD ancient Ranger and...
Check out the Trans Wisconsin Adventure Trail. It's mostly just gravel roads, but it's a nice drive with good camping, and it starts pretty close to your area.
I haven't lived in that area in a long time, but I've been on a few sections of that, and they're quite pretty.