You also have Carson City whose city limits border Lake Tahoe. Pierre and Bismarck are also on the Missouri River. St. Paul is also on the Mississippi River. I'm also guessing you are leaving out capitals who have the same names as rivers like Sacramento and Des Moines. Harrisburg is on the Susquehanna River if you want to add that in.