Royals, politicos, soldiers, artists, scientists, reformers and other characters who were active during the Victorian age in what was then called the United Kingdom of Britain and Ireland.
@Amilcar: Holmes doesn't really fit the theme as he's fictional. Also think there's more than one actress/mistress which could be accepted as answers. But it's an interesting selection of people.