The British colony originally set up as a penal colony was World History Chapter 10 The British colony originally set up as a penal colony was a. Ulster b. Nunavut c. Australia d. Upper Canada Answer: c Learn More : Share this Share on FacebookTweet on TwitterPlus on Google+