Chapter 6 of Spiegel (1992) provides a clear yet elementary introduction
to the basic concepts of probability together with many good examples.
Chapter 2 of Wilks (1995) also presents a good introduction to probability
with examples taken from meteorological situations.
An interesting review of the history of probability and risk can be
found in the popular book by David (1962)