This text is not just a presentation of mathematical theory, but also a discussion of why that theory takes its current form. It will be a secure starting point for anyone who needs to invoke rigorous probabilistic arguements and understand what they mean.