Entropy

The notion of entropy is very important in statistical physics and thermodynamics. We discuss some basic properties of entropy and why some processes are not reversible. Effectively, this irreversibility determines the direction of time. We also discuss various applications of entropy in information theory.