But thanks to a bunch of rowdy guys and girls we have physics for idiots dot com. Let me link you to their thermodynamics and entropy article and be amazed:
A very weak analogy would the configurations of Rubik's cube when you're solving it. From one configuration to the final desired configuration you have a certain amount of configurations you have to go through. With each and every new state you know more about the past and future configurations.