Just to complicate things, and because this is like the Platonic form of a post I would make:

Cosma Shalizi is skeptical of Jaynes’ interpretation of the second law, saying it would actually imply that entropy decreases over time.

And Eliezer Yudkowsky is skeptical of Shalizi’s argument.  (See discussion here).

(I remember being confused by Shalizi’s argument when I first read it.  I should read it again.)