Keep Moving was the fifth Madness studio album and the last with keyboard player Mike Barson, who left the band shortly afterwards. The recordings lean more heavily on horns and soul than the early ska material. Its best known song is Michael Caine, on which the actor speaks his own name. One Better Day closes the album with a quiet portrait of two homeless people around Arlington House in Camden, the neighbourhood the band came from. Clive Langer and Alan Winstanley produced once again. The album originally appeared in 1984 on Stiff Records.

This edition is an LP.