Little Earthquakes Rarities gathers B-sides and rare material surrounding Tori Amos' 1992 debut album Little Earthquakes. The eleven pieces, among them "Upside Down", "Sweet Dreams", "Sugar", and "Flying Dutchman", were scattered across singles and compilations at the time. Together they show the songwriting Amos was developing in that early period, with voice and piano at the centre. It was the first time these tracks were collected on a single release; they came out in 2023 through Atlantic Records, in a run of 10,000 copies.

This edition is an LP on black vinyl, released for Record Store Day 2023.