BioFormed in spring 2004, just as the Libertines were beginning to fall apart, Baby Shambles became the main vessel for Pete Doherty's poetic, chaotic rock when he was ousted from the Libertines for his increasing drug use and erratic behavior. Baby Shambles released their self-titled debut 7" in April 2004, and settled on the lineup of Doherty, guitarist Patrick Walden, bassist Drew McConnell, and drummer Gemma Clarke by that summer. That fall, things went relatively smoothly for the band, with a sold-out U.K. tour and the release of a second single, Kilamangiro, on the Libertines' former label, Rough Trade. But by December, the band had to cancel or halt shows because Doherty was unable to perform; one of these sudden cancellations sparked a riot at the London Astoria. Clarke left the band early in 2005 and was replaced with new drummer Adam Ficek.
Despite the band's ongoing tumult -- which included Doherty's arrest for allegedly assaulting and blackmailing documentarian Max Carlish (these charges were dropped that spring) - Baby Shambles began work on their first album. Teaming up with former Libertines producer Mick Jones, the band worked on the album through the spring and summer of 2005 and released the single Fuck Forever that August as a teaser for the full-length. Down in Albion was released in the U.K. that fall and Baby Shambles toured in support of it, although the band canceled almost as many gigs as it actually performed. Doherty's wild behavior continued and his numerous run-ins with the law, which included being held on suspicion of stealing a car and possession of class A drugs in early 2006 and being arrested three times in one day, made Baby Shambles' existence as perilous as ever. Down in Albion was released in the U.S. that spring.