The lyrics borrow a complete verse from Willie Dixon's 1954 song "I Just Want to Make Love to You" (originally recorded by Muddy Waters). For this reason, the song is occasionally referred to as "Gone Daddy Gone/I Just Want to Make Love to You", as on Permanent Record: The Very Best of Violent Femmes. It features two xylophone solos.
A cover version of the song was the third single released in the United States by Gnarls Barkley, and is taken from their debut album St. Elsewhere (2006). An animated music video was also made. The cover was also used in a 2008 commercial for the movie Igor, in the TV-Series Chuck and in the 2006 game Tony Hawk's Project 8, the cover also appears in the 2007 game Forza Motorsport 2.