Shelley Alexis Duvall was born on July 7, 1949, in Fort Worth, Texas, the first child of Bobbie Ruth Crawford (née Massengale, 1929–2020), a real estate broker and in the legal field, and Robert Richardson "Bobby" Duvall (1919–1994), a cattle auctioneer-turned-lawyer. Her younger brothers were Scott, Shane, and Stewart.
For her first few years, Duvall lived in various locations throughout Texas due to her father's work, before the family settled in Houston when she was five years old. She was in a choir. She was an artistic and energetic young child, eventually earning the nickname "Manic Mouse" from her mother. Growing up, Duvall's only exposure to acting was when she forgot her lines to Joyce Kilmer's poem "Trees" in a sixth-grade talent show. She became interested in science at a young age; as a teenager she aspired to become a scientist. After graduating from Waltrip High School in 1967, she sold cosmetics at Foley's, a department store; she attended South Texas Junior College and majored in nutrition and diet therapy. Duvall dropped out of college shortly after when she witnessed a monkey vivisection.