Dreyfuss was born in Brooklyn, New York, the son of Geraldine Dreyfus (née Robbins; 1921–2000), a peace activist, and Norman Dreyfus (1920–2013), an attorney and restaurateur, and was raised in the Bayside area of Queens, New York. His family is Jewish. He has commented that he "grew up thinking that Alfred Dreyfus and [he] are from the same family. " His father disliked New York, and moved the family first to Europe,[clarification needed] and later to Los Angeles, California, when Dreyfuss was nine. Dreyfuss attended Beverly Hills High School.