"There was a beach house we used to stay at that belongs to our neighbor's family, which Steven's house in the show is based ...