 Firefighters expect the wildfires to last a few more days |
Governor Arnold Schwarzenegger declared a state of emergency in seven counties, with 35,000 acres (14,000 hectares) burnt from Santa Barbara to San Diego.
In Malibu, a large blaze forced stars including film director James Cameron and Olivia Newton-John to flee.
Officials say the ground is tinder dry after a record summer heatwave.
"The wildfires have caused the loss of human life and serious injuries," Mr Schwarzenegger's office said.
And with forecasters predicting hurricane-force winds to continue until later in the week, thousands more homes could be at risk, says the BBC's David Willis in California.
During a long heatwave in July, wildfires scorched thousands of acres across California, Arizona, Nevada, Utah, South Dakota, Washington, New Mexico, Oregon, Idaho and Montana.
More than 1,500 firefighters are battling the blazes, including one in the town of Potrero, near San Diego.
That fire killed one person and injured four firefighters and at least 10 other people, said Matt Streck, a spokesman for California's Department of Forestry.
It burned more than 14,000 acres (5,700 hectares) just north of the Mexican border town of Tecate, Mr Streck said.
Thousands flee
All 36,000 residents of Ramona, north-east of San Diego, were ordered to leave their homes as another blaze razed more than 5,000 acres (2,000 hectares), said San Diego sheriff's office spokesman Phillip Brust.
"I can't ever remember doing this," Mr Brust said. "This fire is crazy."
In seaside Malibu, several buildings were destroyed and thousands of local residents evacuated as flames swept across the hills overlooking the ocean.
Fanned by winds of up to 80mph (130km/h), the wildfire around Malibu had burnt about 1,250 acres (505 hectares) by mid-afternoon on Sunday (2200 GMT Sunday), officials said.
That fire is thought to have been caused by a power cable that ignited after being blown over in heavy wind.
Among the buildings destroyed in the town of 13,000 residents were the famous Castle Kashan and a Presbyterian church.
Thousands of students at nearby Pepperdine University were also evacuated.
The coastal area is home to many celebrities including Mel Gibson, Barbara Streisand, Richard Gere, Pierce Brosnan, Dick Van Dyke, Ted Danson and David Geffen.
