There's a different sort ofdroughtplaguing California, the nation's largest farm state. It's $38 billion agricultural sector is facing a scarcity of labor.

"This year is the worst it's been, ever," said Craig Underwood, who farms everything from strawberries to lemons to peppers, carrots, and turnips in Ventura County.

Some crops aren't get picked this season due to a lack of workers.

"We just left them in the field," he said.

The Western Growers Association told CNBC its members are reporting a 20 percent drop in laborers this year. Stronger border controls are keeping workers from crossing into the U.S. illegally, and the current guest worker program is not providing enough bodies. (Related:Massive US Drought Leads to Worst Fears for Corn Crop.)

"We have 100 fewer people this year," said Sergio Diaz, who provides workers under contract for growers. "We're having difficulty finding people to do this work."

The lack of workers is forcing farmers to pay more. In one of Underwood's fields, pickers are harvesting peppers for $9.25 a hour, or $5 a bucket, whichever is more. Craig Underwood said his workforce is aging and starting to retire, and no one is coming in to replace them. (Related:Recession-Proof Industries.)

Jane Wells
CNBC Reporter

"Migratory flows between Mexico and the United States have come to a halt," Carlos Gonzalez Gutierrez, consul general of Mexico in Sacramento, told a California farm bureau labor committee, according toAgAlert.

Growers of California's wine grapes are concerned there won't be enough pickers for this fall's harvest. Berry growers — among the highest paying — saw fewer field hands show up in the spring.

"Fruit that you should be picking is not being picked," said grower John Eiskamp.

Most pickers in California are not here legally, a fact of life for decades.

When asked if any local residents have come out to apply to work in the fields, Craig Underwood replied, "None. Absolutely none." He is even having trouble finding truck drivers and other semi-skilled labor for jobs that pay $12-$18 an hour. (Related:America's Top States for Job Creation.)

The industry lost many workers tohome constructionduring the housing boom, but those workers have not returned.

"The downturn should be helping us," Underwood said.

He wishes the labor dilemma, which extends beyond California, would get the attention of the presidential campaign, but it hasn't. (Related:Election 2012: Your Money, Your Vote.)

While standing in a field of peppers, Underwood realizes even if he doesn't have enough labor to pick his crop, Americans will still have food.

"It'll just be grown in Mexico," he said. "Or China."

—By CNBC's Jane Wells