A blueberry can grow and flower yet produce disappointing crops.
Variety matters
Southern California generally favors lower-chill blueberry cultivars. Cross-pollination between compatible cultivars can improve fruit size or yield for many types.
Also check
Consider winter chill, bloom timing, pollinator activity, pruning, soil acidity, irrigation and overall plant vigor.