Filling a company's board of directors with lightweights can hurt the value of the stock according to James Drury of Drury Partners.