Meserimus family could work for either,

He would be vaguely disappointed in a silly or naive daughter or grand daughter, not cruel just a bit disappointed, in a family of smarties that she's a bit uninspired . There was a character, estella valenduris, who was bit like this, she or a variant of her would be an option.