(figurative) people whose criticisms are regarded as irrelevant or insignificant (resembling uneducated people who throw peanuts on the stage to express displeasure with a performance)
They trigger embarrassing catcalls from the peanut gallery and a general whoever-thought-that-was-a-good-idea-in-the-first-place bewilderment.