On one hand, most of the criticism come from experts (for the most part deserving of the title) who complain about the score not expressing the quality of their expertise. They say the scores are just a measure of the “time you spend in Twitter”.
Yes, I think it is important to understand what is being measured: level of engagement in social media. Once we acknowledge that, I think general scores are useful and can be considered a valid dimension of “influence”.
On the other hand, if we accept it as a valid measure, a social media engagement score reflects influence only to the degree you use social media to exert it. It is not a measure of the total expertise or influence of a person.
We should take general engagement scores like Klout and PeerIndex with a grain of salt. I agree with the ones who consider the tagline “The Standard for Influence” a bit of a stretch. But every marketing slogan is a stretch.
Then this morning, Klout had a technical problem and most users saw their scores drop drastically o single digits for a couple of hours. That gives the critics the perfect opportunity to say: #fail!
The irony of the incident is that the Klout score for @klout (the user representing them in interaction with the community) will go up because there were so many people complaining about their scores (increasing volume of mentions and conversations impact the engagement score positively).
Does that event show the flaws in social media engagement scoring? (How can a negative incident increase your score?!)
Or does it simply reflect the fact that the event validated the influence of @klout (or else why would so many people check their own score early in the morning, notice the glitch, and trigger such large number of conversations?).
What do you think?