Writing · Archive

When Ego Kills Innovation: The Case for Conscious Collaboration and Idea Mining

The way the problem is usually described, innovation dies because a dominant personality in the room drowns out quieter voices. The solution, on this account, is cultural: build psychological safety, reward dissent, hire leaders who listen. There is something in this, but it misses the more fundamental mechanism. Innovation does not primarily fail because of what happens in the room. It fails in transit, long before the room.

By the time an idea reaches the meeting where decisions get made, it has typically been edited multiple times. The person who had it decided whether to mention it at all. If they did, they shaped it to fit what they thought would be well received. Their manager filtered it again before passing it up. Each stage of transmission carries loss, and the loss is not random: it systematically removes ideas that do not resemble what the current leadership expects, ideas from parts of the organisation that do not have established credibility, and ideas that challenge the direction already committed to.

Where the ideas actually originate

The most operationally valuable ideas in any organisation tend to come from the edges: the people who handle customer interactions directly, who operate the product in the field, who sit at the junction between teams where friction accumulates. Those people accumulate knowledge about what is actually happening, as opposed to what the plan says is happening, in a way that is rarely matched by those further from the operational front.

The same distribution applies to innovation more broadly. New approaches are more likely to come from people who have direct experience of the current approach failing than from people removed from those failure modes. The engineer who has spent years working around a constraint knows more about how to eliminate it than the strategy team working from abstracted data. The customer-facing team knows more about unmet needs than the product team working from aggregated survey results.

None of that knowledge enters the decision process automatically. It has to travel, and travel is where it gets lost.

What Conscious Collaboration and Idea Mining address

The Idea Mining framework I developed in 2018 is a response to the transit problem, not the room problem. Its starting assumption is that organisations already contain the ideas they need. The problem is not generation but extraction: building the mechanisms that allow distributed knowledge to surface and reach the people who can act on it.

This requires two things working together. Conscious Collaboration establishes the conditions, the deliberate inclusion of the full range of perspectives, the structured evaluation of ideas against their content rather than the stature of their source, the explicit creation of channels that do not depend on voluntary self-advocacy from people without established credibility. Idea Mining provides the method: the systematic drilling across functions and into operational layers to surface what the standard channels do not carry.

The two approaches address what strong personalities and dominant voices cannot, even well-intentioned ones. A leader who genuinely wants to hear dissenting views still cannot hear what never travels far enough to reach them. The structural problem requires a structural answer.

What changes in practice

Organisations that have worked through this genuinely find that the ideas were there. The operational insight that would have saved six months of rework was known to three people in the field who had no effective route to the product team. The competitive threat that materialised as a surprise had been noticed by customer service for two years. The failure mode that turned into a recall had been flagged by a junior engineer and filed as low priority.

The goal of combining Conscious Collaboration with Idea Mining is not to manage personalities differently. It is to build the connective tissue that lets distributed knowledge flow to where it can be used, before events prove what it was worth.

© 2024 Catherine Ives-Yim. All rights reserved.

Catherine Ives-Yim

Catherine Ives-Yim

Chartered Engineer and independent technical adviser, with a lifetime at the bleeding edge of embedded systems, connected products, data platforms and AI-assisted engineering, who has advised clients across the UK, Europe, the Middle East, the Far East, North America and Africa. Based in Leeds.