ZenPundit
Monday, August 20, 2007
JUDGMENT DAY
An interesting confluence of information has crossed my computer screen in the last 24 hours.
Fabius Maximus was kind enough to send me a PDF, "Cognitive biases potentially affecting judgment of global risks" by Eliezer Yudkowsky, Singularity Institute for Artificial Intelligence. It's a very interesting paper on analytical thinking - or s even though a number of the points made by Yudkowsky I have seen previously made elsewhere ( the blogosphere revels in hyperactive disconfirmation biases). Their central cognitive philosophy - "....the one whom you must watch above all is yourself", is spot on.
Secondly, over at Kent's Imperative, one of the Kentians, let's call them "Most Formal Prose Kent" had a highly congruent post to the Yudkowsky paper, "The sins of analytic methodologists ":
"There is an increasingly common conceit that reliance on the analyst - subject to, cognitive bias, information overload, and human fallibility – can be engineered out of the process of doing intelligence. Instead, certain methodologists would substitute organizational structures, workflow re-organization, and the introduction of supposedly superior quantitative metrics in order to create a new standard for “answers”. The underlying thrust of these efforts is to reform intelligence activities towards a more “repeatable” process, often described by industrial or scientific metaphors such “foundry” or “lab”. These typically originate from the engineering and technical intelligence disciplines, and are usually directed as criticism of typical all source efforts – particularly those grounded in social science fields or qualitative methodology.
...The fundamental flaw in many of these methodologists' efforts is that they are essentially reductionist attempts to force the difficult and oft-times messy art of intelligence entirely into the narrow box of its scientific side. While there is a place for scientific approaches, particularly in the grounding and validation of assessment, the inherently creative, non-linear, and even non-rational elements of the profession can never be completely discarded. Most recent intelligence failures have occurred, not due to a lack of precision in judgment, but from a lack of imagination in identifying, describing, and forecasting the uncertain dynamics and emerging complexities of fast-changing accounts."
Sagely described.
Clear thinking is difficult. Few of us begin by checking our premises or, sadly, our facts. Even in the domain of the concrete and verifiable factual information, so much rides on our implicit opinion of what exactly, in terms of data points, constitutes a " fact" that we are usually off-base before we begin. Even if we are cognizant of these variables from the inception of forming a question, we might be horrified to discover, with some dogged investigation of the finer details, how fuzzy at the margins that even our peer-reviewed, "valid and reliable", facts can be - much less the breezy assertions delivered by the MSM.
Then, more to the point of the KI post, there is the hasty selection of particular, reductionist analytical tools that a priori blind us to the nature of the emergent unknown that we are trying to understand. We become prisoners of our chosen perspective. One problem with human perception is that there is no guarantee, having recognized the existence of a novel dynamic phenomena, that our perception represents the most significant aspect of it. Much like conceptualizing an Elephant in motion from blind contact with it's eyelashes. Or it's feces.
Human nature is a perpetual rush to judgment. We must rise above that.
An interesting confluence of information has crossed my computer screen in the last 24 hours.
Fabius Maximus was kind enough to send me a PDF, "Cognitive biases potentially affecting judgment of global risks" by Eliezer Yudkowsky, Singularity Institute for Artificial Intelligence. It's a very interesting paper on analytical thinking - or s even though a number of the points made by Yudkowsky I have seen previously made elsewhere ( the blogosphere revels in hyperactive disconfirmation biases). Their central cognitive philosophy - "....the one whom you must watch above all is yourself", is spot on.
Secondly, over at Kent's Imperative, one of the Kentians, let's call them "Most Formal Prose Kent" had a highly congruent post to the Yudkowsky paper, "The sins of analytic methodologists ":
"There is an increasingly common conceit that reliance on the analyst - subject to, cognitive bias, information overload, and human fallibility – can be engineered out of the process of doing intelligence. Instead, certain methodologists would substitute organizational structures, workflow re-organization, and the introduction of supposedly superior quantitative metrics in order to create a new standard for “answers”. The underlying thrust of these efforts is to reform intelligence activities towards a more “repeatable” process, often described by industrial or scientific metaphors such “foundry” or “lab”. These typically originate from the engineering and technical intelligence disciplines, and are usually directed as criticism of typical all source efforts – particularly those grounded in social science fields or qualitative methodology.
...The fundamental flaw in many of these methodologists' efforts is that they are essentially reductionist attempts to force the difficult and oft-times messy art of intelligence entirely into the narrow box of its scientific side. While there is a place for scientific approaches, particularly in the grounding and validation of assessment, the inherently creative, non-linear, and even non-rational elements of the profession can never be completely discarded. Most recent intelligence failures have occurred, not due to a lack of precision in judgment, but from a lack of imagination in identifying, describing, and forecasting the uncertain dynamics and emerging complexities of fast-changing accounts."
Sagely described.
Clear thinking is difficult. Few of us begin by checking our premises or, sadly, our facts. Even in the domain of the concrete and verifiable factual information, so much rides on our implicit opinion of what exactly, in terms of data points, constitutes a " fact" that we are usually off-base before we begin. Even if we are cognizant of these variables from the inception of forming a question, we might be horrified to discover, with some dogged investigation of the finer details, how fuzzy at the margins that even our peer-reviewed, "valid and reliable", facts can be - much less the breezy assertions delivered by the MSM.
Then, more to the point of the KI post, there is the hasty selection of particular, reductionist analytical tools that a priori blind us to the nature of the emergent unknown that we are trying to understand. We become prisoners of our chosen perspective. One problem with human perception is that there is no guarantee, having recognized the existence of a novel dynamic phenomena, that our perception represents the most significant aspect of it. Much like conceptualizing an Elephant in motion from blind contact with it's eyelashes. Or it's feces.
Human nature is a perpetual rush to judgment. We must rise above that.
Labels: analytic, bias, cognition, counterintuitive, fabius maximus, gaussian, IC, insight, intelligence, kent's imperative, psychology
¶ 7:08 PM 0 comments
Wednesday, February 14, 2007
ON BIAS AND THINKING
I'd like to juxtapose a couple of interesting posts that I have read this week that have bearing on how we select information that subsequently shapes our thoughts.
At Complexity and Social Networks Blog, Maria Binz-Scharf asks "How does the way we process information relate to how we search for it?". A key excerpt:
"Some days ago I attended a talk on human information processing by Thomas Mussweiler from the University of Cologne who spoke at the Columbia Business School. Mussweiler and colleagues conducted an impressive number of experiments on the mechanisms and influences of individual information processing. A simple example would be to ask you to determine your best athletic performance. You have two basic options: 1) You think of every single athletic moment in your life, i.e. you engage in absolute information processing, or 2) you compare what you recollect as some of your best performances to a given standard, e.g. a famous athlete’s performance (or a famous couch potato’s performance). Not surprisingly it turns out that comparison allows to process information in a more efficient manner.
Mussweiler went on to talk about various factors that influence the comparisons we make, most importantly the standards we employ for comparing information. His experiments used a technique called “priming” to activate certain standards – for example, subjects were asked to judge a trait in a person. The result shows that priming a trait concept (such as aggressiveness) will induce the subject to judge the target person according to that trait. In other words, once activated, standards are spontaneously compared to the target person."
This is very interesting. "Priming" would be an efficiency mechanism for rapid mental screening of a large number of things. It is also a "bias mechanism" that would strongly predispose you to see some evidence of what pattern you are looking for, even if it does not exist. It would be very much like the " Framing" of George Lakoff in its effect.
How to deal with that effect, our own unintentional biases or being targeted by zealous Lakoffian framers ? Metacognition might be a helpful technique, as suggested in the post "Strategic Learning: Metacognition and Metamemory" at The Eide Neurolearning Blog . The Drs. Edie write:
"High level strategic learning often requires constant self-regulation and error monitoring strategies, metacognition (thinking about the thought processes), sometimes specific memory techniques (metamemory or conscious thinking about memory)."
Such self-regulative monitoring provides a mental check against racing ahead with a dubious but attractive premise. It would also tend to derail the the likelihood of the amygdala becoming overly engaged in the heat of the argument and turning us into red-faced, sputtering, arm-waving, buffoons with a surge of emotionality.
Cross-posted to Chicago Boyz
I'd like to juxtapose a couple of interesting posts that I have read this week that have bearing on how we select information that subsequently shapes our thoughts.
At Complexity and Social Networks Blog, Maria Binz-Scharf asks "How does the way we process information relate to how we search for it?". A key excerpt:
"Some days ago I attended a talk on human information processing by Thomas Mussweiler from the University of Cologne who spoke at the Columbia Business School. Mussweiler and colleagues conducted an impressive number of experiments on the mechanisms and influences of individual information processing. A simple example would be to ask you to determine your best athletic performance. You have two basic options: 1) You think of every single athletic moment in your life, i.e. you engage in absolute information processing, or 2) you compare what you recollect as some of your best performances to a given standard, e.g. a famous athlete’s performance (or a famous couch potato’s performance). Not surprisingly it turns out that comparison allows to process information in a more efficient manner.
Mussweiler went on to talk about various factors that influence the comparisons we make, most importantly the standards we employ for comparing information. His experiments used a technique called “priming” to activate certain standards – for example, subjects were asked to judge a trait in a person. The result shows that priming a trait concept (such as aggressiveness) will induce the subject to judge the target person according to that trait. In other words, once activated, standards are spontaneously compared to the target person."
This is very interesting. "Priming" would be an efficiency mechanism for rapid mental screening of a large number of things. It is also a "bias mechanism" that would strongly predispose you to see some evidence of what pattern you are looking for, even if it does not exist. It would be very much like the " Framing" of George Lakoff in its effect.
How to deal with that effect, our own unintentional biases or being targeted by zealous Lakoffian framers ? Metacognition might be a helpful technique, as suggested in the post "Strategic Learning: Metacognition and Metamemory" at The Eide Neurolearning Blog . The Drs. Edie write:
"High level strategic learning often requires constant self-regulation and error monitoring strategies, metacognition (thinking about the thought processes), sometimes specific memory techniques (metamemory or conscious thinking about memory)."
Such self-regulative monitoring provides a mental check against racing ahead with a dubious but attractive premise. It would also tend to derail the the likelihood of the amygdala becoming overly engaged in the heat of the argument and turning us into red-faced, sputtering, arm-waving, buffoons with a surge of emotionality.
Cross-posted to Chicago Boyz
Labels: bias, binz-scharf, cognition, eide, emotion, framing, horizontal thinking, intelligence, priming
¶ 7:47 PM 4 comments
