Saturday, October 28, 2017

BAYESIAN INTELLIGENCE ANALYSIS

Dr. Barbieri Davide of the University of Ferrara examined the Bayesian approach to intelligence analysis by first looking the the three ways of examining probability. He showed the historic approach from French mathematician Laplace with the equation P(E)=m/n. The probability as shown is the number of favorable cases divided by the number of possible cases. In this approach, he notes that the probability of an event will always be between 0 and 1. The second approach he examined was the frequentist approach, also known as the "law of large numbers. This equation divides the frequency of events by the frequency of events out of "n" trials. However, analysts do not use this approach as much because they often work with less data than what the frequentist approach requires. The third approach is the amount of confidence an analyst gives an estimate based on previous experience and available information. He also goes into conditional probability and how something is likely to happen if something else happens.

After examining  regular probability, he examines the Bayes approach to probability. He shows the conditional probability equation first to provide a comparison. This equation is P(H/E)=P(HupsidedownUE)/P(E). The Bayes approach to probability is P(H/E)=P(E/H)P(H)/P(E). P(H/E) is revised probability after reviewing evidence. P(E/H) is the conditional probability of E in case of H. P(H) is the probability without any evidence. The Bayes approach allows for the estimate to change as more information comes in.

In intelligence analysis, the equation given is R=PL with R being the estimate of conditional probability of the hypothesis H after revising evidence E. P or prior estimate times the likelihood of an event or L. He advocates that this approach is best used in strategic warning; for example the probability of a terrorist attack. This approach forces analysts to quantify their estimates and reduce cognitive bias using competing hypotheses. The weaknesses of this approach in the vulnerability to false evidence, time constraints, and limited information.

He uses historical events such as the Cuban missile crisis and the tension between Russia and China during the Cold War to show the differences between conventional probability and the Bayes approach. The estimates were the same, but the analysts using the Bayes approach arrived at their conclusions faster than the conventional analysts.

Critique: Dr. Davide was very thorough in his study of the use of Bayesian networks in intelligence analysis. However, it was a difficult read because he uses mathematical language very often. His examples were also slightly outdated. An updated version of his study would be useful in the modern intelligence field.

Dr. Barbieri Davide. https://www.researchgate.net/publication/257933578_Bayesian_Intelligence_Analysis.

 

5 comments:

  1. I agree that the study needs updated but I would also try and argue for a better method of evaluating analytic confidence. He doesn't seem to think that analysts have the ability to quantify there analytic confidence, but they do in most cases. So I agree that Bayesian would be great when applying it to intelligence studies, but in combination with current methods used for evaluating analytic confidence.

    ReplyDelete
    Replies
    1. Bayesian can provide analysts with the ability to quantify their estimates. The inability to quantify analyst's confidence leaves room for bias and makes the analyst unable to see things differently since they have to rely on past experiences in making estimates.

      Delete
  2. I agree with Matthew. Bayes should be added once other analysis was conducted to add (counter)weight to what we already found.

    Do you think the weaknesses inherent in Bayesian Statistics can weaken the analysis because they add external pressure?

    ReplyDelete
  3. The issue at hand with this methodology is that it fails to remove cognitive bias in my opinion. It remains a challenge for analysts to objectively quantify there analytic confidence. Better methodology needed.

    ReplyDelete
  4. That's attractive that Bayesian Statistics can net similar results in less time. However, as the above comments have highlighted, the issue of quantifying analytic confidence stands out to me.

    ReplyDelete