Facts and Values

It is often said that science is about facts (what is) and religion is about values (what ought to be). The fact-value distinction is usually attributed to David Hume, and it is argued that the distinction has helped to protect science and the search for truth from religious biases and dogmatism. On the other hand, the distinction suggests that atheists are amoral (we have no values), although the idea that truth is important is itself a value. Is the fact-value distinction valid?

The distinction between facts and values appears to be related to the distinction between beliefs and desires: facts are what we believe to be true, whereas values are what we desire to be true. Daniel Dennett argues that we understand people using a kind of folk psychology, which he calls the intentional stance, in which agents choose actions based on their beliefs and their desires. For example, Jane enters a dark room and flips the light switch (action). We infer that she wanted light in the room (desire) and she thought that flipping the switch would turn on the lights (belief). Is the intentional stance a good model of how people think?

An interesting way to approach this question is through the field of reinforcement learning, a subfield of machine learning. This field attempts to develop algorithms that choose actions in an environment in order to maximize expected reward. In Modeling the Evolution of Motivation, Batali and Grundy show that there are environments in which it is beneficial to use an algorithm with two separate modules, one which learns to model the environment (beliefs) and another which learns to maximize rewards (desires). In other words, the distinction between belief and desire can make good sense from an engineering perspective, for certain types of environments. But their most interesting observation is that the learned model of the environment contained systematic distortions that made it easier to maximize rewards. In other words, although the modeling module was separate from the reinforcement module, the modeling module was influenced by the reinforcement module. Although it may be useful to distinguish desire from belief, it seems that desire exerts a strong influence on belief. Facts may be laden with values.

One model of how we vote in an election is that we choose the candidate whom we believe (facts) will most likely make the changes we desire (values). But George Lakoff argues that we understand political parties by metaphorically mapping them into parent-child family dynamics. The intentional stance does not adequately describe Lakoff’s model. The metaphorical mapping does not cleanly separate into fact and value.

I believe that our values (ethics, morals) have evolved, both biologically and culturally. Appealing to evolution to justify ethics is known as the naturalistic fallacy, but this fallacy is closely related to the fact-value distinction. When we start to question the fact-value distinction, the naturalistic fallacy begins to seem less fallacious. I do not think that there is a direct, simple argument from how nature is to how we should act ethically. But I do believe that science has something to say about values.

6 Responses to “Facts and Values”

  1. It’s one thing to argue the engineering merit of biased learning, its quite another to posit a theory within which learning and decision are unified. This is, in fact, the chief result of Hutter’s recent work on AIXI about which he wrote his book, “Universal Artificial Intelligence Sequential Decisions based on Algorithmic Probability”:

    “This book presents sequential decision theory from a novel algorithmic information theory perspective. While the former is suited for active agents in known environments, the latter is suited for passive prediction in unknown environments.

    The book introduces these two well-known but very different ideas and removes the limitations by unifying them to one parameter-free theory of an optimal reinforcement learning agent embedded in an arbitrary unknown environment. Most if not all AI problems can easily be formulated within this theory, which reduces the conceptual problems to pure computational ones…”

    http://www.hutter1.net/ai/uaibook.htm

  2. Interesting post, Peter. I especially agree with the main conclusion that the fact/value dichotomy is a false one. It reminds me that Lakatos et. al. have convincingly argued that the analogous distinction between “empirical fact” and “scientific theory” is a also a false one and that there is no such thing as a theory-free “empirical fact”. (Feyarabend has some nice examples in “Against Method”.)

    I also agree, of course, that being atheist doesn’t imply that you are amoral. What I’m not sure about is one of the premises: “facts are what we believe to be true, whereas values are what we desire to be true”.

    Consider the value-proposition “it is wrong to kill”. Surely I don’t merely desire it to be true that it is wrong to kill - I believe it. And what exactly do I believe when I say that? Well, that depends on the belief system on which I ground my values. If I believe in a Judeo-Christian God, then I what I believe is that killing is something that is contrary to God’s will (as written in the 10 Commandments, etc.) If I am a Buddhist then I believe that killing is imprudent because if I kill I will regret it and lead a remorseful and unhappy life (which is a rather more empirically testable belief, I might add.) But either way, I believe something to be true rather than desire it to be true.

    In any given situation, my desire not to kill may be explained by my moral belief perhaps. In the case of killing - I may desire not to kill some being or other because I don’t want to be punished by God for doing so (if I am Judeo-Christian). Or if I’m a Buddhist I may desire to be happy and believe that killing is not a successful strategy to achieve that desire. But in both cases I have a “moral belief.”

  3. Consider the value-proposition “it is wrong to kill”. Surely I don’t merely desire it to be true that it is wrong to kill - I believe it.

    What I meant was “I value X” implies “I desire a world (home, country, universe) in which there is (some, more, only) X”. Likewise, “X is morally wrong” implies “I desire a world in which there is no X”. So, if you believe that it is wrong to kill, then you desire a world in which there is no killing. That is, you wish (desire, want) people would stop killing each other.

  4. I recently read the book “Good and Real” by Gary Drescher. He was an AI researcher at MIT, more recently he has been working with Dennett. The book deals with “deriving ought from is” among other things. I am still not sure if you can do it without accepting a set of values as given.

  5. Could you spell out your position on the fact/value distinction a little more?

    Do you believe that the distinction is invalid in general, and that every fact (e.g., human beings reproduce sexually rather than asexually) is really a value? Or are you saying merely that some of what seem to be judgments of fact are judgments of value?

    If the former, I would be curious to hear how the given example, or “it is not currently raining outside my window”, are not non-value-laden facts.

  6. Could you spell out your position on the fact/value distinction a little more?

    I think it’s like black versus white. There are extreme cases that seem to be pure fact (pure black) and extreme cases that seem to be pure value (pure white). But we live most of our life in shades of gray.

    This post is related to my later post, A Scientific Approach to Morals and Ethics.

Leave a Reply