The "Other" Entry for "Implicature" at the Stanford

by Rooij

"Optimality-Theoretic and Game-Theoretic Approaches to Implicature"

"Pragmatics," Rooij notes, "studies the interpretation of expressions in the particular contexts in which they are used."

"Perhaps the most important notion in pragmatics is Grice's (1966) notion of conversational implicature."

---- Grice introduced the neologism, 'implicature' in the Oxford lectures on Logic and Conversation, 1966. He revised the lectures for Harvard, but most of the theoretical insights as he saw fit for his Oxford audience are to be found in the original lectures: the role of modelling for example.

"It is based on the insight that by means of general principles of rational cooperative behaviour we can communicate more with the use of a sentence than the conventional semantic meaning associated with it."

"Grice argues that the exclusive interpretation of ‘or’—according to which we infer from ‘John or Mary came’ that John and Mary didn't come both—is not due to the semantic meaning of ‘or’ but should be accounted for by a theory of conversational implicatures."

"In this particular example,—a typical example of a so-called Quantity implicature—the hearer's implication is taken to follow from the fact that the speaker could have used a contrasting, and informatively stronger expression, but chose not to. Grice suggested that other implicatures follow from what the hearer thinks that the speaker takes to be the normal state of affairs. For both types of implicatures, the hearer's (pragmatic) interpretation of an expression involves what he takes to be the speaker's reason for using this expression. But obviously, this speaker's reason must involve assumptions about the hearer's reasoning as well."

Some theories of conversational implicature explicitly take the interactive reasoning of speaker and hearer into account:

(Bidirectional) Optimality Theory and
Game Theory.

1. Bidirectional Optimality Theory

1.1 Bidirectional OT and Quantity implicatures

"Optimality Theory (OT) is a linguistic theory which assumes that linguistic choices are governed by competition between a set of candidates, or alternatives."

"In standard OT (Prince & Smolensky, 1993) the optimal candidate is the one that satisfies best a set of violable constraints."

"After its success in phonology, OT has been used also in the theory of meaning."

"The original idea here was to take the candidates to be the alternative interpretations that the hearer could assign to the given expression."

"Blutner (1998, 2000) extended this original version by taking also alternative expressions, or forms, into account that the speaker could have used, but did not."

"The reference to alternative expressions/forms is standard in pragmatics to account for Quantity implicatures."

"Optimization should thus be thought of from two directions: that of the hearer, and that of the speaker."

"What is optimal, according to Blutner's Bidirectional-OT (Bi-OT), is not just interpretations with respect to forms, but rather form-interpretation pairs. In terms of a ‘better than’ relation ‘>’ between form-interpretation pairs, the pair 〈f,i〉 is said to be (strongly) optimal iff it satisfies the following two conditions:

¬∃i′ : 〈f,i′〉 > 〈f,i〉

¬∃f′ : 〈f′,i〉 > 〈f,i〉

The first condition requires that i is an optimal interpretation of form f. In Bi-OT this condition is thought of as optimization from the hearer's point of view.

Blutner proposes that 〈f,i′〉 > 〈f,i〉 iff i′ is a more likely, or stereotypical, interpretation of f than i is: P(i′ |  f ) > P(i |  f ) (where  f  denotes the semantic meaning of f, and P(B | A) the conditional probability of B given A, defined as P(A∩B)/P(A)). The second condition is taken to involve speaker's optimization: for 〈f,i〉 to be optimal for the speaker, it has to be the case that she cannot use a more optimal form f ′ to express i. 〈f ′,i〉 > 〈f,i〉 iff either (i) P(i | f ′) > P(i |  f ), or (ii) P(i | f ′) = P(i |  f ) and f ′ is a less complex form to express i than f is.

Blutner's bidirectional OT accounts for classical Quantity implicatures.

An example of such an (assumed) Quantity implicatures is the ‘exactly’-interpretation of number terms. Let us assume, with other Griceans, that number-terms semantically have an ‘at least’ meaning.[1] Still, we want to account for the intuition that the sentence “Three children came to the party” is normally interpreted as saying that Exactly three children came to the party. One way to do this is to assume that the alternative expressions that the speaker could use are of the form “(At least) n children came to the party”, while the alternative interpretations for the hearer are of type in meaning that “Exactly n children came to the party”.[2] If we then assume that the probabilities are equally distributed over the interpretations and that it is already commonly assumed that some children came, but not more than four, a bidirectional formalization gives rise to the following table, with the desired outcome.

P(i |  f ) i1 i2 i3 i4

‘one’ ⇒¼ ¼ ¼ ¼

‘two’ 0 ⇒1⁄3 1⁄3 1⁄3

‘three’ 0 0 ⇒½ ½

‘four’ 0 0 0 ⇒1


In this table the entry P(i3 | ‘two’) = 1⁄3 because P(i3 | {i2,i3,i4}) = 1⁄3. Notice that according to this reasoning ‘two’ is interpreted as ‘exactly 2’ (as indicated by an arrow) because (i) P(i2 | ‘two’) = 1⁄3 is higher than P(i2 | ‘n’) for any alternative expression ‘n’, and (ii) all other interpretations compatible with the semantic meaning of the numeral expression are blocked: there is, for instance, another expression for which i4 is a better interpretation, i.e., an interpretation with a higher conditional probability.

With numeral terms, the semantic meanings of the alternative expressions give rise to a linear order. This turns out to be crucial for the Bi-OT analysis, if we continue to take the interpretations as specific as we have done so far. Consider the following alternative answers to the question “Who came to the party?”:

John came to the party.

John or Bill came to the party.


Suppose that John and Bill are the only relevant persons and that it is presupposed that somebody came to the party. In that case the bidirectional table looks as follows (where ix is the interpretation that only x came):

P(i |  f ) ij ib ijb

‘John’ ⇒½ 0 ½

‘Bill’ 0 ⇒½ ½

‘John and Bill’ 0 0 ⇒ 1

‘John or Bill’ 1⁄3 1⁄3 1⁄3


This table correctly predicts that (1) is interpreted as saying that only John came. But now consider the disjunction (2). Intuitively, this answer should be interpreted as saying that either only John, or only Bill came: the scalar implicature. It is easy to see, however, that this is predicted only if ‘John came’ and ‘Bill came’ are not taken to be alternative forms. Bi-OT predicts that in case also ‘John came’ and ‘Bill came’ are taken to be alternatives, the disjunction is uninterpretable, because the specific interpretations ij, ib, and ijb all can be expressed better by other forms. In general, one can see that in case the semantic meanings of the alternative expressions are not linearly, but only partially ordered, the derivation of Quantity implicatures sketched above gives rise to partially wrong predictions.

As it turns out, this problem for Bi-OT seems larger than it really is. Intuitively, an answer like (2) expresses incomplete information, and to take this into account in Bi-OT (or in any other analysis of Quantity implicatures) we should allow for alternative interpretations in the table that have partial information. It can be shown that if we take the alternative interpretations to be such partial information states, what Bi-OT ends up with is the pragmatic interpretation function called ‘Grice’ in various (joint) papers of Schulz and Van Rooij (e.g. Schulz & Van Rooij, 2006). In these papers it is claimed that Grice implements the Gricean maxim of Quality and the first maxim of Quantity, and it is shown that in terms of it (together with an additional assumption of competence) we can account for many conversational implicatures, including the ones of (1) and (2).

1.2 A Bi-OT analysis of Horn's division

Bi-OT can also account for Horn's division of pragmatic labor—according to which an (un)marked expression (morphologically complex and less lexicalized) typically gets an (un)marked interpretation—which Horn (1984) claimed to follow from the interaction between both Gricean submaxims of Quantity, and the maxims of Relation and Manner.

To illustrate, consider the following well-known example:

John killed the sheriff.

John caused the sheriff to die.


We typically interpret the unmarked (3) as meaning stereotypical killing (on purpose), while the marked (4) suggests that John killed the sheriff in a more indirect way, and unintentionally. Blutner (1998, 2000) shows that this can be accounted for in his Bidirectional OT. Take ist to be the more plausible interpretation where John killed the sheriff in the stereotypical way, while i¬st is the interpretation where John caused the sheriff's death in an unusual way. Because (3) is less complex than (4), and ist is the more stereotypical interpretation compatible with the semantic meaning of (3), it is predicted that (3) is interpreted as ist. Thus, in terms of his notion of strong optimality, meaning that 〈f,i〉 is optimal both for the speaker and the hearer, Blutner can account for the intuition that sentences typically get the most plausible, or stereotypical, interpretation. In terms of this notion of optimality, however, Blutner is not able yet to explain how the more complex form (4) can have an interpretation at all, in particular, why it will be interpreted as non-stereotypical killing. The reason is that on the assumption that (4) has the same semantic meaning as (3), the stereotypical interpretation would be hearer-optimal not only for (3), but also for (4). This interpretation of (4) is blocked, however, by the cheaper alternative expression (3). To account for the intuition that (4) is interpreted in a non-stereotypical way, Blutner (2000) introduces a weaker notion of optimality. In our setup we can say that a form-interpretation pair 〈f,i〉 is weakly optimal[3] iff there is neither a strongly optimal 〈f,i′〉 such that 〈f,i′〉 > 〈f,i〉 nor a strongly optimal 〈f ′,i〉 such that 〈f ′,i〉 > 〈f,i〉. All form-interpretation pairs that are strongly optimal are also weakly optimal. However, a pair that is not strongly optimal like 〈(4),ist〉 can still be weakly optimal: because neither 〈(4),ist〉 nor 〈(3),i¬st〉 is strongly optimal, there is no objection for 〈(4),i¬st〉 to be a (weakly) optimal pair. As a result, the marked (4) will get the non-stereotypical interpretation.

2. Implicatures and Game Theory

2.1 Signaling games

David Lewis (1969) introduced signaling games to explain how messages can be used to communicate something, although these messages do not have a pre-existing meaning. In pragmatics we want to do something similar: explain what is actually communicated by an expression which actual interpretation is underspecified by its conventional semantic meaning. It is therefore a natural idea to base pragmatics on Lewisian signaling games.

A signaling game is a game of asymmetric information between a sender s and a receiver r. The sender observes the state t that s and r are in, while the receiver has to perform an action. Sender s can try to influence the action taken by r by sending a message. T is the set of states, F the set of forms, or messages. We assume that the messages already have a semantic meaning, given by the semantic interpretation function · which assigns to each form a subset of T. The sender will send a message/form in each state, a sender strategy S is thus a function from T to F. We assume that the speaker has to say something that (semantically) is true. The receiver will perform an action after hearing a message with a particular semantic meaning, but for present purposes we can think of actions simply as interpretations. Thus, a receiver strategy R is a function taking a message into an interpretation, i.e., a subset of T. We assume that the utility functions of s and r (Us and Ur) are the same (implementing Grice's cooperation principle), and that they depend on (i) the state, t that s and r are in, (ii) the receiver's interpretation, i, of the message f sent by s in t according to their respective strategies R and S, i.e., i = R(S(t)), and (iii) (in section 2.3) the message being sent in t by the sender, f = S(t). We assume that Nature picks the state according to some (commonly known) probability distribution P over T. With respect to this probability function, we can determine the expected, or average, utility of each sender-receiver strategy combination 〈S,R〉 for player e ∈ {s,r} as follows:

EUe(S,R) = ∑t∈T P(t) × Ue(t,S(t),R(S(t))).

A solution of the game is called a Nash Equilibrium.

A Nash Equilibrium of a signaling game is a pair of strategies 〈S*,R*〉 which has the property that neither the sender nor the receiver could increase his or her expected utility by unilateral deviation. Thus, S* is a best response to R* and R* is a best response to S*.

2.2 A game theoretical explanation of Horn's division

Suppose we have 2 states, tst and t¬st, and 2 messages, fu and fm. Assume that the semantic meaning of both messages is {tst,t¬st}, but that tst is more stereotypical, or probable, than t¬st: P(tst) > P(t¬st). In distinction with what we have done before, we now decompose the sender's utility function into a benefit and a cost function, Us(t,f,i) = Bs(t,i) − C(f), where i is an interpretation. We adopt the following benefit function: Bs(t,i) = 1 if i = t, and Bs(t,i) = 0 otherwise. The cost of the unmarked message fu is lower than the cost of the marked message fm. We can assume without loss of generality that C(fu) = 0 < C(fm). We also assume that it is always better to have successful communication with a costly message than unsuccessful communication with a cheap message, which means that C(fm), though greater than C(fu), must remain reasonable small. The sender and receiver strategies are as before. The combination of sender and receiver strategies that gives rise to the bijective mapping {〈tst,fu〉, 〈t¬st,fm〉} is a Nash equilibrium of this game. And this equilibrium encodes Horn's division of pragmatic labor: the unmarked (and lighter) message fu expresses the stereotypical interpretation tst, while the non-stereotypical state t¬st is expressed by the marked and costlier message fm. Unfortunately, also the mapping {〈tst,fm〉, 〈t¬st,fu〉} —where the lighter message denotes the non-stereotypical situation—is a Nash equilibrium of the game, which means that on the present implementation the standard solution concept of game theory cannot yet single out the desired outcome.

Parikh (1991, 2001) argues that to account for this problem we should adopt another, and more fine-grained, solution concept. He observes that of the two equilibria mentioned above, the first one Pareto-dominates the second, and that for this reason the former should be preferred. Van Rooij (2004) suggests that because Horn's division of pragmatic labor involves not only language use but also language organization, one should look at signaling games from an evolutionary point of view, and make use of those variants of evolutionary game theory that explain the emergence of Pareto-optimal solutions. As a third alternative, following some ideas of De Jaegher (2008), van Rooij (2008) proposes that one could also make use of forward induction to single out the desired equilibrium.

2.3 Quantity implicatures and best responses

Just like Bi-OT, also a game theoretical analysis of scalar implicatures crucially involves two players: speaker and hearer. First we assume that the hearer faces a decision problem: he wonders which action he should choose. The solution of a decision problem is simply the action (or set of actions) which has (have) the highest expected utility. In special cases, this decision problem can be the choice which world is the actual one. Now maximizing expected utility comes down to selecting those worlds which are most probable. Suppose that the hearer receives some new information. As a result, he will update his prior probability function with this new information, and maximizes his expected utility with respect to this new probability function. Thus, providing new information can influence the hearer's decision.

Consider now a better informed speaker. She knows that by providing new information, she can influence the hearer's decision. Suppose that she can only provide (by Gricean ‘quality’) true information: she cannot utter a sentence whose semantic meaning is false. Suppose also that she knows the hearer's decision problem and that she has preferences over which action the hearer might choose. As a result, she also has preferences over which information she should provide herself, because she knows that the hearer chooses by maximiz- ing utility after updating his beliefs by standard conditionalisation. On the assumption that the speaker has a set of messages F between which she can choose, she will choose that message f which is best for her: the message to which the hearer will react (with action af) in the for the speaker optimal way.

At first, it seems only natural to assume that after receiving message f, the hearer will update her information state with the semantic meaning of f, f. This does not take the strategic situation into account, though. It is assumed that the hearer does not reason about why the speaker said what she actually said. But it is exactly because of this strategic reasoning, according to Benz (2006) and Benz & van Rooij (2007), that what is implicated can go beyond what is explicitly said. Taking this strategic interaction into ac- count, the hearer will conclude that the speaker asserted f instead of any of the alternatives, because f is the message that maximizes the speaker's utility. Suppose the hearer's decision problem involves the choice which world is actual. In that case, af is simply the set of interpretations/worlds which after conditionalization with the semantic meaning of f will be most probable according to the hearer. It follows that the hearer can conclude that the speaker is in one of those worlds w such that for all alternative expressions f′: Ps(w|af) ≥ Ps(w|af), where Ps is the speaker's probability function. Given that the hearer's decision concerns worlds/interpretations and assuming that everything else equal, all wolds in af are equally probable, this means that the hearer can conclude from assertion f that the speaker is in one of those worlds w such that for all alternative expressions f′: Ps(w|f) ≥ Ps(w|f).

To illustrate this game theoretical treatment, let us look for simplicity at numerical expressions again. Take a signaling game with 4 states, or worlds, W = {w1, w2, w3, w4}, and four messages F = {‘one’,‘two’,‘three’, ‘four’}. On a neo-Gricean ‘at least’-interpretation of numerals, the meanings of the numeral expressions form an implication chain: ‘four’ ⊂ ‘three’ ⊂ ‘two’ ⊂ ‘one’. The speaker has to say something that is true. Thus, if the speaker is in w4—the situation that 4 men came to the party—, she could send all four messages, but if she is in a situation where only 1 man came, w1, she could say only that. The receiver's action is one of interpretation: he will assign an interpretation to each message. By the above reasoning, the hearer can conclude from assertion f that the speaker is in one of those worlds w such that for all alternative expressions f′: PI(w|f) ≥ PI(w|f). For all the alternative expressions, this can be given by the following table:

P(w |  f ) w1 w2 w3 w4

‘one’ ⇒¼ ¼ ¼ ¼

‘two’ 0 ⇒1/3 1/3 1/3

‘three’ 0 0 ⇒½ ½

‘four’ 0 0 0 ⇒1


Notice that what results is exactly the same as the Bi-OT solution described above. Unfortunately, this game-theoretical account of Quantity implicatures faces some of the same limitations as the Bi-OT analysis described above. But just as Bi-OT can do better, the game-theoretical analysis can be extended to overcome these limitations as well. It would be beyond the scope of this entry to describe these extensions, though.

There is one particular limitation of the above analysis which is worth mentioning, however. This limitation involves the treatment of free-choice permission sentences like ‘You may take an apple or a pear’. Intuitively, from the utterance of such a sentence the hearer can conclude that he may take an apple and that she may take a pear. This does not come out as an implicature, if we apply the above reasoning. This can be seen from the following table:

Ps(w |  f ) w◊φ∧¬◊ψ w¬◊φ∧◊ψ w◊φ∧◊ψ

◊φ ⇒½ 0 ⇒½

◊ψ 0 ⇒½ ⇒½

◊(φ∨ψ) 1/3 1/3 1/3


The important thing to note is that according to our above reasoning, no speaker (a speaker in no world) would ever utter ◊(φ∨ψ). Still, this is exactly the message that was uttered and should be interpreted, so we obviously missed something. Franke (2009) proposes that what we missed is that our interactive reasoning didn't go far enough. We should not just assume that the hearer can take into account the sophisticated reasoning of the speaker, but also that the speaker can take the hearer's sophisticated reasoning into account as well, and so on. We end up with a Best-Response Dynamics (see also Ebert and Jäger (2009)) according to which pragmatic interpretation is identified with the fixed point (if there is one) of this interactive reasoning. Franke (2009) shows that, among others, free choice permission sentences can in this way be given a natural interpretation.

Conclusion

"Bidirectional Optimality Theory and Game Theory are quite natural, and similar, frameworks to account for some basic conversational implicatures."

"It was noted that straightforward applications of these frameworks are sometimes not general enough and may depend on unnatural assumptions, but that these limitations can be overcome by making appropriate generalizations."

"The examples discussed above were limited, but central."

"Other implicatures not discussed at all here involve truthfulness, politeness, and manner of speech."

"Game Theoretical accounts of such implicatures have been proposed as well, but it would be beyond the scope of this entry to go into any of these proposals."

REFERENCES

Benz, A.

Utility and relevance of answers

In A. Benz, G. Jäger and R. van Rooij (eds.), Game Theory and Pragmatics, Palgrave McMillan, pp. 195–214.

---- & R. van Rooij (2007),

Optimal Assertions, and what they implicate. A uniform game theoretic approach’,
Topoi

Blutner, R.
Lexical Pragmatics’, Journal of Semantics, 15

---
Some aspects of optimality in natural language interpretation’, Journal of Semantics, 17: 189–216.

Ebert, C. and G. Jäger (2009), ‘Pragmatic Rationalizability’. in In A. Riester and T. Solstand (eds.), Proceedings of Sinn und Bedeutung 14, SFB 732, vol. 5, University of Stuttgart, 1–15.

Franke, M. (2009), ‘Signal to Act’, PhD dissertation, University of Amsterdam

Gazdar, G. (1979), Pragmatics, Academic Press, London.

Grice, H. P. 1941. Personal identity. Mind.
-- 1948. Meaning.
-- 1949. Disposition and intention.
-- 1961. The causal theory of perception.
-- 1966. Logic and conversation. The Oxford lectures.
-- 1967. Logic and conversation. The William James Lectures, Harvard University, reprinted in Studies in the Way of Words, 1989, Harvard University Press, Cambridge, Massachusetts.
-- 1987. Retrospective epilogue, to WoW.
-- 1989. Studies in the way of words.
-- 2001. Aspects of reason.

Horn, L.
Towards a new taxonomy of pragmatic inference: Q-based and R-based implicature’. In: D. Schiffrin (ed.), Meaning, Form, and Use in Context: Linguistic Applications, GURT84, 11–42, Washington; Georgetown University Press.
---- A brief history of negation.

De Jaegher, K. (2008), ‘The evolution of Horn's rule’, Journal of Economic Methodology, 15: 275–284.

Lewis, D. (1969), Convention, Cambridge: Harvard University Press.

Parikh, P. (1991), ‘Communication and strategic inference’, Linguistics and Philosophy, 14: 473–513.

--- The use of Language, CSLI Publications, Stanford, California.

Prince, A. and P. Smolensky, (1993), Optimality Theory. Constraint interaction in generative grammar, MIT Press, Cambridge, Mass.

Rooij, R. van (2004), ‘Signalling games select Horn strategies’, Linguistics and Philosophy, 27: 493–527.

Schulz, K., and R. van Rooij (2006), ‘Pragmatic meaning and non-monotonic reasoning: the case of exhaustive interpretation’, Linguistics and Philosophy, 29: 205–250.

R. van Rooij (2008), ‘Game Theory and Quantity Implicatures’, Journal of Economic Methodology, 15: 261–274.

Because Optimality Theoretic and Game Theoretic approaches to Pragmatics are relatively young, still practiced only by a small number of researchers, most of the relevant (published or unpublished) articles, or pointers to them, can be be found on the internet. For further details, one could perhaps best have a look at the home pages of

Nicholas Asher,
Anton Benz,
Reinhard Blutner,
Michael Franke,
Gerhard Jäger,
Prashant Parikh,
Robert van Rooij, and
Henk Zeevat.

Related Entries

defaults in semantics and pragmatics | game theory | Grice, Paul | implicature | logic: and games | pragmatics