View source for Theory of conjoint measurement

{{short description|General, formal theory of continuous quantity}}
The '''theory of conjoint measurement''' (also known as '''conjoint measurement''' or '''additive conjoint measurement''') is a general, formal theory of continuous [[quantity]]. It was independently discovered by the French economist [[Gérard Debreu]] (1960) and by the American mathematical psychologist [[R. Duncan Luce]] and statistician [[John Tukey]] {{harv|Luce|Tukey|1964}}.

The theory concerns the situation where at least two natural attributes, ''A'' and ''X'', non-interactively relate to a third attribute, ''P''. It is not required that ''A'', ''X'' or ''P'' are known to be quantities. Via specific relations between the levels of ''P'', it can be established that ''P'', ''A'' and ''X'' are continuous quantities. Hence the theory of conjoint measurement can be used to quantify attributes in empirical circumstances where it is not possible to combine the levels of the attributes using a side-by-side operation or [[Concatenation (mathematics)|concatenation]]. The quantification of psychological attributes such as attitudes, cognitive abilities and utility is therefore logically plausible. This means that the scientific measurement of psychological attributes is possible. That is, like physical quantities, a magnitude of a psychological quantity may possibly be expressed as the product of a [[real number]] and a unit magnitude.

Application of the theory of conjoint measurement in psychology, however, has been limited. It has been argued that this is due to the high level of formal mathematics involved (e.g., {{harvnb|Cliff|1992}}) and that the theory cannot account for the "noisy" data typically discovered in psychological research (e.g., {{harvnb|Perline|Wright|Wainer|1979}}). It has been argued that the [[Rasch model]] is a stochastic variant of the theory of conjoint measurement (e.g., {{harvnb|Brogden|1977}}; {{harvnb|Embretson|Reise|2000}}; {{harvnb|Fischer|1995}}; {{harvnb|Keats|1967}}; {{harvnb|Kline|1998}}; {{harvnb|Scheiblechner|1999}}), however, this has been disputed (e.g., Karabatsos, 2001; Kyngdon, 2008). Order restricted methods for conducting probabilistic tests of the cancellation axioms of conjoint measurement have been developed in the past decade (e.g., Karabatsos, 2001; Davis-Stober, 2009).

The theory of conjoint measurement is (different but) related to [[conjoint analysis (marketing)|conjoint analysis]], which is a statistical-experiments methodology employed in [[marketing]] to estimate the parameters of additive utility functions. Different multi-attribute stimuli are presented to respondents, and different methods are used to measure their preferences about the presented stimuli. The coefficients of the utility function are estimated using alternative regression-based tools.

==Historical overview==
In the 1930s, the [[British Association for the Advancement of Science]] established the Ferguson Committee to investigate the possibility of psychological attributes being measured scientifically. The British physicist and measurement theorist [[Norman Robert Campbell]] was an influential member of the committee. In its Final Report (Ferguson, ''et al.'', 1940), Campbell and the Committee concluded that because psychological attributes were not capable of sustaining concatenation operations, such attributes could not be continuous quantities. Therefore, they could not be measured scientifically. This had important ramifications for psychology, the most significant of these being the creation in 1946 of the ''operational theory of measurement'' by Harvard psychologist [[Stanley Smith Stevens]]. Stevens' non-scientific theory of measurement is widely held as definitive in psychology and the behavioural sciences generally {{harv|Michell|1999}}.

Whilst the German mathematician [[Otto Hölder]] (1901) anticipated features of the theory of conjoint measurement, it was not until the publication of Luce & Tukey's seminal 1964 paper that the theory received its first complete exposition. Luce & Tukey's presentation was algebraic and is therefore considered more general than Debreu's (1960) [[topological]] work, the latter being a special case of the former {{harv|Luce|Suppes|2002}}. In the first article of the inaugural issue of the ''Journal of Mathematical Psychology'', {{harvnb|Luce|Tukey|1964}} proved that via the theory of conjoint measurement, attributes not capable of concatenation could be quantified. N.R. Campbell and the Ferguson Committee were thus proven wrong. That a given psychological attribute is a continuous quantity is a logically coherent and empirically testable hypothesis.

Appearing in the next issue of the same journal were important papers by [[Dana Scott]] (1964), who proposed a hierarchy of cancellation conditions for the indirect testing of the solvability and Archimedean [[axioms]], and David Krantz (1964) who connected the Luce & Tukey work to that of Hölder (1901).

Work soon focused on extending the theory of conjoint measurement to involve more than just two attributes. {{harvnb|Krantz|1968}} and [[Amos Tversky]] (1967) developed what became known as [[polynomial conjoint measurement]], with {{harvnb|Krantz|1968}} providing a schema with which to construct conjoint measurement structures of three or more attributes. Later, the theory of conjoint measurement (in its two variable, polynomial and ''n''-component forms) received a thorough and highly technical treatment with the publication of the first volume of ''Foundations of Measurement'', which Krantz, Luce, Tversky and philosopher [[Patrick Suppes]] cowrote {{harv|Krantz|Luce|Suppes|Tversky|1971}}.

Shortly after the publication of Krantz, et al., (1971), work focused upon developing an "error theory" for the theory of conjoint measurement. Studies were conducted into the number of conjoint arrays that supported only single cancellation and both single and double cancellation ({{harvnb|Arbuckle|Larimer|1976}}; {{harvnb|McClelland|1977}}). Later enumeration studies focused on polynomial conjoint measurement ({{harvnb|Karabatsos|Ullrich|2002}}; {{harvnb|Ullrich|Wilson|1993}}). These studies found that it is highly unlikely that the axioms of the theory of conjoint measurement are satisfied at random, provided that more than three levels of at least one of the component attributes has been identified.

Joel Michell (1988) later identified that the "no test" class of tests of the double cancellation axiom was empty. Any instance of double cancellation is thus either an acceptance or a rejection of the axiom. Michell also wrote at this time a non-technical introduction to the theory of conjoint measurement {{harv|Michell|1990}} which also contained a schema for deriving higher order cancellation conditions based upon Scott's (1964) work. Using Michell's schema, Ben Richards (Kyngdon & Richards, 2007) discovered that some instances of the triple cancellation axiom are "incoherent" as they contradict the single cancellation axiom. Moreover, he identified many instances of the triple cancellation which are trivially true if double cancellation is supported.

The axioms of the theory of conjoint measurement are not stochastic; and given the ordinal constraints placed on data by the cancellation axioms, order restricted inference methodology must be used {{harv|Iverson|Falmagne|1985}}. George Karabatsos and his associates (Karabatsos, 2001; {{harvnb|Karabatsos|Sheu|2004}}) developed a [[Bayesian inference|Bayesian]] [[Markov chain Monte Carlo]] methodology for [[psychometric]] applications. Karabatsos & Ullrich 2002 demonstrated how this framework could be extended to polynomial conjoint structures. Karabatsos (2005) generalised this work with his multinomial Dirichlet framework, which enabled the probabilistic testing of many non-stochastic theories of [[mathematical psychology]]. More recently, Clintin Davis-Stober (2009) developed a frequentist framework for order restricted inference that can also be used to test the cancellation axioms.

Perhaps the most notable (Kyngdon, 2011) use of the theory of conjoint measurement was in the [[prospect theory]] proposed by the Israeli – American psychologists [[Daniel Kahneman]] and [[Amos Tversky]] (Kahneman & Tversky, 1979). Prospect theory was a theory of decision making under risk and uncertainty which accounted for choice behaviour such as the [[Allais Paradox]]. David Krantz wrote the formal proof to prospect theory using the theory of conjoint measurement. In 2002, Kahneman received the [[Nobel Memorial Prize in Economics]] for prospect theory (Birnbaum, 2008).

==Measurement and quantification==

===The classical / standard definition of measurement===

In [[physics]] and [[metrology]], the standard definition of measurement is the estimation of the ratio between a magnitude of a continuous quantity and a unit magnitude of the same kind (de Boer, 1994/95; Emerson, 2008). For example, the statement "Peter's hallway is 4 m long" expresses a measurement of an hitherto unknown length magnitude (the hallway's length) as the ratio of the unit (the metre in this case) to the length of the hallway. The number 4 is a real number in the strict mathematical sense of this term.

For some other quantities, invariant are ratios between attribute ''differences''. Consider temperature, for example. In the familiar everyday instances, temperature is measured using instruments calibrated in either the Fahrenheit or Celsius scales. What are really being measured with such instruments are the magnitudes of temperature differences. For example, [[Anders Celsius]] defined the unit of the Celsius scale to be 1/100 of the difference in temperature between the freezing and boiling points of water at sea level. A midday temperature measurement of 20 degrees Celsius is simply the difference of the midday temperature and the temperature of the freezing water divided by the difference of the Celsius unit and the temperature of the freezing water.

Formally expressed, a scientific measurement is:

: <math> Q = r \times [Q]</math>

where ''Q'' is the magnitude of the quantity, ''r'' is a real number and [''Q''] is a unit magnitude of the same kind.

===Extensive and intensive quantity===
{{Main articles|Intensive and extensive properties}}
Length is a quantity for which natural concatenation operations exist. That is, we can combine in a side-by-side fashion lengths of rigid steel rods, for example, such that the additive relations between lengths is readily observed. If we have four 1&nbsp;m lengths of such rods, we can place them end to end to produce a length of 4&nbsp;m. Quantities capable of concatenation are known as ''extensive quantities'' and include mass, time, electrical resistance and plane angle. These are known as ''base'' quantities in physics and metrology.

Temperature is a quantity for which there is an absence of concatenation operations. We cannot pour a volume of water of temperature 40&nbsp;°C into another bucket of water at 20&nbsp;°C and expect to have a volume of water with a temperature of 60&nbsp;°C. Temperature is therefore an ''intensive'' quantity.

Psychological attributes, like temperature, are considered to be intensive as no way of concatenating such attributes has been found. But this is not to say that such attributes are not quantifiable. The theory of conjoint measurement provides a theoretical means of doing this.

===Theory===

Consider two natural attributes ''A'', and ''X''. It is not known that either ''A'' or ''X'' is a continuous quantity, or that both of them are. Let ''a'', ''b'', and ''c'' represent three independent, identifiable levels of ''A''; and let ''x'', ''y'' and ''z'' represent three independent, identifiable levels of ''X''. A third attribute, ''P'', consists of the nine ordered pairs of levels of ''A'' and ''X''. That is, (''a'', ''x''), (''b'', ''y''),..., (''c'', ''z'') (see Figure 1). The quantification of ''A'', ''X'' and ''P'' depends upon the behaviour of the relation holding upon the levels of ''P''. These relations are presented as axioms in the theory of conjoint measurement.

====Single cancellation or independence axiom====

[[Image:Wikipage single cancellation.JPG|thumb|350px|right|Figure One: Graphical representation of the single cancellation axiom. It can be seen that ''a'' > ''b'' because (''a'', ''x'') > (''b'', ''x''), (''a'', ''y'') > (''b'', ''y'') and (''a'', ''z'') > (''b'', ''z'').]]
The single cancellation axiom is as follows. The relation upon ''P'' satisfies ''single cancellation'' if and only if for all ''a'' and ''b'' in ''A'', and ''x'' in ''X'', (''a'', ''x'') > (''b'', ''x'') is implied for every ''w'' in ''X'' such that (''a'', ''w'') > (''b'', ''w''). Similarly, for all ''x'' and ''y'' in ''X'' and ''a'' in ''A'', (''a'', ''x'') > (''a'', ''y'') is implied for every ''d'' in ''A'' such that (''d'', ''x'') > (''d'', ''y''). What this means is that if any two levels, ''a'', ''b'', are ordered, then this order holds irrespective of each and every level of ''X''. The same holds for any two levels, ''x'' and ''y'' of ''X'' with respect to each and every level of ''A''.

Single cancellation is so-called because a single common factor of two levels of ''P'' cancel out to leave the same ordinal relationship holding on the remaining elements. For example, ''a'' cancels out of the inequality (''a'', ''x'') > (''a'', ''y'') as it is common to both sides, leaving ''x'' > ''y''. Krantz, et al., (1971) originally called this axiom ''independence'', as the ordinal relation between two levels of an attribute is independent of any and all levels of the other attribute. However, given that the term ''independence'' causes confusion with statistical concepts of independence, single cancellation is the preferable term. Figure One is a graphical representation of one instance of single cancellation.

Satisfaction of the single cancellation axiom is necessary, but not sufficient, for the quantification of attributes ''A'' and ''X''. It only demonstrates that the levels of ''A'', ''X'' and ''P'' are ordered. Informally, single cancellation does not sufficiently constrain the order upon the levels of ''P'' to quantify ''A'' and ''X''. For example, consider the ordered pairs (''a'', ''x''), (''b'', ''x'') and (''b'', ''y''). If single cancellation holds then (''a'', ''x'') > (''b'', ''x'') and (''b'', ''x'') > (''b'', ''y''). Hence via transitivity (''a'', ''x'') > (''b'', ''y''). The relation between these latter two ordered pairs, informally a ''left-leaning diagonal'', is determined by the satisfaction of the single cancellation axiom, as are all the "left leaning diagonal" relations upon ''P''.

====Double cancellation axiom====
[[Image:Wikipage double cancellation.JPG|thumb|350px|right|Figure Two: A Luce–Tukey instance of double cancellation, in which the consequent inequality (broken line arrow) does not contradict the direction of both antecedent inequalities (solid line arrows), so supporting the axiom.]]

Single cancellation does not determine the order of the "right-leaning diagonal" relations upon ''P''. Even though by transitivity and single cancellation it was established that (''a'', ''x'') > (''b'', ''y''), the relationship between (''a'', ''y'') and (''b'', ''x'') remains undetermined. It could be that either (''b'', ''x'') > (''a'', ''y'') or (''a'', ''y'') > (''b'', ''x'') and such ambiguity cannot remain unresolved.

The double cancellation axiom concerns a class of such relations upon ''P'' in which the common terms of two antecedent inequalities cancel out to produce a third inequality. Consider the instance of double cancellation graphically represented by Figure Two. The antecedent inequalities of this particular instance of double cancellation are:

: <math>(a, y) > (b, x)</math>

and

: <math>(b, z)> (c, y).</math>

Given that:

: <math> (a, y) > (b, x)</math>

is true if and only if <math> a + y > b + x; </math> and

: <math>(b, z) > (c, y)</math>

is true if and only if <math> b + z > c + y </math>, it follows that:

: <math>a + y + b + z > b + x + c + y.</math>

Cancelling the common terms results in:

: <math> (a, z) > (c, x). </math>

Hence double cancellation can only obtain when ''A'' and ''X'' are quantities.

Double cancellation is satisfied if and only if the consequent inequality does not contradict the antecedent inequalities. For example, if the consequent inequality above was:

: <math> (a, z)< (c, x),</math> or alternatively,

: <math> (a, z) = (c, x),</math>

then double cancellation would be violated {{harv|Michell|1988}} and it could not be concluded that ''A'' and ''X'' are quantities.

Double cancellation concerns the behaviour of the "right leaning diagonal" relations on ''P'' as these are not logically entailed by single cancellation. {{harv|Michell|2009}} discovered that when the levels of ''A'' and ''X'' approach infinity, then the number of right leaning diagonal relations is half of the number of total relations upon ''P''. Hence if ''A'' and ''X'' are quantities, half of the number of relations upon ''P'' are due to ordinal relations upon ''A'' and ''X'' and half are due to additive relations upon ''A'' and ''X'' {{harv|Michell|2009}}.

The number of instances of double cancellation is contingent upon the number of levels identified for both ''A'' and ''X''. If there are ''n'' levels of ''A'' and ''m'' of ''X'', then the number of instances of double cancellation is ''n''! × ''m''!. Therefore, if ''n'' = ''m'' = 3, then 3! × 3! = 6 × 6 = 36 instances in total of double cancellation. However, all but 6 of these instances are trivially true if single cancellation is true, and if any one of these 6 instances is true, then all of them are true. One such instance is that shown in Figure Two. {{harv|Michell|1988}} calls this a ''Luce–Tukey'' instance of double cancellation.

If single cancellation has been tested upon a set of data first and is established, then only the Luce–Tukey instances of double cancellation need to be tested. For ''n'' levels of ''A'' and ''m'' of ''X'', the number of Luce–Tukey double cancellation instances is <math>\tbinom{n}{3}</math><math>\tbinom{m}{3}</math>. For example, if ''n'' = ''m'' = 4, then there are 16 such instances. If ''n'' = ''m'' = 5 then there are 100. The greater the number of levels in both ''A'' and ''X'', the less probable it is that the cancellation axioms are satisfied at random ({{harvnb|Arbuckle|Larimer|1976}}; {{harvnb|McClelland|1977}}) and the more stringent test of quantity the application of conjoint measurement becomes.

====Solvability and Archimedean axioms====

[[Image:Wikipage triple cancellation.JPG|thumb|350px|right|Figure Three: An instance of triple cancellation.]]

The single and double cancellation axioms by themselves are not sufficient to establish continuous quantity. Other conditions must also be introduced to ensure continuity. These are the ''solvability'' and ''Archimedean'' conditions.

''Solvability'' means that for any three elements of ''a'', ''b'', ''x'' and ''y'', the fourth exists such that the equation ''a'' ''x'' = ''b'' ''y'' is solved, hence the name of the condition. Solvability essentially is the requirement that each level ''P'' has an element in ''A'' and an element in ''X''. Solvability reveals something about the levels of ''A'' and ''X'' — they are either dense like the real numbers or equally spaced like the [[integers]] {{harv|Krantz|Luce|Suppes|Tversky|1971}}.

The ''Archimedean condition'' is as follows. Let ''I'' be a set of consecutive integers, either finite or infinite, positive or negative. The levels of ''A'' form a ''standard sequence'' if and only if there exists ''x'' and ''y'' in ''X'' where ''x'' ≠ ''y'' and for all integers ''i'' and ''i'' + 1 in ''I'':

: <math> (a_i, x) = (a_{i+1}, y).</math>

What this basically means is that if ''x'' is greater than ''y'', for example, there are levels of ''A'' which can be found which makes two relevant ordered pairs, the levels of ''P'', equal.

The Archimedean condition argues that there is no infinitely greatest level of ''P'' and so hence there is no greatest level of either ''A'' or ''X''. This condition is a definition of continuity given by the ancient Greek mathematician [[Archimedes]] whom wrote that "Further, of unequal lines, unequal surfaces, and unequal solids, the greater exceeds the less by such a magnitude as, when added to itself, can be made to exceed any assigned magnitude among those which are comparable with one another " (''On the Sphere and Cylinder'', Book I, Assumption 5). Archimedes recognised that for any two magnitudes of a continuous quantity, one being lesser than the other, the lesser could be multiplied by a whole number such that it equalled the greater magnitude. [[Euclid]] stated the Archimedean condition as an axiom in Book V of the [[Euclid's Elements|Elements]], in which Euclid presented his theory of continuous quantity and measurement.

As they involve infinitistic concepts, the solvability and [[Archimedean axiom]]s are not amenable to direct testing in any finite empirical situation. But this does not entail that these axioms cannot be empirically tested at all. Scott's (1964) finite set of cancellation conditions can be used to indirectly test these axioms; the extent of such testing being empirically determined. For example, if both ''A'' and ''X'' possess three levels, the highest order cancellation axiom within Scott's (1964) hierarchy that indirectly tests solvability and Archimedeaness is double cancellation. With four levels it is triple cancellation (Figure 3). If such tests are satisfied, the construction of standard sequences in differences upon ''A'' and ''X'' are possible. Hence these attributes may be dense as per the real numbers or equally spaced as per the integers {{harv|Krantz|Luce|Suppes|Tversky|1971}}. In other words, ''A'' and ''X'' are continuous quantities.

==Relation to the scientific definition of measurement==

Satisfaction of the conditions of conjoint measurement means that measurements of the levels of ''A'' and ''X'' can be expressed as either ratios between magnitudes or ratios between magnitude differences. It is most commonly interpreted as the latter, given that most behavioural scientists consider that their tests and surveys "measure" attributes on so-called "interval scales" {{harv|Kline|1998}}. That is, they believe tests do not identify absolute zero levels of psychological attributes.

Formally, if ''P'', ''A'' and ''X'' form an ''additive conjoint structure'', then there exist functions from ''A'' and ''X'' into the real numbers such that for ''a'' and ''b'' in ''A'' and ''x'' and ''y'' in ''X'':

: <math>(a, x)\succsim(b, y)\iff \varphi_A (a) + \varphi_X (x)\geqslant\varphi_A (b) + \varphi_X (y).</math>

If <math>\varphi'_A \, </math> and <math>\varphi'_X \, </math> are two other real valued functions satisfying the above expression, there exist <math>\alpha > 0, \beta_A \, </math> and <math>\beta_X \, </math> real valued constants satisfying:

: <math>\varphi'_A = \alpha \varphi_A + \beta_A \text{ and } \varphi'_X = \alpha \varphi_X + \beta_X. \, </math>

That is, <math>\varphi'_A, \varphi_A, \varphi'_X \, </math> and <math>\varphi_X \, </math> are measurements of ''A'' and ''X'' unique up to affine transformation (i.e. each is an [[interval scale]] in Stevens’ (1946) parlance). The mathematical proof of this result is given in {{harv|Krantz|Luce|Suppes|Tversky|1971|pp=261–6}}.

This means that the levels of ''A'' and ''X'' are magnitude differences measured relative to some kind of unit difference. Each level of ''P'' is a difference between the levels of ''A'' and ''X''. However, it is not clear from the literature as to how a unit could be defined within an additive conjoint context. {{harvnb|van der Ven|1980}} proposed a scaling method for conjoint structures but he also did not discuss the unit.

The theory of conjoint measurement, however, is not restricted to the quantification of differences. If each level of ''P'' is a product of a level of ''A'' and a level of ''X'', then ''P'' is another different quantity whose measurement is expressed as a magnitude of ''A'' per unit magnitude of ''X''. For example, ''A'' consists of masses and ''X'' consists of volumes, then ''P'' consists of densities measured as mass per unit of volume. In such cases, it would appear that one level of ''A'' and one level of ''X'' must be identified as a tentative unit prior to the application of conjoint measurement.

If each level of ''P'' is the sum of a level of ''A'' and a level of ''X'', then ''P'' is the same quantity as ''A'' and ''X''. For example, ''A'' and ''X'' are lengths so hence must be ''P''. All three must therefore be expressed in the same unit. In such cases, it would appear that a level of either ''A'' or ''X'' must be tentatively identified as the unit. Hence it would seem that application of conjoint measurement requires some prior descriptive theory of the relevant natural system.

==Applications of conjoint measurement==

Empirical applications of the theory of conjoint measurement have been sparse ({{harvnb|Cliff|1992}}; {{harvnb|Michell|2009}}).

Several empirical evaluations of the double cancellation have been conducted. Among these, {{harvnb|Levelt|Riemersma|Bunt|1972}} evaluated the axiom to the [[psychophysics]] of binaural loudness. They found the double cancellation axiom was rejected. {{harvnb|Gigerenzer|Strube|1983}} conducted a similar investigation and replicated Levelt, ''et al.''' (1972) findings. {{harvnb|Gigerenzer|Strube|1983}} observed that the evaluation of double
cancellation involves considerable redundancy that complicates its empirical testing. Therefore, {{harvnb|Steingrimsson|Luce|2005}} evaluated instead the equivalent [[Thomsen condition]] axiom, which avoids this redundancy, and found the property supported in binaural loudness. {{harvnb|Luce|Steingrimsson|2011}},  summarized the literature to that date, including the observation that the evaluation of the Thomsen Condition also involves an empirical challenge that they find remedied by the [[conjoint commutativity]] axiom, which they show to be equivalent to the Thomsen Condition. {{harvnb|Luce|Steingrimsson|2011}} found conjoint commutativity supported for binaural loudness and brightness.

{{harvnb|Michell|1990}} applied the theory to [[L. L. Thurstone]]'s (1927) theory of paired comparisons, multidimensional scaling and Coombs' (1964) theory of unidimensional unfolding. He found support of the cancellation axioms only with Coombs' (1964) theory. However, the statistical techniques employed by Michell (1990) in testing Thurstone's theory and multidimensional scaling did not take into consideration the ordinal constraints imposed by the cancellation axioms {{harv|van der Linden|1994}}.

{{harv|Johnson|2001}}, Kyngdon (2006), Michell (1994) and {{harv|Sherman|1993}} tested the cancellation axioms of upon the interstimulus midpoint orders obtained by the use of Coombs' (1964) theory of unidimensional unfolding. Coombs' theory in all three studies was applied to a set of six statements. These authors found that the axioms were satisfied, however, these were applications biased towards a positive result. With six stimuli, the probability of an interstimulus midpoint order satisfying the double cancellation axioms at random is .5874 (Michell, 1994). This is not an unlikely event. Kyngdon & Richards (2007) employed eight statements and found the interstimulus midpoint orders rejected the double cancellation condition.

{{harvnb|Perline|Wright|Wainer|1979}} applied conjoint measurement to item response data to a convict parole questionnaire and to intelligence test data gathered from Danish troops. They found considerable violation of the cancellation axioms in the parole questionnaire data, but not in the intelligence test data. Moreover, they recorded the supposed "no test" instances of double cancellation. Interpreting these correctly as instances in support of double cancellation (Michell, 1988), the results of {{harvnb|Perline|Wright|Wainer|1979}} are better than what they believed.

{{harvnb|Stankov|Cregan|1993}} applied conjoint measurement to performance on sequence completion tasks. The columns of their conjoint arrays (''X'') were defined by the demand placed upon working memory capacity through increasing numbers of working memory place keepers in letter series completion tasks. The rows were defined by levels of motivation (''A''), which consisted in different number of times available for completing the test. Their data (''P'') consisted of completion times and average number of series correct. They found support for the cancellation axioms, however, their study was biased by the small size of the conjoint arrays (3 × 3 is size) and by statistical techniques that did not take into consideration the ordinal restrictions imposed by the cancellation axioms.

Kyngdon (2011) used Karabatsos's (2001) order-restricted inference framework to test a conjoint matrix of reading item response proportions (''P'') where the examinee reading ability comprised the rows of the conjoint array (''A'') and the difficulty of the reading items formed the columns of the array (''X''). The levels of reading ability were identified via raw total test score and the levels of reading item difficulty were identified by the [[Lexile]] Framework for Reading {{harv|Stenner|Burdick|Sanford|Burdick|2006}}. Kyngdon found that satisfaction of the cancellation axioms was obtained only through permutation of the matrix in a manner inconsistent with the putative Lexile measures of item difficulty. Kyngdon also tested simulated ability test response data using polynomial conjoint measurement. The data were generated using Humphry's extended frame of reference Rasch model {{harv|Humphry|Andrich|2008}}. He found support of distributive, single and double cancellation consistent with a distributive polynomial conjoint structure in three variables {{harv|Krantz|Tversky|1971}}.

==See also==
*{{annotated link|Item response theory}}

==References==
{{No footnotes|date=August 2011}}
*{{cite journal |last1=Arbuckle |first1=J. |last2=Larimer |first2=J. |year=1976 |title=The number of two-way tables satisfying certain additivity axioms |journal=Journal of Mathematical Psychology |volume=12 |pages=89–100 |doi=10.1016/0022-2496(76)90036-5 }}
*{{cite journal |last1=Birnbaum |first1=M. H. |year=2008 |title=New paradoxes of risky decision making |journal=Psychological Review |volume=115 |pages=463–501 |doi=10.1037/0033-295X.115.2.463 |pmid=18426300 |issue=2|citeseerx=10.1.1.144.5661 }}
*{{cite journal |last1=Brogden |first1=H. E. |date=December 1977 |title=The Rasch model, the law of comparative judgement and additive conjoint measurement |journal=Psychometrika |volume=42 |issue=4 |pages=631–4 |doi=10.1007/BF02295985 |s2cid=123583660 }}
*{{cite journal |last1=Cliff |first1=N. |year=1992 |title=Abstract measurement theory and the revolution that never happened |journal=Psychological Science |volume=3 |pages=186–190 |doi=10.1111/j.1467-9280.1992.tb00024.x |issue=3 |s2cid=144507788 }}
*{{cite book |last1=Coombs |first1=C. H. |title=A Theory of Data |publisher=Wiley |location=New York |year=1964 }}{{page needed|date=July 2012}}
*{{cite journal |last1=Davis-Stober |first1=C. P. |date=February 2009 |title=Analysis of multinomial models under inequality constraints: applications to measurement theory |journal=Journal of Mathematical Psychology |volume=53 |issue=1 |pages=1–13 |doi=10.1016/j.jmp.2008.08.003 }}
*{{cite book |last1=Debreu |first1=G. |chapter=Topological methods in cardinal utility theory |editor1-first=K.J. |editor1-last=Arrow |editor2-first=S. |editor2-last=Karlin |editor3-first=P. |editor3-last=Suppes |title=Mathematical Methods in the Social Sciences |publisher=Stanford University Press |pages=16–26 |year=1960 }}
*{{cite book |last1=Embretson |first1=S. E. |last2=Reise |first2=S. P. |title=Item response theory for psychologists |publisher=Erlbaum |year=2000 }}{{page needed|date=July 2012}}
*{{cite journal |last1=Emerson |first1=W. H. |year=2008 |title=On quantity calculus and units of measurement |journal=Metrologia |volume=45 |pages=134–138 |bibcode=2008Metro..45..134E |doi=10.1088/0026-1394/45/2/002 |issue=2|s2cid=121451085 }}
*{{cite book |last1=Fischer |first1=G. |chapter=Derivations of the Rasch model |editor1-first=G. |editor1-last=Fischer |editor2-first=I.W. |editor2-last=Molenaar |title=Rasch models: Foundations, recent developments, and applications |publisher=Springer |location=New York |year=1995 |pages=15–38 }}
*{{cite journal |last1=Gigerenzer |first1=G. |last2=Strube |first2=G. |year=1983 |title=Are there limits to binaural additivity of loudness? |journal=Journal of Experimental Psychology: Human Perception and Performance |volume=9 |issue=1 |pages=126–136 |doi=10.1037/0096-1523.9.1.126|pmid=6220118 |hdl=21.11116/0000-0000-BC9A-F |hdl-access=free }}
*{{cite journal |last1=Grayson |first1=D. A. |date=September 1988 |title=Two-group classification and latent trait theory: scores with monotone likelihood ratio |journal=Psychometrika |volume=53 |issue=3 |pages=383–392 |doi=10.1007/BF02294219 |s2cid=121684695 }}
*{{cite journal |last1=Hölder |first1=O. |year=1901 |title=Die Axiome der Quantität und die Lehre vom Mass |journal=Berichte Uber die Verhandlungen der Koeniglich Sachsischen Gesellschaft der Wissenschaften zu Leipzig, Mathematisch-Physikaliche Klasse |volume=53 |pages=1–46}} (Part 1 translated by {{cite journal |first1=J. |last1=Michell |first2=C. |last2=Ernst |date=September 1996 |title=The axioms of quantity and the theory of measurement |journal=Journal of Mathematical Psychology |volume=40 |issue=3 |pages=235–252 |doi=10.1006/jmps.1996.0023 |pmid=8979975}}
*{{cite journal |last1=Humphry |first1=S. M. |last2=Andrich |first2=D. |year=2008 |title=Understanding the unit in the Rasch model |journal=Journal of Applied Measurement |volume=9 |pages=249–264 |pmid=18753694 |issue=3 }}
*{{cite journal |last1=Iverson |first1=G. |last2=Falmagne |first2=J. C. |author-link2=Jean-Claude Falmagne |year=1985 |title=Statistical issues in measurement |journal=Mathematical Social Sciences |volume=10 |pages=131–153 |doi=10.1016/0165-4896(85)90031-9 |issue=2 }}
*{{cite journal |last1=Johnson |first1=T. |year=2001 |title=Controlling the effect of stimulus context change on attitude statements using Michell's binary tree procedure |journal=Australian Journal of Psychology |volume=53 |pages=23–28 |doi=10.1080/00049530108255118 |doi-access=free }}
*{{cite journal |last1=Kahneman |first1=D. |last2=Tversky |first2=A. |year=1979 |title=Prospect theory: an analysis of decision under risk |journal=Econometrica |volume=47 |pages=263–291 |doi=10.2307/1914185 |issue=2|jstor=1914185 |citeseerx=10.1.1.407.1910 }}
*{{cite journal |last1=Karabatsos |first1=G. |year=2001 |title=The Rasch model, additive conjoint measurement, and new models of probabilistic measurement theory |journal=Journal of Applied Measurement |volume=2 |pages=389–423 |pmid=12011506 |issue=4}}
*{{cite journal |last1=Karabatsos |first1=G. |date=February 2005 |title=The exchangeable multinomial model as an approach for testing axioms of choice and measurement |journal=Journal of Mathematical Psychology |volume=49 |issue=1 |pages=51–69 |doi=10.1016/j.jmp.2004.11.001 |url=http://tigger.uic.edu/~georgek/HomePage/KarabatsosJMP.pdf |archive-url=https://web.archive.org/web/20060206175241/http://tigger.uic.edu/~georgek/HomePage/KarabatsosJMP.pdf |url-status=dead |archive-date=2006-02-06 }}
*{{cite journal |last1=Karabatsos |first1=G. |last2=Sheu |first2=C. F. |year=2004 |title=Bayesian order constrained inference for dichotomous models of unidimensional non-parametric item response theory |journal=Applied Psychological Measurement |volume=28 |pages=110–125 |doi=10.1177/0146621603260678 |issue=2 |s2cid=122303701 }}
*{{cite journal |last1=Karabatsos |first1=G. |last2=Ullrich |first2=J. R. |year=2002 |title=Enumerating and testing conjoint measurement models |journal=Mathematical Social Sciences |volume=43 |pages=485–504 |doi=10.1016/S0165-4896(02)00024-0 |issue=3 }}
*{{cite journal |last1=Krantz |first1=D. H. |date=July 1964 |title=Conjoint measurement: the Luce–Tukey axiomatisation and some extensions |journal=Journal of Mathematical Psychology |volume=1 |issue=2 |pages=248–277 |doi=10.1016/0022-2496(64)90003-3 }}
*{{cite book |last1=Krantz |first1=D. H. |chapter=A survey of measurement theory |editor1-first=G.B. |editor1-last=Danzig |editor2-first=A.F. |editor2-last=Veinott |title=Mathematics of the Decision Sciences: Part 2 |publisher=American Mathematical Society |location=Providence, Rhode Island |year=1968 |pages=314–350 }}
*{{cite journal |last1=Keats |first1=J. A. |year=1967 |title=Test theory |journal=Annual Review of Psychology |volume=18 |pages=217–238 |doi=10.1146/annurev.ps.18.020167.001245 |pmid=5333423 }}
*{{cite book |last1=Kline |first1=P. |title=The New Psychometrics: Science, psychology and measurement |publisher=Routledge |location=London |year=1998 }}{{page needed|date=July 2012}}
*{{cite book |last1=Krantz |first1=D. H. |last2=Luce |first2=R.D |last3=Suppes |first3=P. |last4=Tversky |first4=A. |title=Foundations of Measurement, Vol. I: Additive and polynomial representations |publisher=Academic Press |location=New York |year=1971 }}
*{{cite journal |last1=Krantz |first1=D. H. |last2=Tversky |first2=A. |year=1971 |title=Conjoint measurement analysis of composition rules in psychology |journal=Psychological Review |volume=78 |pages=151–169 |doi=10.1037/h0030637 |issue=2 }}
*{{cite journal |last1=Kyngdon |first1=A. |year=2006 |title=An empirical study into the theory of unidimensional unfolding |journal=Journal of Applied Measurement |volume=7 |issue=4 |pages=369–393 |pmid=17068378}}
*{{cite journal |last1=Kyngdon |first1=A. |year=2008 |title=The Rasch model from the perspective of the representational theory of measurement |journal=Theory & Psychology |volume=18 |pages=89–109 |doi=10.1177/0959354307086924|s2cid=143679173 }}
*{{Cite journal | last1 = Kyngdon | first1 = A. | title = Plausible measurement analogies to some psychometric models of test performance | doi = 10.1348/2044-8317.002004 | journal = British Journal of Mathematical and Statistical Psychology | volume = 64 | issue = 3 | pages = 478–497 | year = 2011 | pmid =  21973097}}
*{{cite journal |last1=Kyngdon |first1=A. |last2=Richards |first2=B. |year=2007 |title=Attitudes, order and quantity: deterministic and direct probabilistic tests of unidimensional unfolding |journal=Journal of Applied Measurement |volume=8 |pages=1–34 |pmid=17215563 |issue=1}}
*{{cite journal |last1=Levelt |first1=W. J. M. |last2=Riemersma |first2=J. B. |last3=Bunt |first3=A. A. |date=May 1972 |title=Binaural additivity of loudness |journal=British Journal of Mathematical and Statistical Psychology |volume=25 |issue=1 |pages=51–68 |doi=10.1111/j.2044-8317.1972.tb00477.x |pmid=5031649 |hdl=11858/00-001M-0000-0013-2CBF-1 |url=http://pubman.mpdl.mpg.de/pubman/item/escidoc:66802/component/escidoc:124661/Levelt_Binaural_Additivity_1972.pdf |hdl-access=free }}
*{{cite journal |last1=Luce |first1=R. D. |last2=Steingrimsson |first2=R. |date=2011 |title=Theory and tests of the conjoint commutativity axiom for additive conjoint measurement |journal=Journal of Mathematical Psychology |volume=55 |issue=5 |pages=379–389 |doi=10.1016/j.jmp.2011.05.004 |url=http://www.imbs.uci.edu/files/personnel/luce/2011/Luce-Steingrimsson_JMP-2011.pdf }}
*{{cite book |last1=Luce |first1=R. D. |last2=Suppes |first2=P. |chapter=Representational measurement theory |editor1-first=H. |editor1-last=Pashler |editor2-first=J. |editor2-last=Wixted |title=Stevens' handbook of experimental psychology: Vol. 4. Methodology in experimental psychology |publisher=Wiley |location=New York |year=2002 |pages=1–41 |edition=3rd }}
*{{cite journal |last1=Luce |first1=R. D. |last2=Tukey |first2=J. W. |date=January 1964 |title=Simultaneous conjoint measurement: a new scale type of fundamental measurement |journal=Journal of Mathematical Psychology |volume=1 |issue=1 |pages=1–27 |doi=10.1016/0022-2496(64)90015-X |citeseerx=10.1.1.334.5018 }}
*{{cite journal |last1=McClelland |first1=G. |date=June 1977 |title=A note on Arbuckle and Larimer: the number of two way tables satisfying certain additivity axioms |journal=Journal of Mathematical Psychology |volume=15 |issue=3 |pages=292–5 |doi=10.1016/0022-2496(77)90035-9 }}
*{{cite journal |last1=Michell |first1=J. |date=June 1994 |title=Measuring dimensions of belief by unidimensional unfolding |journal=Journal of Mathematical Psychology |volume=38 |issue=2 |pages=224–273 |doi=10.1006/jmps.1994.1016 }}
*{{cite journal |last1=Michell |first1=J. |date=December 1988 |title=Some problems in testing the double cancellation condition in conjoint measurement |journal=Journal of Mathematical Psychology |volume=32 |issue=4 |pages=466–473 |doi=10.1016/0022-2496(88)90024-7 }}
*{{cite book |last1=Michell |first1=J. |title=An Introduction to the Logic of Psychological Measurement |publisher=Erlbaum |location=Hillsdale NJ |year=1990 }}{{page needed|date=July 2012}}
*{{cite journal |last1=Michell |first1=J. |date=February 2009 |title=The psychometricians' fallacy: Too clever by half? |journal=British Journal of Mathematical and Statistical Psychology |volume=62 |issue=1 |pages=41–55 |doi=10.1348/000711007X243582 |pmid=17908369 }}
*{{cite journal |last1=Perline |first1=R. |last2=Wright |first2=B. D. |last3=Wainer |first3=H. |year=1979 |title=The Rasch model as additive conjoint measurement |journal=Applied Psychological Measurement |volume=3 |pages=237–255 |doi=10.1177/014662167900300213 |issue=2 |s2cid=53706504 |url=http://purl.umn.edu/99628 }}
*{{cite journal |last1=Scheiblechner |first1=H. |date=September 1999 |title=Additive conjoint isotonic probabilistic models (ADISOP) |journal=Psychometrika |volume=64 |issue=3 |pages=295–316 |doi=10.1007/BF02294297 |s2cid=120080826 }}
*{{cite journal |last1=Scott |first1=D. |date=July 1964 |title=Measurement models and linear inequalities |journal=Journal of Mathematical Psychology |volume=1 |issue=2 |pages=233–247 |doi=10.1016/0022-2496(64)90002-1 }}
*{{cite journal |last1=Sherman |first1=K. |date=April 1994 |title=The effect of change in context in Coombs's unfolding theory |journal=Australian Journal of Psychology |volume=46 |issue=1 |pages=41–47 |doi=10.1080/00049539408259468 }}
*{{cite journal |last1=Stankov |first1=L. |last2=Cregan |first2=A. |year=1993 |title=Quantitative and qualitative properties of an intelligence test: series completion |journal=Learning and Individual Differences |volume=5 |pages=137–169 |doi=10.1016/1041-6080(93)90009-H |issue=2 }}
*{{cite journal |last1=Steingrimsson |first1=R |last2=Luce |first2=R. D. |date=2005 |title=Evaluating a model of global psychophysical judgments I: Behavioral properties of summations and productions |journal=Journal of Mathematical Psychology |volume=49 |issue=4 |pages=290–306 |doi=10.1016/j.jmp.2005.03.003 |url=http://www.imbs.uci.edu/files/personnel/luce/2005/SteingrimssonLuce_JMP_2005a.pdf }}
*{{cite journal |last1=Stenner |first1=A. J. |last2=Burdick |first2=H. |last3=Sanford |first3=E. E. |last4=Burdick |first4=D. S. |title=How accurate are Lexile text measures? |journal=Journal of Applied Measurement |volume=7 |pages=307–322 |pmid=16807496 |year=2006 |issue=3 }}
*{{cite journal |last1=Stevens |first1=S. S. |year=1946 |title=On the theory of scales of measurement |journal=Science |volume=103 |pages=667–680 |bibcode=1946Sci...103..677S |doi=10.1126/science.103.2684.677 |issue=2684 |pmid=17750512}}
*{{cite book |last1=Stober |first1=C. P. |title=Luce's challenge: Quantitative models and statistical methodology |year=2009 }}{{full citation needed|date=November 2012}}
*{{cite journal |last1=Thurstone |first1=L. L. |year=1927 |title=A law of comparative judgement |journal=Psychological Review |volume=34 |pages=278–286 |doi=10.1037/h0070288 |issue=4|s2cid=144782881 }}
*{{cite journal |last1=Tversky |first1=A. |year=1967 |title=A general theory of polynomial conjoint measurement |journal=Journal of Mathematical Psychology |volume=4 |pages=1–20 |doi=10.1016/0022-2496(67)90039-9 |url=http://deepblue.lib.umich.edu/bitstream/2027.42/33362/1/0000760.pdf |hdl=2027.42/33362 |hdl-access=free }}
*{{cite journal |last1=Ullrich |first1=J. R. |last2=Wilson |first2=R. E. |date=December 1993 |title=A note on the exact number of two and three way tables satisfying conjoint measurement and additivity axioms |journal=Journal of Mathematical Psychology |volume=37 |issue=4 |pages=624–8 |doi=10.1006/jmps.1993.1037 }}
*{{cite journal |last1=van der Linden |first1=W. |date=March 1994 |title=Review of Michell (1990) |journal=Psychometrika |volume=59 |issue=1 |pages=139–142 |doi=10.1007/BF02294273 |url=https://research.utwente.nl/en/publications/reviews-j-michell-1990--an-introduction-to-the-logic-of-psychological-measurement(5d879317-87db-4003-90b4-9a7375a2b7f5).html }}
*{{cite book |last1=van der Ven |first1=A. H. G. S. |title=Introduction to Scaling |publisher=Wiley |location=New York |year=1980 }}{{page needed|date=July 2012}}

==External links==
* [http://tigger.uic.edu/~georgek/HomePage/publications.htm Karabatsos' S-Plus programs for testing conjoint axioms]
* [http://psych.fullerton.edu/mbirnbaum/programs.htm Birnbaum's FORTRAN MONANOVA program for testing additivity]
* [https://web.archive.org/web/20130708083656/https://sites.google.com/site/drandrewkyngdon/home Kyngdon's R programs for enumerating cancellation tests, testing axioms and prospect theory]
* [http://www.r-project.org/ R statistical computing software]

[[Category:Psychometrics]]
[[Category:Statistical theory|conjoint measurement theory of]]
[[Category:Latent variable models]]
[[Category:Economic theories|conjoint measurement theory of]]
[[Category:Mathematical psychology]]