Choice modelling

Last updated

Choice modelling attempts to model the decision process of an individual or segment via revealed preferences or stated preferences made in a particular context or contexts. Typically, it attempts to use discrete choices (A over B; B over A, B & C) in order to infer positions of the items (A, B and C) on some relevant latent scale (typically "utility" in economics and various related fields). Indeed many alternative models exist in econometrics, marketing, sociometrics and other fields, including utility maximization, optimization applied to consumer theory, and a plethora of other identification strategies which may be more or less accurate depending on the data, sample, hypothesis and the particular decision being modelled. In addition, choice modelling is regarded as the most suitable method for estimating consumers' willingness to pay for quality improvements in multiple dimensions. [1]

Contents

There are a number of terms which are considered to be synonyms with the term choice modelling. Some are accurate (although typically discipline or continent specific) and some are used in industry applications, although considered inaccurate in academia (such as conjoint analysis). [2]

These include the following:

  1. Stated preference discrete choice modeling
  2. Discrete choice
  3. Choice experiment
  4. Stated preference studies
  5. Conjoint analysis
  6. Controlled experiments

Although disagreements in terminology persist, it is notable that the academic journal intended to provide a cross-disciplinary source of new and empirical research into the field is called the Journal of Choice Modelling. [3]

Theoretical background

The theory behind choice modelling was developed independently by economists and mathematical psychologists. The origins of choice modelling can be traced to Thurstone's research into food preferences in the 1920s and to random utility theory. [4] In economics, random utility theory was then developed by Daniel McFadden [5] and in mathematical psychology primarily by Duncan Luce and Anthony Marley. [6] In essence, choice modelling assumes that the utility (benefit, or value) that an individual derives from item A over item B is a function of the frequency that (s)he chooses item A over item B in repeated choices. Due to his use of the normal distribution Thurstone was unable to generalise this binary choice into a multinomial choice framework (which required the multinomial logistic regression rather than probit link function), hence why the method languished for over 30 years. However, in the 1960s through 1980s the method was axiomatised and applied in a variety of types of study.

Distinction between revealed and stated preference studies

Choice modelling is used in both revealed preference (RP) and stated preference (SP) studies. RP studies use the choices made already by individuals to estimate the value they ascribe to items - they "reveal their preferences - and hence values (utilities) – by their choices". SP studies use the choices made by individuals made under experimental conditions to estimate these values – they "state their preferences via their choices". McFadden successfully used revealed preferences (made in previous transport studies) to predict the demand for the Bay Area Rapid Transit (BART) before it was built. Luce and Marley had previously axiomatised random utility theory but had not used it in a real world application; [7] furthermore they spent many years testing the method in SP studies involving psychology students.

History

McFadden's work earned him the Nobel Memorial Prize in Economic Sciences [8] in 2000. However, much of the work in choice modelling had for almost 20 years been proceeding in the field of stated preferences. [9] [10] Such work arose in various disciplines, originally transport and marketing, due to the need to predict demand for new products that were potentially expensive to produce. This work drew heavily on the fields of conjoint analysis and design of experiments, in order to:

  1. Present to consumers goods or services that were defined by particular features (attributes) that had levels, e.g. "price" with levels "$10, $20, $30"; "follow-up service" with levels "no warranty, 10 year warranty";
  2. Present configurations of these goods that minimised the number of choices needed in order to estimate the consumer's utility function (decision rule).

Specifically, the aim was to present the minimum number of pairs/triples etc of (for example) mobile/cell phones in order that the analyst might estimate the value the consumer derived (in monetary units) from every possible feature of a phone. In contrast to much of the work in conjoint analysis, discrete choices (A versus B; B versus A, B & C) were to be made, rather than ratings on category rating scales (Likert scales). David Hensher and Jordan Louviere are widely credited with the first stated preference choice models. [10] They remained pivotal figures, together with others including Joffre Swait and Moshe Ben-Akiva, and over the next three decades in the fields of transport and marketing helped develop and disseminate the methods. [11] [12] However, many other figures, predominantly working in transport economics and marketing, contributed to theory and practice and helped disseminate the work widely. [13]

Relationship with conjoint analysis

Choice modelling from the outset suffered from a lack of standardisation of terminology and all the terms given above have been used to describe it. However, the largest disagreement has proved to be geographical: in the Americas, following industry practice there, the term "choice-based conjoint analysis" has come to dominate. This reflected a desire that choice modelling (1) reflect the attribute and level structure inherited from conjoint analysis, but (2) show that discrete choices, rather than numerical ratings, be used as the outcome measure elicited from consumers. Elsewhere in the world, the term discrete choice experiment has come to dominate in virtually all disciplines. [2] Louviere (marketing and transport) and colleagues in environmental and health economics came to disavow the American terminology, claiming that it was misleading and disguised a fundamental difference discrete choice experiments have from traditional conjoint methods: discrete choice experiments have a testable theory of human decision-making underpinning them (random utility theory), whilst conjoint methods are simply a way of decomposing the value of a good using statistical designs from numerical ratings that have no psychological theory to explain what the rating scale numbers mean. [2]

Designing a choice model

Designing a choice model or discrete choice experiment (DCE) generally follows the following steps:

  1. Identifying the good or service to be valued;
  2. Deciding on what attributes and levels fully describe the good or service;
  3. Constructing an Experimental design that is appropriate for those attributes and levels, either from a design catalogue, [14] or via a software program; [15]
  4. Constructing the survey, replacing the design codes (numbers) with the relevant attribute levels;
  5. Administering the survey to a sample of respondents in any of a number of formats including paper and pen, but increasingly via web surveys;
  6. Analysing the data using appropriate models, often beginning with the Multinomial logistic regression model, given its attractive properties in terms of consistency with economic demand theory. [5]

Identifying the good or service to be valued

This is often the easiest task, typically defined by:

Deciding on what attributes and levels fully describe the good or service

A good or service, for instance mobile (cell) phone, is typically described by a number of attributes (features). Phones are often described by shape, size, memory, brand, etc. The attributes to be varied in the DCE must be all those that are of interest to respondents. Omitting key attributes typically causes respondents to make inferences (guesses) about those missing from the DCE, leading to omitted variable problems. The levels must typically include all those currently available, and often are expanded to include those that are possible in future – this is particularly useful in guiding product development.

Constructing an experimental design that is appropriate for those attributes and levels, either from a design catalogue, or via a software program

A strength of DCEs and conjoint analyses is that they typically present a subset of the full factorial. For example, a phone with two brands, three shapes, three sizes and four amounts of memory has 2x3x3x4=72 possible configurations. This is the full factorial and in most cases is too large to administer to respondents. Subsets of the full factorial can be produced in a variety of ways but in general they have the following aim: to enable estimation of a certain limited number of parameters describing the good: main effects (for example the value associated with brand, holding all else equal), two-way interactions (for example the value associated with this brand and the smallest size, that brand and the smallest size), etc. This is typically achieved by deliberately confounding higher order interactions with lower order interactions. For example, two-way and three-way interactions may be confounded with main effects. This has the following consequences:

Thus, researchers have repeatedly been warned that design involves critical decisions to be made concerning whether two-way and higher order interactions are likely to be non-zero; making a mistake at the design stage effectively invalidates the results since the hypothesis of higher order interactions being non-zero is untestable. [11]

Designs are available from catalogues and statistical programs. Traditionally they had the property of Orthogonality where all attribute levels can be estimated independently of each other. This ensures zero collinearity and can be explained using the following example.

Imagine a car dealership that sells both luxury cars and used low-end vehicles. Using the utility maximisation principle and assuming an MNL model, we hypothesise that the decision to buy a car from this dealership is the sum of the individual contribution of each of the following to the total utility.

Using multinomial regression on the sales data however will not tell us what we want to know. The reason is that much of the data is collinear since cars at this dealership are either:

There is not enough information, nor will there ever be enough, to tell us whether people are buying cars because they are European, because they are a BMW or because they are high performance. This is a fundamental reason why RP data are often unsuitable and why SP data are required. In RP data these three attributes always co-occur and in this case are perfectly correlated. That is: all BMWs are made in Germany and are of high performance. These three attributes: origin, marque and performance are said to be collinear or non-orthogonal. Only in experimental conditions, via SP data, can performance and price be varied independently – have their effects decomposed.

An experimental design (below) in a Choice Experiment is a strict scheme for controlling and presenting hypothetical scenarios, or choice sets to respondents. For the same experiment, different designs could be used, each with different properties. The best design depends on the objectives of the exercise.

It is the experimental design that drives the experiment and the ultimate capabilities of the model. Many very efficient designs exist in the public domain that allow near optimal experiments to be performed.

For example the Latin square 1617 design allows the estimation of all main effects of a product that could have up to 1617 (approximately 295 followed by eighteen zeros) configurations. Furthermore this could be achieved within a sample frame of only around 256 respondents.

Below is an example of a much smaller design. This is 34 main effects design.

0000
0112
0221
1011
1120
1202
2022
2101
2210

This design would allow the estimation of main effects utilities from 81 (34) possible product configurations assuming all higher order interactions are zero. A sample of around 20 respondents could model the main effects of all 81 possible product configurations with statistically significant results.

Some examples of other experimental designs commonly used:

More recently, efficient designs have been produced. [16] [17] These typically minimise functions of the variance of the (unknown but estimated) parameters. A common function is the D-efficiency of the parameters. The aim of these designs is to reduce the sample size required to achieve statistical significance of the estimated utility parameters. Such designs have often incorporated Bayesian priors for the parameters, to further improve statistical precision. [18] Highly efficient designs have become extremely popular, given the costs of recruiting larger numbers of respondents. However, key figures in the development of these designs have warned of possible limitations, most notably the following. [16] Design efficiency is typically maximised when good A and good B are as different as possible: for instance every attribute (feature) defining the phone differs across A and B. This forces the respondent to trade across price, brand, size, memory, etc; no attribute has the same level in both A and B. This may impose cognitive burden on the respondent, leading him/her to use simplifying heuristics ("always choose the cheapest phone") that do not reflect his/her true utility function (decision rule). Recent empirical work has confirmed that respondents do indeed have different decision rules when answering a less efficient design compared to a highly efficient design. [19]

More information on experimental designs may be found here. It is worth reiterating, however, that small designs that estimate main effects typically do so by deliberately confounding higher order interactions with the main effects. This means that unless those interactions are zero in practice, the analyst will obtain biased estimates of the main effects. Furthermore (s)he has (1) no way of testing this, and (2) no way of correcting it in analysis. This emphasises the crucial role of design in DCEs.

Constructing the survey

Constructing the survey typically involves:

Administering the survey to a sample of respondents in any of a number of formats including paper and pen, but increasingly via web surveys

Traditionally, DCEs were administered via paper and pen methods. Increasingly, with the power of the web, internet surveys have become the norm. These have advantages in terms of cost, randomising respondents to different versions of the survey, and using screening. An example of the latter would be to achieve balance in gender: if too many males answered, they can be screened out in order that the number of females matches that of males.

Analysing the data using appropriate models, often beginning with the multinomial logistic regression model, given its attractive properties in terms of consistency with economic demand theory

Analysing the data from a DCE requires the analyst to assume a particular type of decision rule - or functional form of the utility equation in economists' terms. This is usually dictated by the design: if a main effects design has been used then two-way and higher order interaction terms cannot be included in the model. Regression models are then typically estimated. These often begin with the conditional logit model - traditionally, although slightly misleadingly, referred to as the multinomial logistic (MNL) regression model by choice modellers. The MNL model converts the observed choice frequencies (being estimated probabilities, on a ratio scale) into utility estimates (on an interval scale) via the logistic function. The utility (value) associated with every attribute level can be estimated, thus allowing the analyst to construct the total utility of any possible configuration (in this case, of car or phone). However, a DCE may alternatively be used to estimate non-market environmental benefits and costs. [20]

Strengths

Weaknesses

The mean-variance confound

Yatchew and Griliches first proved that means and variances were confounded in limited dependent variable models (where the dependent variable takes any of a discrete set of values rather than a continuous one as in conventional linear regression). [22] This limitation becomes acute in choice modelling for the following reason: a large estimated beta from the MNL regression model or any other choice model can mean:

  1. Respondents place the item high up on the latent scale (they value it highly), or
  2. Respondents do not place the item high up on the scale BUT they are very certain of their preferences, consistently (frequently) choosing the item over others presented alongside, or
  3. Some combination of (1) and (2).

This has significant implications for the interpretation of the output of a regression model. All statistical programs "solve" the mean-variance confound by setting the variance equal to a constant; all estimated beta coefficients are, in fact, an estimated beta multiplied by an estimated lambda (an inverse function of the variance). This tempts the analyst to ignore the problem. However (s)he must consider whether a set of large beta coefficients reflect strong preferences (a large true beta) or consistency in choices (a large true lambda), or some combination of the two. Dividing all estimates by one other – typically that of the price variable – cancels the confounded lambda term from numerator and denominator. [23] This solves the problem, with the added benefit that it provides economists with the respondent's willingness to pay for each attribute level. However, the finding that results estimated in "utility space" do not match those estimated in "willingness to pay space", [24] [25] suggests that the confound problem is not solved by this "trick": variances may be attribute specific or some other function of the variables (which would explain the discrepancy). This is a subject of current research in the field.

Versus traditional ratings-based conjoint methods

Major problems with ratings questions that do not occur with choice models are:

Other types

Ranking

Rankings do tend to force the individual to indicate relative preferences for the items of interest. Thus the trade-offs between these can, like in a DCE, typically be estimated. However, ranking models must test whether the same utility function is being estimated at every ranking depth: e.g. the same estimates (up to variance scale) must result from the bottom rank data as from the top rank data.

Best–worst scaling

Best–worst scaling (BWS) is a well-regarded alternative to ratings and ranking. It asks people to choose their most and least preferred options from a range of alternatives. By subtracting or integrating across the choice probabilities, utility scores for each alternative can be estimated on an interval or ratio scale, for individuals and/or groups. Various psychological models may be utilised by individuals to produce best-worst data, including the MaxDiff model.

Uses

Choice modelling is particularly useful for:

The section on "Applications" of discrete choice provides further details on how this type of modelling can be applied in different fields.

Occupational choice model

In Economics, an occupational choice model is a model that seeks to answer why people enter into different occupations [28] . [29]

In the model, in each moment, the person decides whether to work as in the previous occupation, in some other occupation, or not to be employed. In some versions of the model, an individual chooses that occupation for which the present value of his expected income is a maximum. [30] However, in other versions, risk aversion may drive people to work in the same occupation as before. [31]

See also

Related Research Articles

Analysis of variance (ANOVA) is a collection of statistical models and their associated estimation procedures used to analyze the differences among means. ANOVA was developed by the statistician Ronald Fisher. ANOVA is based on the law of total variance, where the observed variance in a particular variable is partitioned into components attributable to different sources of variation. In its simplest form, ANOVA provides a statistical test of whether two or more population means are equal, and therefore generalizes the t-test beyond two means. In other words, the ANOVA is used to test the difference between two or more means.

Concept testing is the process of using surveys to evaluate consumer acceptance of a new product idea prior to the introduction of a product to the market. It is important not to confuse concept testing with advertising testing, brand testing and packaging testing, as is sometimes done. Concept testing focuses on the basic product idea, without the embellishments and puffery inherent in advertising.

Nonparametric statistics is a type of statistical analysis that makes minimal assumptions about the underlying distribution of the data being studied. Often these models are infinite-dimensional, rather than finite dimensional, as is parametric statistics. Nonparametric statistics can be used for descriptive statistics or statistical inference. Nonparametric tests are often used when the assumptions of parametric tests are evidently violated.

<span class="mw-page-title-main">Conjoint analysis</span> Survey-based statistical technique

Conjoint analysis is a survey-based statistical technique used in market research that helps determine how people value different attributes that make up an individual product or service.

<span class="mw-page-title-main">Interaction (statistics)</span> Statistical term

In statistics, an interaction may arise when considering the relationship among three or more variables, and describes a situation in which the effect of one causal variable on an outcome depends on the state of a second causal variable. Although commonly thought of in terms of causal relationships, the concept of an interaction can also describe non-causal associations. Interactions are often considered in the context of regression analyses or factorial experiments.

<span class="mw-page-title-main">Optimal experimental design</span> Experimental design that is optimal with respect to some statistical criterion

In the design of experiments, optimal experimental designs are a class of experimental designs that are optimal with respect to some statistical criterion. The creation of this field of statistics has been credited to Danish statistician Kirstine Smith.

In the statistical theory of the design of experiments, blocking is the arranging of experimental units that are similar to one another in groups (blocks) based on one or more variables. These variables are chosen carefully to minimize the impact of their variability on the observed outcomes. There are different ways that blocking can be implemented, resulting in different confounding effects. However, the different methods share the same purpose: to control variability introduced by specific factors that could influence the outcome of an experiment. The roots of blocking originated from the statistician, Ronald Fisher, following his development of ANOVA.

In economics, discrete choice models, or qualitative choice models, describe, explain, and predict choices between two or more discrete alternatives, such as entering or not entering the labor market, or choosing between modes of transport. Such choices contrast with standard consumption models in which the quantity of each good consumed is assumed to be a continuous variable. In the continuous case, calculus methods can be used to determine the optimum amount chosen, and demand can be modeled empirically using regression analysis. On the other hand, discrete choice analysis examines situations in which the potential outcomes are discrete, such that the optimum is not characterized by standard first-order conditions. Thus, instead of examining "how much" as in problems with continuous choice variables, discrete choice analysis examines "which one". However, discrete choice analysis can also be used to examine the chosen quantity when only a few distinct quantities must be chosen from, such as the number of vehicles a household chooses to own and the number of minutes of telecommunications service a customer decides to purchase. Techniques such as logistic regression and probit regression can be used for empirical analysis of discrete choice.

In statistics, binomial regression is a regression analysis technique in which the response has a binomial distribution: it is the number of successes in a series of independent Bernoulli trials, where each trial has probability of success . In binomial regression, the probability of a success is related to explanatory variables: the corresponding concept in ordinary regression is to relate the mean value of the unobserved response to explanatory variables.

In statistics, fractional factorial designs are experimental designs consisting of a carefully chosen subset (fraction) of the experimental runs of a full factorial design. The subset is chosen so as to exploit the sparsity-of-effects principle to expose information about the most important features of the problem studied, while using a fraction of the effort of a full factorial design in terms of experimental runs and resources. In other words, it makes use of the fact that many experiments in full factorial design are often redundant, giving little or no new information about the system.

Repeated measures design is a research design that involves multiple measures of the same variable taken on the same or matched subjects either under different conditions or over two or more time periods. For instance, repeated measurements are collected in a longitudinal study in which change over time is assessed.

A glossary of terms used in experimental research.

Multivariate landing page optimization (MVLPO) is a specific form of landing page optimization where multiple variations of visual elements on a webpage are evaluated. For example, a given page may have k choices for the title, m choices for the featured image or graphic, and n choices for the company logo. This example yields k×m×n landing page configurations.

In statistics, a mixed-design analysis of variance model, also known as a split-plot ANOVA, is used to test for differences between two or more independent groups whilst subjecting participants to repeated measures. Thus, in a mixed-design ANOVA model, one factor is a between-subjects variable and the other is a within-subjects variable. Thus, overall, the model is a type of mixed-effects model.

In randomized statistical experiments, generalized randomized block designs (GRBDs) are used to study the interaction between blocks and treatments. For a GRBD, each treatment is replicated at least two times in each block; this replication allows the estimation and testing of an interaction term in the linear model.

Best–worst scaling (BWS) techniques involve choice modelling and were invented by Jordan Louviere in 1987 while on the faculty at the University of Alberta. In general with BWS, survey respondents are shown a subset of items from a master list and are asked to indicate the best and worst items. The task is repeated a number of times, varying the particular subset of items in a systematic way, typically according to a statistical design. Analysis is typically conducted, as with DCEs more generally, assuming that respondents makes choices according to a random utility model (RUM). RUMs assume that an estimate of how much a respondent prefers item A over item B is provided by how often item A is chosen over item B in repeated choices. Thus, choice frequencies estimate the utilities on the relevant latent scale. BWS essentially aims to provide more choice information at the lower end of this scale without having to ask additional questions that are specific to lower ranked items.

In statistics, linear regression is a statistical model which estimates the linear relationship between a scalar response and one or more explanatory variables. The case of one explanatory variable is called simple linear regression; for more than one, the process is called multiple linear regression. This term is distinct from multivariate linear regression, where multiple correlated dependent variables are predicted, rather than a single scalar variable. If the explanatory variables are measured with error then errors-in-variables models are required, also known as measurement error models.

SIMALTO – SImultaneous Multi-Attribute Trade Off – is a survey based statistical technique used in market research that helps determine how people prioritise and value alternative product and/or service options of the attributes that make up individual products or services.

Utility assessment, also called utility measurement, is a process by which the utility function of individuals or groups can be estimated. There are many different methods for utility assessment.

References

  1. ↑ 2001 - Centre for International Economics - Review of willingness-to-pay methodologies
  2. 1 2 3 Louviere, Jordan J; Flynn, Terry N; Carson, Richard T (2010-01-01). "Discrete Choice Experiments Are Not Conjoint Analysis". Journal of Choice Modelling. 3 (3): 57–72. doi: 10.1016/S1755-5345(13)70014-9 . hdl: 10453/15890 .
  3. ↑ Journal of Choice Modelling . Retrieved 2015-11-05.{{cite book}}: |website= ignored (help)
  4. ↑ Thurston (1994). "A law of comparative judgment". APA PsycNET. Retrieved 2017-12-08.
  5. 1 2 Zarembka, Paul (1974). Frontiers in Econometrics. New York: Academic Press. pp. 105–142.
  6. ↑ Luce, R. Duncan (1959). Conditional logit analysis of qualitative choice behavior. New York: John Wiley & Sons.
  7. ↑ Marley, A. A. J. (1968-06-01). "Some probabilistic models of simple choice and ranking". Journal of Mathematical Psychology. 5 (2): 311–332. doi:10.1016/0022-2496(68)90078-3.
  8. ↑ Economics 2000
  9. ↑ Louviere, Jordan J.; Woodworth, George (1983-11-01). "Design and Analysis of Simulated Consumer Choice or Allocation Experiments: An Approach Based on Aggregate Data". Journal of Marketing Research. 20 (4): 350–367. doi:10.2307/3151440. JSTOR   3151440.
  10. 1 2 Louviere, Jordan J.; Hensher, David A. (1982-01-01). "DESIGN AND ANALYSIS OF SIMULATED CHOICE OR ALLOCATION EXPERIMENTS IN TRAVEL CHOICE MODELING". Transportation Research Record (890). ISSN   0361-1981.
  11. 1 2 "Stated Choice Methods". Cambridge University Press. Retrieved 2015-11-04.
  12. ↑ Discrete Choice Analysis. Transportation Studies. 18 December 1985. ISBN   9780262022170 . Retrieved 2015-11-04.{{cite book}}: |website= ignored (help)
  13. ↑ Baltas, George; Doyle, Peter (2001-02-01). "Random utility models in marketing research: a survey". Journal of Business Research. 51 (2): 115–125. doi:10.1016/S0148-2963(99)00058-2. ISSN   0148-2963.
  14. ↑ "Orthogonal Arrays". support.sas.com. Retrieved 2015-11-04.
  15. ↑ "ChoiceMetrics | Ngene | Features". www.choice-metrics.com. Retrieved 2015-11-04.
  16. 1 2 Rose, John M.; Bliemer, Michiel C. J. (2009-09-01). "Constructing Efficient Stated Choice Experimental Designs". Transport Reviews. 29 (5): 587–617. doi:10.1080/01441640902827623. ISSN   0144-1647. S2CID   111072085.
  17. ↑ Street, Deborah J.; Burgess, Leonie (2007-07-20). The Construction of Optimal Stated Choice Experiments: Theory and Methods. John Wiley & Sons. ISBN   9780470148556.
  18. ↑ [Rossi, P., Allenby, G., McCulloch, R. (2009) Bayesian statistic and marketing. Wiley]
  19. ↑ Flynn, Terry N (March 2016). "Are Efficient Designs Used In Discrete Choice Experiments Too Difficult For Some Respondents? A Case Study Eliciting Preferences for End-Of-Life Care". Pharmacoeconomics. 34 (3): 273–284. doi:10.1007/s40273-015-0338-z. PMID   26589411. S2CID   207492460.
  20. ↑ Jeff Bennet University of Queensland https://www.epa.qld.gov.au/publications?id=1585 Archived 2008-08-19 at the Wayback Machine
  21. ↑ 2001 – The Centre for International Economics – review of willingness-to-pay methodologies
  22. ↑ Yatchew, Adonis; Griliches, Zvi (1985). "Specification Error in Probit Models". The Review of Economics and Statistics. 67 (1): 134. doi:10.2307/1928444. JSTOR   1928444.
  23. ↑ Hensher, David; Louviere, Jordan; Swait, Joffre (1998-11-26). "Combining sources of preference data". Journal of Econometrics. 89 (1–2): 197–221. doi:10.1016/S0304-4076(98)00061-X. hdl: 2123/19028 .
  24. ↑ Train, Kenneth (2005). Applications of simulation methods in environmental and resource economics. Doredrecht. pp. 1–16.
  25. ↑ Sonnier, Garrett; Ainslie, Andrew S.; Otter, Thomas (2007). "Heterogeneity Distributions of Willingness-to-Pay in Choice Models". doi:10.2139/ssrn.928412. S2CID   154620696.{{cite journal}}: Cite journal requires |journal= (help)
  26. ↑ Irwin, Neil (4 September 2014). "Why Colleges With a Distinct Focus Have a Hidden Advantage". The Upshot. The New York Times . Retrieved 9 May 2023.
  27. ↑ Selingo, Jeffrey J. (September 23, 2015). "When students have choices among top colleges, which one do they choose?". The Washington Post . Retrieved 9 May 2023.
  28. ↑ Blau, Peter; Gustad, John; Jessor, Richard; Parnes, Herbert; Wilcock, Richard (1956). "Occupational Choice: A Conceptual Framework". ILR Review. 9 (4): 531–543. doi:10.1177/001979395600900401. S2CID   158449519 . Retrieved 18 April 2021.
  29. ↑ McCall, Brian P. (1991). "A dynamic model of occupational choice". Journal of Economic Dynamics and Control. 15 (2): 387–408. doi:10.1016/0165-1889(91)90019-W . Retrieved 18 April 2021.
  30. ↑ Benewitz, Maurice; Zucker, Albert (1968). "Human Capital and Occupational Choice: A Theoretical Model". Southern Economic Journal. 34 (3): 406–409. doi:10.2307/1055503. JSTOR   1055503.
  31. ↑ Lang, Kevin (August 2018). "THE DETERMINANTS OF TEACHERS' OCCUPATIONAL CHOICE". NBER Working Paper Series. 24883. Retrieved 18 April 2021.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.