Linkage analysis (either parametric or nonparametric) is commonly applied to identify chromosomal regions using related individuals affected by disease. In complex disease the incomplete relationship between phenotype and genotype can be modeled using a phenocopy parameter, the probability that an individual is affected given they do not carry the disease mutation of interest, and a nonpenetrance parameter, the probability that an individual is not affected given they do carry the disease mutation of interest. If the linkage phase between multiple markers and a putative disease locus is known, then haplotypes carrying the mutation can, in principle, be identified by comparing the chromosome segments that are shared identical-by-descent (IBD) across affected individuals. We consider here the effect of a nonzero phenocopy rate on the linkage peak and hence upon the identification of disease haplotypes that are shared IBD between affected individuals. We show, by theory and computer simulation, that in diseases for which there is a nonzero phenocopy rate, the chromosomal regions identified may not include the true disease locus. We utilize a LOD-1 confidence interval for a widely used nonparametric linkage statistic. We find that in small/moderate samples this confidence interval may be inappropriate. We give specific examples where the phenocopy rates are nonnegligible in some complex diseases. The success of further work to identify the causal mutations underlying the linkage peaks in these diseases will depend on researchers allowing for the presence of phenocopies by examining appropriately wide regions around the initial positive linkage finding.

Gene action underlying selection responses has been studied using crossbreeding. Maximum likelihood based segregation analysis has been presented for analysing backcross data for the presence of genes with a large effect. Two sets of divergently selected lines (P-lines for body weight and F-lines for fat content) were reciprocally crossed and the F1s were crossed to the high and low lines to produce all possible backcrosses. Earlier analysis had shown that the difference in body weight at 10 weeks (n = 595) between the high and low P-lines was largely (75–80%) explained by autosomal, additive genes with the remainder explained by additive genes on the X chromosome. Maximum likelihood segregation analysis suggested the presence of a major effect on the X chromosome, but as there was only one round of recombination between the X chromosomes in the forming of the backcrosses, linked genes on the X chromosome could have acted together to give the appearance of a single major gene. The difference in fat content between the F-lines (n = 578) could be explained by autosomal genes of largely additive effect. Segregation analysis suggested the presence of a major gene with complete dominance, but this was attributed to a relationship between the mean and the variance: transformation of the data resulted in only polygenic additive genes being of importance. This study concluded that maximum likelihood based analysis and crosses between selected lines provide a powerful means for studying the gene action underlying responses to selection.

Dominance is an important source of variation in complex traits. Here, we have carried out the first thorough investigation of quantitative trait locus (QTL) detection using variance component (VC) models extended to incorporate both additive and dominant QTL effects. Simulation results showed that the empirical distribution of the test statistic when testing for dominant QTL effects did not behave in accordance with existing theoretical expectations and varied with pedigree structure. Extensive simulations were carried out to assess accuracy of estimates, type 1 error and statistical power in two-generation human-, poultry- and pig-type pedigrees each with 1900 progeny in small-, medium- and large-sized families, respectively. The distribution of the likelihood-ratio test statistic was heavily dependent on family structure, with empirical thresholds lower for human pedigrees. Power to detect QTL was high (0·84–1·0) in pig and poultry scenarios for dominance effects accounting for >7% of phenotypic variance but much lower (0·42) in human-type pedigrees. Maternal or common environment effects can be partially confounded with dominance and must be fitted in the QTL model. Including dominance in the QTL model did not affect power to detect additive QTL effects. Also, detection of spurious dominance QTL effects only occurred when maternal effects were not included in the QTL model. When dominance effects were present in the data but not in the analysis model, this resulted in spurious detection of additive QTL or inflated estimates of additive QTL effects. The study demonstrates that dominance can be included routinely in QTL analysis of general pedigrees; however, optimal power is dependent on selection of the appropriate thresholds for pedigree structure.

Multiple-trait analyses have been shown to improve the detection of quantitative trait loci (QTLs) with multiple effects. Here we applied a multiple-trait approach on obesity- and growth-related traits that were surveyed in 275 F2 mice generated from an intercross between the high body weight selected line NMRI8 and DBA/2 as lean control. The parental lines differed 2·5-fold in body weight at the age of 6 weeks. Within the F2 population, the correlations between body weight and weights of abdominal fat weight, muscle, liver and kidney at the age of 6 weeks were about 0·8. A least squares multiple-trait QTL analysis was performed on these data to understand more precisely the cause of the genetic correlation between body weight, body composition traits and weights of inner organs. Regions on Chr 1, 2, 7 and 14 for body weights at different early ages and regions on Chr 1, 2, 4, 7, 14, 17 and 19 for organ weights at 6 weeks were found to have significant multiple effects at the genome-wide level.

There are several instances in which quantitative trait locus (QTL) mapping experiments have been independently carried out for similar traits in different laboratories. We develop a permutation test of the correspondence between the test statistics obtained from genome-wide QTL scans in two such experiments to test whether the same QTLs are segregating in the experimental pair. In simulations, we show that the permutation test has the desired properties if chromosomes are of equal length, but bias can occur if chromosomes are of unequal length, a problem connected with autocorrelation of test statistic values. We apply the test to data from three recent mouse body weight QTL mapping experiments. The results from the test are non-significant, and imply a lack of overall concordance between the QTLs that were segregating in these experiments.