The survival of minority governments depends on support from non-cabinet parties that strive to safeguard government stability while also fulfilling their accountability to the electorate. This article argues that non-cabinet parties' propensity to support the government depends on their desire to uphold distinctiveness when accountability is at stake. This even applies to opposition parties that are officially committed to minority government support and, as a trade-off, receive policy pay-offs. By analysing opposition party voting in 23 years of Swedish minority governments (1991–2018), the article suggests that ideologically distant support parties are more likely to oppose the government on their core issues since compromise would involve too-large concessions. These results question our understanding of support party pay-offs as a trade-off for minority government support and highlight the rationality of entering a support agreement, which gives the support party a certain degree of policy influence while also keeping a distinct party profile.