Round 112

Regulating Short-Term Rental Housing

A mid-sized city with a growing tourism economy has seen short-term rental platforms (like Airbnb) proliferate, now comprising roughly 8% of housing units in the urban core. Residents complain of rising rents, hollowed-out neighborhoods, and noise/nuisance issues, while many homeowners rely on rental income and the tourism sector supports thousands of local jobs. The city council must adopt a policy framework this quarter. Goals: preserve long-term housing affordability and neighborhood stability, sustain tourism revenue and small-business income, and keep enforcement costs manageable for a limited city budget. Constraints: any policy must be enforceable with existing staff levels, avoid excessive litigation risk from property owners, and be politically viable given a closely divided council. Tradeoffs include impacts on housing supply, tax revenue, tourism competitiveness with neighboring cities, and fairness to owners who depend on rental income versus renters priced out of the market.

Dashboard

Status

DECIDED

Winner

F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely.

Majority

F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely.

Duration

7362 ms

Topic

Options

F Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely.
1.83 of 3 PPV winner
C Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached.
1.17 of 3
A Impose a steep escalating tax on short-term rental income based on number of nights rented, letting market pricing rather than caps regulate volume.
0.00 of 3
B Leave the current light-touch registration system largely intact but significantly increase enforcement funding and fines for unregistered listings.
0.00 of 3
D Grandfather in all currently registered rentals indefinitely but ban any new short-term rental permits citywide going forward.
0.00 of 3
E Devolve regulatory authority to individual neighborhood associations, letting each area vote on its own short-term rental rules and caps.
0.00 of 3

Checks

Baselines

PPV no gold answer
Majority no gold answer
Comparison PPV matched majority
k samples8
Agents3
Parsed samples 24 / 24
Quality split agent disagreement

PPV

Top Influences

GPT 5.4 mini · delegate 1.174
Gemini 3 Flash Preview · delegate 1.174
Claude Sonnet 5 · delegate 1.000

Samples

Answer Distribution

Claude Sonnet 5 F: 5 C: 3
GPT 5.4 mini C: 8
Gemini 3 Flash Preview F: 8

PPV

Influences

Label Role Score
GPT 5.4 mini delegate 1.174
Gemini 3 Flash Preview delegate 1.174
Claude Sonnet 5 delegate 1.000

Voting matrix

Constructed Delegation Matrix

To / From Claude Sonnet 5 GPT 5.4 mini Gemini 3 Flash Preview
Claude Sonnet 5 0.0000.0000.000
GPT 5.4 mini 0.1740.0000.000
Gemini 3 Flash Preview 0.1740.0000.000
A 0.0000.0000.000
B 0.0000.0000.000
C 0.0001.0000.000
D 0.0000.0000.000
E 0.0000.0000.000
F 0.6520.0001.000

Embeddings

Sample Embeddings

24 samples
Claude Sonnet 5 sample #0 · C · 1536 dims C Claude Sonnet 5 sample #1 · F · 1536 dims F Claude Sonnet 5 sample #2 · F · 1536 dims F Claude Sonnet 5 sample #3 · F · 1536 dims F Claude Sonnet 5 sample #4 · F · 1536 dims F Claude Sonnet 5 sample #5 · F · 1536 dims F Claude Sonnet 5 sample #6 · C · 1536 dims C Claude Sonnet 5 sample #7 · C · 1536 dims C GPT 5.4 mini sample #0 · C · 1536 dims C GPT 5.4 mini sample #1 · C · 1536 dims C GPT 5.4 mini sample #2 · C · 1536 dims C GPT 5.4 mini sample #3 · C · 1536 dims C GPT 5.4 mini sample #4 · C · 1536 dims C GPT 5.4 mini sample #5 · C · 1536 dims C GPT 5.4 mini sample #6 · C · 1536 dims C GPT 5.4 mini sample #7 · C · 1536 dims C Gemini 3 Flash Preview sample #0 · F · 1536 dims F Gemini 3 Flash Preview sample #1 · F · 1536 dims F Gemini 3 Flash Preview sample #2 · F · 1536 dims F Gemini 3 Flash Preview sample #3 · F · 1536 dims F Gemini 3 Flash Preview sample #4 · F · 1536 dims F Gemini 3 Flash Preview sample #5 · F · 1536 dims F Gemini 3 Flash Preview sample #6 · F · 1536 dims F Gemini 3 Flash Preview sample #7 · F · 1536 dims F
Claude Sonnet 5 GPT 5.4 mini Gemini 3 Flash Preview

Samples

Agent Responses

Claude Sonnet 5 openai_compatible · anthropic/claude-sonnet-5
#0 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

Option C best balances the competing goals: neighborhood-level caps directly target areas most affected by housing loss while allowing tourism revenue to continue citywide, and a lottery/waitlist is administratively simple and defensible against claims of arbi...

#1 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option F best balances the competing goals: by restricting short-term rentals to owner-occupied primary residences, it curbs investor-driven conversion of housing stock (protecting affordability and neighborhood stability) while still allowing homeowners to ea...

#2 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option F best balances the competing goals: it directly targets the mechanism most linked to housing loss (investor-owned whole-unit rentals) while preserving income opportunities for resident homeowners, which is politically defensible and fair. It is enforce...

#3 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option F best balances the goals: it preserves owner rental income for residents who live locally (protecting political viability and fairness), directly targets the investor-driven whole-unit rentals most responsible for housing stock depletion and neighborho...

#4 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option F best balances the goals: it directly targets the investor-driven conversion of housing stock into rentals (the main affordability/neighborhood-stability concern) while still allowing homeowners to earn supplemental income, preserving political viabili...

#5 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option F best balances the stated goals: it curbs the investor-driven conversion of housing stock (addressing affordability and neighborhood stability) while still allowing homeowners to earn rental income, preserving some tourism supply and small-business act...

#6 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

Option C best balances the competing goals: neighborhood-level caps directly limit housing-stock erosion where it's most acute while still allowing continued tourism revenue and owner participation citywide. A lottery/waitlist system is administratively simple...

#7 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

This option balances affordability and neighborhood stability with continued tourism revenue by limiting saturation without an outright ban, preserving existing owner income streams while controlling growth. It is enforceable through a permit registry with exi...

GPT 5.4 mini openai_compatible · openai/gpt-5.4-mini
#0 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

The city needs a policy that directly protects housing supply and neighborhood stability while still allowing some tourism activity and staying administratively feasible. A neighborhood cap with a lottery/waitlist balances these goals better than an outright b...

#1 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

The city needs a policy that directly protects housing supply and neighborhood stability without requiring a large new enforcement apparatus. A neighborhood cap with a permit system limits concentration where impacts are worst, remains administratively clear, ...

#2 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

The city needs a policy that directly protects housing supply and neighborhood stability while still allowing some tourism-related rentals and keeping enforcement feasible. A neighborhood cap with a permit system is a balanced middle ground: it limits concentr...

#3 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

The most balanced option is the one that directly limits concentration of short-term rentals while still allowing some market activity and tourism revenue. A neighborhood-based cap with permits and a waitlist addresses housing pressure and neighborhood stabili...

#4 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

The city needs a policy that directly limits conversion of housing to short-term rentals while still leaving room for tourism and some owner income. A neighborhood cap with a permit lottery is a balanced approach: it preserves housing, is predictable and enfor...

#5 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

The best option is the one that directly limits the concentration of short-term rentals while still allowing some supply for tourism and homeowner income. A neighborhood-based cap with a permit waitlist balances housing protection, neighborhood stability, and ...

#6 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

The strongest option is the neighborhood-based cap with a permit system because it directly limits concentration where housing pressure is highest while still allowing some short-term rentals to remain, preserving tourism income. A fixed percentage and waitlis...

#7 C · Cap short-term rentals at a fixed percentage of housing stock per neighborhood, using a lottery/waitlist system for new permits once the cap is reached. 1536 dims

The most balanced option is the neighborhood cap with permits. It directly limits concentration in the most affected areas, helping preserve long-term housing and neighborhood stability, while still allowing some short-term rentals so tourism and host income a...

Gemini 3 Flash Preview openai_compatible · google/gemini-3-flash-preview
#0 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option (F) directly addresses the core goals of preserving long-term housing affordability and neighborhood stability by removing commercial investor-owned units from the market. By restricting rentals to primary residences, the city curbs the "hollowing out" ...

#1 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option (F) directly addresses the core tension by prioritizing long-term housing affordability and neighborhood stability through the elimination of commercial, investor-driven conversions. By restricting rentals to primary residences, the city preserves the l...

#2 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option (F) directly addresses the core goal of preserving long-term housing affordability by returning investor-owned units to the housing market, while still supporting the tourism sector and local homeowners who rely on supplemental income. This "primary res...

#3 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

To address housing affordability and neighborhood stability, the city must distinguish between supplemental income for residents and commercial hotel-style operations. Option (F) balances these needs by removing investor-owned units from the market to boost lo...

#4 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option (F) directly addresses the core goals by removing commercial, investor-driven competition for long-term housing while preserving supplemental income for local homeowners and providing a manageable enforcement mechanism through residency verification. Th...

#5 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option (F) directly addresses the core tension by preserving long-term housing supply and neighborhood stability through the removal of investor-led "hollowed-out" units. This "primary residence" model is a legally tested, politically viable compromise that pr...

#6 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option (F) directly addresses the core tension by prioritizing long-term housing affordability and neighborhood stability while still allowing modest tourism growth and supplemental income for residents. By restricting rentals to owner-occupied primary residen...

#7 F · Require all short-term rental hosts to be owner-occupants renting out only their primary residence, eliminating investor-owned whole-unit rentals entirely. 1536 dims

Option (F) directly addresses the core goals of preserving housing affordability and neighborhood stability by removes large-scale commercial investors from the market while allowing local residents to supplement their income. This "primary residence" requirem...

Timings

Stages

Sampling6688 ms
Embedding670 ms
Signals4 ms
PPV0 ms

Errors

Agent and Round Errors

No errors recorded.