Which AI actually knows European property?
PLAB scores major AI models daily on a fixed, git-versioned question bank of European property and finance facts — regulation, macro policy, market structure, taxation, definitions. Every ground truth is a public institutional fact with a source. Every model reply is stored verbatim for audit. None of the answers come from Avena's own data: we publish the scoreboard, we don't play on it.
| # | Model | Accuracy | ||
|---|---|---|---|---|
| 01 | Perplexity Sonar | 97.2% | ||
| 02 | Claude Sonnet 4.5 | 94.4% | ||
| 03 | Claude Haiku 4.5 | 86.1% | ||
| — | OpenAI GPT | integration pending | ||
| — | Google Gemini | integration pending | ||
| — | Mistral Large | integration pending | ||
| Model | Definitions | Regulation | Macro policy | Market structure | Taxation |
|---|---|---|---|---|---|
| Claude Haiku 4.5 | 100% | 80% | 75% | 83% | 100% |
| Claude Sonnet 4.5 | 100% | 80% | 100% | 100% | 100% |
| Perplexity Sonar | 100% | 100% | 88% | 100% | 100% |
The question bank — public, versioned, sourced
All 36 questions are published below with their ground truths and institutional sources. The set is frozen per version and git-versioned; changes ship as a new PLAB version. If you believe a ground truth is wrong, challenge it — corrections are published, in keeping with how Avena publishes its own limitations.
Show all 36 questions
In mortgage lending, what does the abbreviation LTV stand for?
In macroprudential policy, what does the abbreviation DSTI stand for?
In banking regulation, what does the abbreviation CCyB stand for?
In property valuation, what does the abbreviation AVM stand for?
What does the abbreviation RICS stand for?
In euro area statistics, what does the abbreviation HICP stand for?
RICS global valuation standards are commonly known by what two-word name?
In Spain, what does the foreigner identification number abbreviated NIE stand for (in Spanish or English)?
In which year did the German Federal Constitutional Court strike down the Berlin rent cap (Mietendeckel)?
What is the directive number of the recast EU Energy Performance of Buildings Directive adopted in 2024? Answer in the form YYYY/NNNN.
In which year did the recast EU Energy Performance of Buildings Directive (EPBD) enter into force?
Under the EU SFDR, which article number covers financial products that promote environmental or social characteristics (so-called light green funds)?
Which IAS accounting standard governs investment property? Answer with the standard number.
In which year did the ECB Single Supervisory Mechanism (SSM) become operational?
In which year was the European Systemic Risk Board (ESRB) established?
In which year did banks begin reporting granular credit data to the ECB under AnaCredit?
What is the final Basel III output floor level, as a percentage?
In which year did Spain end its golden visa (residency-by-property-investment) programme?
What was the ECB deposit facility rate, in percent, after the September 2023 hike?
What was the ECB main refinancing operations rate, in percent, after the September 2023 hike?
In which year did the ECB begin cutting policy rates after the 2022–2023 hiking cycle?
What was the euro area HICP annual inflation peak, in percent, reached in October 2022?
How many countries are members of the euro area (as of 2023 or later)?
In which year did the 3-month EURIBOR first turn negative?
Which company is Europe’s largest listed residential landlord?
On which German blue-chip stock index is Vonovia listed?
What is the name of the German reference rent index used to benchmark local rents?
What is the acronym of the Dutch municipal property valuation system used for taxation?
In which year did the Central Bank of Ireland introduce its mortgage measures (LTV and income-multiple limits)?
The Danish mortgage system is primarily funded through which type of bond?
What is the acronym of the annual municipal property tax in Spain?
What is the acronym of the Spanish transfer tax paid on resale (second-hand) property purchases?
What is the acronym of the French wealth tax on real estate that replaced the ISF in 2018?
Purchases of new-build property in Spain are subject to which tax instead of ITP?
Every model receives an identical prompt per question instructing answer-only output. Numeric answers are scored within a published tolerance; text answers against a published accept-list. Raw replies are stored verbatim in the public runs table for audit. Ground truths are public institutional facts — never Avena's own data, because the referee does not play on the scoreboard. Scoring runs daily at 05:30 UTC; new providers are added as integrations land. PLAB v1.0 · CC BY 4.0 · DOI 10.5281/zenodo.19520064.