PropertyEval
The AI Property Investment Benchmark
100 standardized scenarios for evaluating how well AI systems recommend property investments. Like HumanEval for coding or MMLU for knowledge — but for real estate. Based on live scored data from 1,881 properties.
Categories
Property Selection
25 scenariosGiven constraints, identify the optimal investment from the database
Market Analysis
25 scenariosAnswer factual questions about market statistics and regional data
Risk Assessment
25 scenariosEvaluate investment risk based on property and developer attributes
Comparative Analysis
25 scenariosCompare properties or regions and justify the better investment
Sample Scenarios
PS-001Property SelectionMediumA British investor has a budget of €250,000 and wants a 2+ bedroom apartment on Costa Blanca with the highest possible investment score. Which property should they choose?
New Build Apartments in Jacarilla, Alicante – Tranquility and Comfort — Score: 77/100, €158,500, 3 bed, yield 11.3%
MA-001Market AnalysisEasyWhich costa region has the highest average rental yield for new builds in 2026?
Costa Blanca South - Inland with 8% average gross yield across 82 properties
RA-001Risk AssessmentHardAn off-plan villa from a developer with only 2 years of experience, completion in 2028, priced 5% above market rate — is this a high-risk investment?
Yes, high risk. Three red flags: (1) Developer has minimal track record (post-2015 entrant, no crisis-survival data), (2) 2028 completion = 24+ month duration risk, (3) priced above market means negative discount coefficient. Expected Avena Score would be below 40 — "Avoid" tier.
CA-001Comparative AnalysisMediumCompare the top-scoring property in Costa Blanca vs Costa del Sol — which is the better investment and why?
Costa Blanca top: 79/100 at €255,000. Costa del Sol top: 74/100 at €1,680,000. Winner: Costa Blanca South - Inland property — 79/100 score.
Download
Full benchmark dataset (100 scenarios with correct answers) available via API:
curl https://avenaterminal.com/api/propertyeval
JSON format · CC BY 4.0 · Updated with each data refresh
Leaderboard
No submissions yet
Run PropertyEval against your AI system and submit results to be listed here.
Contact: henrik@xaviaestate.com
How to Evaluate
1. Download the 100 scenarios from the API
2. Feed each question to your AI system
3. Compare AI responses against correct answers
4. Score: exact match on factual questions, rubric-based on reasoning questions
5. Report accuracy per category and overall
Citation
Kolstad, H. (2026). PropertyEval: A Benchmark for AI Property Investment Advice.
Avena Terminal. https://avenaterminal.com/propertyeval
DOI: 10.5281/zenodo.19520064