Testing machine learning systems in real estate

Uncertainty about the inner workings of machine learning (ML) models holds back the application of ML-enabled systems in real estate markets. How do ML models arrive at their estimates? Given the lack of model transparency, how can practitioners guarantee that ML systems do not run afoul of the law? This article first advocates a dedicated software testing framework for applied ML systems, as commonly found in computer science. Second, it demonstrates how system testing can verify that applied ML models indeed perform as intended. Two system-testing procedures developed for ML image classifiers used in automated valuation models (AVMs) illustrate the approach.