Validation

A physics-based model is only useful if its first-principles answers land close to the real machines it’s meant to describe. This page is that check.

AirSourceHeatPumpBoiler has been benchmarked against the Samsung EHS Mono HT Quiet R32 14 kW catalogue across 15 operating points — \(T_{\mathrm{LWT}} \in \{40, 50, 65\}\) °C paired with outdoor air temperatures from −10 to 30 °C. The model tracks the catalogue COP to a mean absolute error of 0.35 (MAPE 10.1 %), with no unit-specific calibration — the same code path applies to any CoolProp refrigerant.

Parity plot

Parity plot — predicted vs target COP across 15 operating points of the Samsung EHS Mono HT Quiet R32 catalogue.

Predicted COP vs catalogue target COP. The 1 : 1 diagonal is the reference; points clustered around it indicate the model tracks the catalogue without unit-specific calibration.

Per-point comparison

Catalogue conditions and target values follow Table 1 of the KJACR 2026 paper (see citations below). Predicted values come from re-running the released code via scripts/validation/samsung_ehs_parity.py.

Show all 15 operating points

ID

\(T_{\mathrm{LWT}}\ [\mathrm{°C}]\)

\(T_0\ [\mathrm{°C}]\)

\(\dot{Q}_{\mathrm{cond}}\ [\mathrm{kW}]\)

\(\mathrm{COP}_{\mathrm{target}}\)

\(\mathrm{COP}_{\mathrm{pred}}\)

AE

APE

1

40

−10

13.45

2.30

2.37

0.07

3.0 %

2

40

2

12.42

3.04

3.83

0.79

25.8 %

3

40

12

14.65

5.07

4.67

0.40

7.9 %

4

40

20

15.69

6.48

5.65

0.83

12.8 %

5

40

30

16.98

7.68

7.43

0.25

3.2 %

6

50

−10

13.89

2.00

1.84

0.16

7.8 %

7

50

2

13.27

2.56

3.04

0.48

18.9 %

8

50

12

14.76

3.86

3.71

0.15

3.9 %

9

50

20

15.97

4.78

4.34

0.44

9.2 %

10

50

30

17.48

5.95

5.37

0.58

9.8 %

11

65

−10

13.97

1.73

1.42

0.31

17.7 %

12

65

2

13.71

2.04

2.37

0.33

16.1 %

13

65

12

16.38

2.84

2.73

0.11

3.7 %

14

65

20

17.48

3.34

3.17

0.17

5.1 %

15

65

30

18.84

4.04

3.79

0.25

6.1 %

Mean

0.35

10.1 %

Notation

  • \(T_{\mathrm{LWT}}\) — Leaving Water Temperature, the manufacturer’s catalogue reference. The model’s tank temperature is set 2.5 K below \(T_{\mathrm{LWT}}\) for \(T_{\mathrm{LWT}} \le 60\) °C and 5 K below for \(T_{\mathrm{LWT}} > 60\) °C, per the paper’s EWT / LWT offset.

  • \(T_0\) — outdoor (dead-state) air temperature.

  • \(\dot{Q}_{\mathrm{cond}}\) — target condenser heat rate.

  • \(\mathrm{COP}\) — system Coefficient of Performance, \(\dot{Q}_{\mathrm{cond}} / (E_{\mathrm{cmp}} + E_{\mathrm{fan}})\).

  • AE — Absolute Error, \(\left|\mathrm{COP}_{\mathrm{pred}} - \mathrm{COP}_{\mathrm{target}}\right|\).

  • APE — Absolute Percentage Error, \(\mathrm{AE} / \mathrm{COP}_{\mathrm{target}}\).

  • MAE / MAPE — mean of AE / APE over all 15 points.

Reproducibility

The parity plot and the table above are regenerated by scripts/validation/samsung_ehs_parity.py, so anyone can rerun the comparison from the source.

uv sync --locked
uv run python scripts/validation/samsung_ehs_parity.py

The script:

  • Iterates over the 15 catalogue operating points hard-coded from Samsung’s TDB Table 1.

  • Calls AirSourceHeatPumpBoiler(ref="R32").analyze_steady(...) at each point.

  • Writes a publication-quality SVG to docs/source/_static/validation_parity.svg with a pinned svg.hashsalt so the output is byte-identical across runs.

Scope

What has — and hasn’t — been benchmarked

Only AirSourceHeatPumpBoiler has been quantitatively validated against catalogue data. The other system classes (GroundSourceHeatPumpBoiler, WaterSourceHeatPumpBoiler, AirSourceHeatPump, GroundSourceHeatPump, and the subsystem-augmented variants) share the same refrigerant-cycle core and pass smoke tests on representative operating points, but they have not yet been benchmarked against unit-specific data.

Because the shared cycle is what’s being validated here — not a fit to one machine — the same accuracy budget is expected to carry across the rest of the family. Per-family catalogue comparisons will be added as the relevant data becomes available.

Citations

  • Jo, H. & Choi, W. “Thermodynamic Modeling of Refrigerant Cycle in an Air-Source Heat Pump Boiler and Performance Validation”, KJACR (2026, in press).

  • Samsung Electronics, EHS Mono HT Quiet R32 Technical Data Book (2024) — PDF.