Abstract
In this work, artificial neural networks (ANNs) is used to predict nucleate boiling heat flux by learning from a dataset of twelve experimental parameters across 231 independent samples. An approach to reduce the number of parameters involved and to increase model accuracy is proposed and implemented. The proposed approach consists of two steps. In the first step, a feature importance study is performed to determine the most significant parameters. Only important features are used in the second step. In the second step, dimensional analysis is performed on these important parameters. Neural network analysis is then conducted based on dimensionless parameters. The results indicate that the proposed feature importance study and dimensional analysis can significantly improve the ANNs performance. It also show that model errors based on the reduced dataset are considerably lower than those based on the initial dataset. The study based on other machine learning models also shows that the reduced dataset generate better results. The results conclude that ANNs outperform other machine learning algorithms and outperform a well-known boiling correlation equation. Additionally, the feature importance study concludes that wall superheat, gravity and liquid subcooling are the three most significant parameters in the prediction of heat flux for nucleate boiling. Novel results quantifying parameter significance in surface tension dominated (SDB) and buoyancy dominated (BDB) boiling regimes have been reported. The results show that surface tension and liquid subcooling are the most significant parameters in SDB regime with a combined contribution percentage of 60%, while wall superheat and gravity are the most significant parameters in BDB regime with a combined contribution percentage of 70%.
1 Introduction
The interest in nucleate boiling is mainly due to high heat flux generated at considerably lower wall superheats. This makes nucleate boiling an efficient mode of heat transfer for cooling applications including cooling in microgravity where an efficient medium of heat transfer is required to make the components more compact.
The typical nature of the boiling curve during the nucleate boiling phase generally shows a sharp increase in the heat flux with increase in wall superheat up to a maximum value known as critical heat flux (CHF). Beyond the CHF, a decrease in the heat flux value is observed with an increase in wall superheat [1]. It is difficult to control the heat flux near the CHF because nucleate boiling is a complicated process that comprises of multiple mechanisms such as liquid–vapor phase change, bubble dynamics, contact line dynamics, and nucleation site densities [2]. These mechanisms further depend on experimental parameters such as wall superheat, liquid subcooling, gravity, surface roughness and thermo-physical properties of the liquid and vapor in question. One of the goals of nucleate boiling research has been to provide a generalized prediction of the heat flux based on other experimental input parameters such that it can be maintained at an optimum value close to the CHF [3]. Empirical correlations have been reported in the literature; however, they lack the accuracy for a general mechanistic prediction [2].
1.1 Empirical Correlations.
Multiple studies related to experiments, numerical simulations and predictive correlations of nucleate boiling have been reported in the literature [4,5]. Numerical simulation studies are typically performed for specific cases, and are computationally expensive. Additionally, simulations are challenging due to complexities arising from phase change and bubble dynamics. Similarly, experiments are also performed for specific cases. Predictive correlations have also been reported in literature, most of which were developed by using empirical coefficients. Rohsenow [6] proposed one of the first correlations in nucleate boiling. He related the heat flux, to the wall superheat, by the assumption of a single phase forced convection problem. Stephan and Abdelsalam [7] also provided a correlation by determining the important fluid property groups using regression analysis. The correlation provided by them considers bubble departure diameter (Dd) as a variable, which is difficult to be considered as an input parameter for predicting heat flux in industrial applications. The correlation by Stephan and Abdelsalam does not consider surface parameters while Rohsenow's correlation implicitly considers surface contribution through a proportionality constant Cs. In Rohsenow's model, Cs depends on the heater material and fluid combination. Later, Liaw and Dhir [8] improved Rohsenow's model. In the improved model, Cs varies linearly with contact angle. Stephan and Abdelsalam's correlation does not consider gravity but Rohsenow's equation considers gravity. Other correlations related to nucleate boiling have been proposed by studies of Fritz [9], and Gorenflo et al. [10] among others. However, these correlations are specific to subprocess mechanisms such as bubble dynamics and nucleation site densities. Thus, these correlations do not aid in predicting the general heat flux. Rohsenow's corrected equation by Liaw and Dhir is a widely-adopted model for the prediction of heat flux.
There have been multiple papers on the effects of surface roughness on nucleate boiling behavior. Wang and Dhir [11] performed research on a range of surface roughness values. They used three subranges: lower than , between and , and larger than . They concluded that density of active nucleation sites is related to the square of the heat flux. Jones et al. [12] also studied the effect of surface roughness for ranges between and , as well as from to . They reported that different trends were observed for different liquids for the same roughness value in terms of heat transfer coefficient. So far, no other work has compared the effects of multiple variables such as surface roughness with other variables such as wall-superhear, gravity, and density. This work attempts to do that by using a dataset which includes surface roughness data in the range of to .
1.2 Machine Learning Techniques.
Multiple studies on nucleate boiling experiments have been performed. A significant amount of data from these experiments is generated. These data can be exploited to identify new features and build better prediction models. It has been shown that Machine Learning predictive models have been effective in their predictive capabilities across multiple fields. Computer Vision [13], Natural Language Processing [14], Software Engineering [15], Epidemiology [16], and Environmental Sciences [17] are some of the fields in which they have been used with great success. Machine learning models including artificial neural networks (ANNs) have been used for prediction in fluid flow and heat transfer based problems too. Alizadehdakhel et al. [18] performed experiments, Computational Fluid Dynamics (CFD) simulations and neural network predictions of multiphase flow pressure drop in an unsteady problem. Jambunathan et al. [19] used back-propagation algorithm-based neural networks to predict convective heat transfer coefficient in a duct. Ling and Templeton [20] evaluated different machine learning algorithms for prediction of turbulence modeling. Rajendran et al. [21] perform vortex detection on unsteady CFD simulations using recurrent neural networks. Singh and Abbassi [22] combined numerical simulations with ANNs to perform thermal modeling in HVAC systems. Mohan and Gaitonde [23] implemented deep neural networks to build a reduced order model using dimensionality reduction technique like proper orthogonal decomposition. They used high-fidelity Direct Numerical Simulation (DNS) data to train the model. This is significant since DNS is computationally expensive specifically for turbulent flows [24]. Naphon and Arisariyawong [25] applied ANNs to analyze heat transfer of spirally fluted tubes. Guo and Iorio [26] used convolution neural networks for steady flow approximation of flow over vehicles. They trained the model with velocity field data over primitive shapes like triangles, quadrilaterals, and hexagons, at steady-state. Then, the model predicts the velocity field of multiple car samples provided as images. Wang et al. [27] used Random Forest algorithm to reconstruct discrepancy between RANS stress modeling and DNS data.
Machine learning models have also been used in predictions of boiling related research works. Liu et al. [28] predicted heat transfer from near wall local features using simulation data from four different heat flux values for boiling. They showed that the neural network model works well in both interpolation and extrapolation cases with respect to the training values provided. Since the training data for their neural networks are generated from simulation data, the same method cannot be used for experimental data because the type of input parameters Liu et al. used for training for their model, such as pressure gradient and momentum convection are hard to determine a priori in experiment. Hassanpour et al. [29] compared different Artificial Intelligence (AI) techniques for prediction of boiling heat transfer coefficient of alumina water based nanofluids. Their results confirmed that diameter of nanoparticles, its weight concentration in base fluid, wall superheat, and operating pressure are the best independent variables for estimating the pool boiling heat transfer coefficient of water-alumina nanofluid. Mazzola [30] integrated ANNs and empirical correlations for predicting the CHF for subcooled water. They provided a range for the variables determined from curve fitting techniques in order to predict the CHF. They report that their method would likely be suitable for thermal-hydraulic and heat transfer data processing. Alimoradi and Shams [31] used ANNs to study optimization of subcooled flow boiling in a vertical pipe. They determined that there is an optimum condition, which leads to minimizing the surface temperature and maximizing the averaged vapor volume fraction. They report that this optimization technique could be used for avoiding burning the walls while maintaining maximum vapor volume fraction. Scalabrin et al. [32] modeled flow boiling heat transfer of pure fluids using ANNs. They report improvements to the conventional correlations in flow boiling using ANNs. Qiu et al. [33] used an ANN model to predict mini/microchannels saturated flow boiling heat transfer coefficient. They report that the ANNs model did extremely well when a working fluid data was included in the training dataset, and poorly when a working fluid data was excluded from training dataset. Zhou et al. [34] compared ANNs predictions with other machine learning models for prediction of flow condensation heat transfer coefficients. They report machine learning models performed better than generalized correlation equation. Bubble images have been used by Suh et al. [35] as input to predict pool boiling characteristics as well. None of these works considered variation in gravity, and very few of them use data from multiple test liquids. McClure and Carey [36] did consider gravity in order to predict heat flux. However, they only considered four input parameters: wall superheat, gravity, surface tension, pressure. They did not consider liquid subcooling, vapor and liquid densities, thermal conductivity, and other parameters, which will be shown to be significant in the feature importance study presented in this work. This work uses deep learning to create a model for nucleate boiling heatflux with a comprehensive set of all of the significant input parameters including gravity for five different test liquids. These input parameters were determined based on four different feature importance techniques. So far according to the author's knowledge no other study has done this.
Limited dataset size is another issue that needs to be addressed. Using a high number of input parameters while the number of training samples are low could reduce the model accuracy as the dimensionality for the model to learn would be high. To solve that problem, this work proposes to use a combination of feature selection techniques and dimensional analysis to reduce the number of input parameters. This helps in keeping the information of each variable intact, and yet reducing the number of parameters which aids in model convergence and increasing model accuracy, and reduces training time [37]. In this work, one algorithm from each of the three feature selection methods has been used: Wrapper Methods, Filter Methods, and Embedded Methods. A brief description of each method is provided in the Section 1 of Supplemental Materials on the ASME Digital Collection.
The accuracy of machine learning models depends on the quality and quantity of the dataset. In many cases, like the study of nucleate boiling, the dataset is very limited while the number of features involved is large, which can be problematic to train the model ([29,32,38]). To address the problem it is proposed to use an approach to reduce the number of features and to improve model prediction accuracy. The approach consists of two steps:
Step 1: Reduce number of features from 12 to 8 by using feature selection techniques as mentioned above.
Step 2: Using the 8 selected variables from Step 1, dimensional analysis is used to generate four non-dimensional Π terms.
In this way, the dimensionality is reduced for the model. In Step 1, a total of four feature selection techniques are used: one from each of the three methods, namely, the Backward Elimination Technique (Wrapper Method), Pearson Correlation (Filter Method) and LASSO (Embedded Method) and an additional manual-wrapper type method based on results of ANNs model, which was trained by removing one feature at a time. Based on the combined conclusion from all the techniques, eight variables are selected for performing dimensional analysis in Step 2.
In this work, ANNs are used to predict nucleate boiling heat flux. Comparisons are made between models that are trained based on (1) a consolidated experimental dataset using all 12 parameters as input and (2) the reduced dataset with three nondimensional Π terms as input. The effectiveness of this approach is highlighted by the change in the reported error metric MAPE (mean absolute percentage error) values. Comparison of the ANNs predictions for both datasets against other machine learning models such as Random Forest-Regression (RFR) and Extreme Gradient Boost (XGBoost or XGB) algorithms have been performed. Additionally, ANN model prediction comparison to a well-known boiling correlation prediction (Liaw and Dhir [8]-corrected Rohsenow's equation [6]) has also been performed. The results show that using feature selection study and dimensional analysis to reduce the number of parameters is a viable option to generate accurate predictions from machine learning models for a limited dataset size. The remainder of the paper is divided as follows: Sec. 2 provides the methods description and reports the details on the dataset, a discussion on the feature importance study and dimensional analysis performed. Section 3 provides ANNs prediction results using Dataset-B and discusses the comparison of ANNs prediction with other machine learning models for both Dataset-A and Dataset-B. It also includes discussion on effect of parameters and parameter significance for different regimes and conditions. Additionally, comparison of heat flux prediction is provided between ANNs and Rohsenow's correlation. Conclusions are provided in Sec. 4.
2 Method
2.1 Artificial Neural Networks.
A neural network [39] is a collection of mutually connected units or neurons. Each neuron in a network has a single task, and it is connected to multiple other neurons in the same layer. A regular neural network with four inputs X1, X2, X3, and X4 (for example, density and viscosity in the fluid flow cases) is shown in Fig. 1. The first layer (to the extreme left) is called the input layer, which contains the features.
Also shown in Fig. 1 is the output layer shown on the extreme right consisting of only one unit named O which corresponds to the label (for example: heat flux in this work). The layers shown in the middle are hidden layers. In Fig. 1, two hidden layers are shown, each with two neurons. For complicated problems multiple layers are usually employed. Also the input and output layers can consist of multiple features and labels. A step-by-step description of the process is provided in Section 2 of Supplemental Materials on the ASME Digital Collection. In this case, the model is trained for 2500 epochs. Model architecture for the boiling parameters case that is used in this work for Dataset-A consists of 12 input parameters. The output layer at the extreme right contains one unit which corresponds to the heat flux. There are five hidden layers between the input and the output layer. The number of neurons in the 5 hidden layers are set to 1000, 500, 250, 100, and 50. Different combinations of number of layers, neurons, epochs, value of learning rate, for hyper-parameter tuning were tested. The reported model provided the most optimum results, hence this architecture was chosen for the study. All codes were developed using Python programing language on Tensorflow [40] and Keras [41] framework using Sci-kit learn [42] package.
Additionally, other machine learning models such as Random Forest Regression (RFR) and Extreme Gradient Boosting were used. A brief description of these are available in Section 2 of Supplemental Materials on the ASME Digital Collection.
2.2 Description of Data.
The original 12-parameter dataset which is used to predict the heat-flux is denoted as Dataset-A, and the reduced data-set which uses three nondimensional Π terms to predict the fourth nondimensional heat-flux term as Dataset-B.
For Dataset-A, 231 data points were consolidated from multiple publications, namely: Dhir (2005) [2], Oka et al. [43], Merte et al. [44], Straub [45], Raj et al. [46], and Warrier et al. [47]. Details about the dataset are provided in Table 1. It should be noted that only ranges of features pertinent to experimental conditions are provided in the table. Other features, which include the fluid properties, are not included since they are constant values for each liquid.
Range of variables | Dhir [2] | Warrier et al. [47] | Raj et al. [46] | Straub et al. [45] | Merte et al. [44] | Oka et al. [43] | Total |
---|---|---|---|---|---|---|---|
Heatflux | 1439–115,895 | 40–39,300 | 3230–391,300 | 106,440–404,000 | 9430–80,700 | 4826–221,171 | 40–404,000 |
Gravity () | 0.098– 9.8 | 2.45 × 10−7–9.8 | 9.8 × 10−6–9.8 | 9.8 × 10−4–9.8 | 9.8 × 10−4– 9.8 | 9.8 × 10−2 –9.8 | 2.45 × 10−7–9.8 |
Wall superheat () | 6–12 | −15.8–11.7 | 14.1–39.1 | 10.6–40.4 | 11.3–39.8 | 3.04–54.26 | −15.88–54.26 |
Liquid subcooling () | 0 | 10.55 | 11 | 17 | 11 | 3–19 | 0–19 |
Surface roughness (μm) | 8.5 | 16.3 | 1 | NA(0) | NA(0) | 0.1 | 0–16.3 |
System pressure (KPa) | 101.32 | 125 | 101 | 102 | 150 | 101.3 | 101–150 |
Number of samples | 10 | 19 | 17 | 9 | 9 | 167 | 231 |
Liquid | Water | pfnh/FC72 | pfnh/FC72 | R113 | R113 | n-pentane, R113, Water | Water, pfnh, R113, n-pentane |
Range of variables | Dhir [2] | Warrier et al. [47] | Raj et al. [46] | Straub et al. [45] | Merte et al. [44] | Oka et al. [43] | Total |
---|---|---|---|---|---|---|---|
Heatflux | 1439–115,895 | 40–39,300 | 3230–391,300 | 106,440–404,000 | 9430–80,700 | 4826–221,171 | 40–404,000 |
Gravity () | 0.098– 9.8 | 2.45 × 10−7–9.8 | 9.8 × 10−6–9.8 | 9.8 × 10−4–9.8 | 9.8 × 10−4– 9.8 | 9.8 × 10−2 –9.8 | 2.45 × 10−7–9.8 |
Wall superheat () | 6–12 | −15.8–11.7 | 14.1–39.1 | 10.6–40.4 | 11.3–39.8 | 3.04–54.26 | −15.88–54.26 |
Liquid subcooling () | 0 | 10.55 | 11 | 17 | 11 | 3–19 | 0–19 |
Surface roughness (μm) | 8.5 | 16.3 | 1 | NA(0) | NA(0) | 0.1 | 0–16.3 |
System pressure (KPa) | 101.32 | 125 | 101 | 102 | 150 | 101.3 | 101–150 |
Number of samples | 10 | 19 | 17 | 9 | 9 | 167 | 231 |
Liquid | Water | pfnh/FC72 | pfnh/FC72 | R113 | R113 | n-pentane, R113, Water | Water, pfnh, R113, n-pentane |
where z is the scaled output, x is the input prior to scaling, μ is the mean, and s is the standard deviation. The 12 parameters that were used for training along with the prediction variable heat flux are given in Table 2 with their respective symbols and units. The details pertaining to the highlighted portions and the column named “Contribution” in Table 2 has been discussed later in the paper.
A flowchart of the entire parameter reduction procedure is provided in Fig. 2.
3 Results and Discussion
3.1 Feature Importance Study.
A deeper look at Dataset-A shows that there are 12 different parameters which are used in predicting one parameter. This means the model has twelve degrees-of-freedom. It can be problematic to train an ANNs model with 12 parameters but less than 200 data points. Hence, with the goal of reducing the number of parameters, first, a feature importance study is performed. Four different feature selection techniques were used: one from each of the wrapper, filter, and embedded methods, and one additional manual wrapper method based on ANNs model prediction result.
where A is the actual value, F is the predicted value, and n is the number of samples predicted. In order to understand the contribution of each parameter, an ablation study was performed by following the steps below:
Step 1: Run the ANNs model by training on all 12 parameters of Dataset-A. It reports a MAPE of 25.77% (Details are provided in Sec. 3.4).
Step 2: Remove one parameter and train the same model architecture on the remaining 11 parameters. Record the MAPE value as it indicates the significance of the parameter that was left out.
Step 3: Add the previously left out parameter back and remove a different parameter and perform Step 2.
Step 4: Repeat step 2 and 3 for all parameters.
Step 5: Compare the MAPE values for each of the runs.
Based on the degree of change in MAPE, the effect of each parameter can be determined. Figure 3 shows the error between the MAPE in each case when one parameter is left out of the training set and the initial Dataset-A which include all parameters. This shows the effect of leaving out each parameter on the MAPE. Based on the results in Fig. 3, the percent contribution for each parameter was calculated. The contribution of each parameter in the order of significance is highlighted in Table 2 in the column named “Contribution.”
Based on the correlation coefficient values for each variable in Dataset-A, a heatmap was generated, which shows the degree of correlation among each variables in Fig. 4.
In Fig. 4, each cell reports the correlation factor between the two variables corresponding to the row and column that the cell belongs to. So, for the heat flux correlation, one should look at the right most column. The high correlation coefficient between density and viscosity is in agreement with the physics, since density is correlated to viscosity. Similarly, high coefficient values between thermal conductivity and latent heat of vaporization also makes sense in the nucleate boiling space as both these variables are related to the total heat coming into the liquid. Regarding the heat flux correlations, the results reported using Pearson Correlation technique are in good agreement to the ablation study reported earlier. Wall superheat, Gravity and Liquid subcooling are determined to be the three highest correlated variables with heat flux.
Out of the five parameters with 1% contribution, surface tension was selected due to its significance in nucleate boiling heatflux [49], and since its percentage being a little higher than the other ones (which was rounded off to 1%). Liquid density was the other parameter selected to formulate density ratio between liquid and vapor densities as a dimension-less parameter in the dimensional analysis (details on dimensional analysis is described in Sec. 3.2), since density ratio has been shown to be a significant parameter for nucleate boiling in other studies [2]. Additionally, it should be noted that the results from Backward Elimination technique were also used in the selection of the eight parameters for the dimensional analysis. These eight parameters were chosen based on the significance of those parameters by both ANN ablation study and Backward elimination technique. Liquid density and surface tension were deemed to be significant by both ANN ablation and Backward Elimination technique.
Additionally, two different feature importance study techniques were also used, namely: Backward Elimination technique and the LASSO (Least Absolute Shrinkage and Selection Operator) technique. All methods report the same conclusion that wall superheat, gravity, and liquid subcooling are the three most significant parameters in predicting nucleate boiling heat flux. Details about the Backward Elimination and the LASSO techniques are not included for brevity.
3.2 Effect of Dimensional Analysis.
Based on the results from the feature importance study, the three most significant parameters were determined. The first step is to train the ANNs model with the three significant parameters, namely, wall superheat, gravity, and liquid subcooling. The MAPE reported by training the ANNs using only these three parameters was 43.43% which is much higher than the MAPE with 12 parameters of 25.7%. This shows that three parameters are not enough to construct an accurate functional mapping by ANNs. The model need the effect of more parameters, with reduced number of parameters. Next, the eight most important parameters including heat flux are selected to perform dimensional analysis [50] as highlighted in the black colored box in Table 2 with the goal of reducing the number of parameters from 8 to 4 nondimensional Π terms. Out of these eight, the parameters that were selected as repeating variables are highlighted in Table 2 with violet cell background color. The Π terms generated as a result of performing dimensional analysis are shown in Table 3. Once the Π terms are generated, the next step is to train the model using and as input to predict the nondimensional heat flux . Here a function was used in to reduce the range of the nondimensional gravity values (microgravity is in the range of ) and earth gravity is ). From the original Dataset-A, a new dataset Dataset-B has been generated which has the four nondimensional Π terms and their values for the same 231 samples.
where α is the scale for negative factor and is set to the default value of 1.0 in the code.
The results for the predictions of 46 samples using ANNs are provided in Fig. 5. The ground truth values (actual values) are plotted along the x-axis, and the model predictions are plotted along the y-axis. The points adhering closer to the center diagonal line passing through the origin depicts higher accuracy. The MAPE reported for ANNs model using nondimensional Π terms is 9.1%, which reduces to 6.4% after removing three outlier predictions.
Next, the results from different models that are trained based on different dataset are compared. In Sec. 3.3, predictions from ANNs are compared with Extreme Gradient Boost (XGB) and Random Forest-Regression (RFR) algorithm predictions using Dataset-B. In Sec. 3.4, predictions are compared with Dataset-A for ANNs and other machine learning models. In Sec. 3.6, comparison of ANNs prediction with that of Rohsenow's correlation is provided.
3.3 Comparison With Other Machine Learning Models.
Two new models are trained using Dataset-B to predict nondimensional heat flux . The predictions for using XGB and RFR algorithms are provided in Fig. 6. The XGB model has an MAPE value of 16.31% which is higher than 9.12% from the ANNs model. Random Forest-Regression reports a MAPE of 18.71% which is higher than those from the ANNs model and the XGB model. MAPE for XGB prediction for using Dataset-B for 46 samples is 16.3% which is higher than 9.1% of ANNs.
Random Forest-Regression reports a MAPE of 18.7% for Dataset-B which is higher than 9.1% of ANNs and 16.3% of XGB. As can be seen from Fig. 6, the predictions are very similar for both models with some minor differences.
3.4 Comparison With 12 Parameter Dataset Predictions.
To highlight the effectiveness of dimension reduction, results from the ANNs model trained using Dataset-A are compared with results from ANNs model trained using Dataset-B. Prediction was made over the testing dataset of 46 independent samples for Dataset-A. The results are shown in Fig. 7. In the case of Dataset-A, the MAPE value is 25.7%. After excluding two outlier samples, the MAPE reduces to 14.4%. The outliers did not have any specific correlation. They are for different liquids with different gravity, wall superheat and liquid subcooling values, indicating that the outliers do not conform to any specific type which the model is unable to predict correctly. In comparison, the prediction error for Dataset-B using ANNs was much lower at 9.1%.
Next, the predictions from the XGB and RFR model for Dataset-A are provided. Prediction was made over the testing data-set of 46 independent samples as in Dataset-B. The results for the XGB and RFR prediction are shown are shown in Fig. 8.
The corresponding MAPE values for XGB prediction for heat flux for Dataset-A is 42.1% which is higher than the 25.7% of ANNs. In comparison, the prediction for Dataset-B using XGB was much lower at 16.3%.
For Dataset-A, RFR reports a MAPE of 44.6% which is higher than 25.7% of ANNs and 42.1% of XGB. In comparison, the prediction for Dataset-B using RFR was much lower at 18.7%.
A comparison between Figs. 6 and 8 shows that the predictions for Dataset-B in Fig. 6 are much closer to the centerline and hence more accurate than the predictions for Dataset-A in Fig. 8. This can also be seen from the MAPE value comparisons.
where N is the number of the samples, xi represents the values from the ith sample, and μ is the mean. The 46 samples were selected prior to the training process for all cases shown in Table 4. The selection process was completely random, however the same seed value was used for all methods so that the exact same samples are chosen to be included in the test set for all models. This would maintain a fair comparison for the predictive capabilities across the models. From the results in Table 4 it is evident that the ANNs model reports the most accurate predictions for both Dataset-A and Dataset-B. The prediction for ANNs using the Dataset-B is considerably more accurate than that using Dataset-A. This trend holds true for XGB and RFR algorithms as well. This suggests that performing feature importance study and dimensional analysis, which resulted in the reduction of the number of features to 3 from 12, improved the accuracy of models.
3.5 Analysis of Predictions
3.5.1 Effect of Gravity.
The model learns the physics-based behavior from the data. This can be verified by considering the example of gravity and its effect on heatflux. Typically experiments have shown that keeping other parameters constant, if gravity is reduced then a reduction in heatflux is observed ([44,46,47]). For the model prediction, two sample points are considered from the unseen test set. The two points are for the same liquid (pfnh) and uses all other parameters of similar value, the only difference between the two datapoints is gravity value. One is in under microgravity conditions, and the other is earth gravity. The ground truth data for gravity and heatflux and the ANN model prediction of heatflux for the two points are shown in Table 5.
Gravity () | Actual heatflux () | Predicted heatflux () | Percent difference in MAPE |
---|---|---|---|
9.8 | 215,000 | 215,755 | 0.35% |
9.8E-6 | 30840 | 24687 | 19.94% |
Gravity () | Actual heatflux () | Predicted heatflux () | Percent difference in MAPE |
---|---|---|---|
9.8 | 215,000 | 215,755 | 0.35% |
9.8E-6 | 30840 | 24687 | 19.94% |
As can be seen from Table 5, the ANN model predicts the trend of heatflux reducing with gravity. This trend has been verified by multiple experiments ([44,45,47]). The error for the earth gravity case is less than 1%. Although the error for the microgravity case is higher at 19.94%, this error is similar to the state-of-the-art scaling law model of Raj et al. [46] for microgravity conditions which provides an error of 20% for heat flux predictions. However, it should be noted that the scaling law model for [46] has been tested only for microgravity conditions. The ANN model predictions have tested for all conditions. Additionally, the higher error for microgravity case can also be explained by the lower number of data points in microgravity conditions. With more experimental data available, the model accuracy could be further improved. This can be considered as part of a future work.
3.5.2 Effect of Wall Superheat.
Next, the effect of wall super heat on heatflux has been considered. From the unseen test set, sample datapoints have been selected which are for the same test liquid (water) and uses all other parameters of similar values, the only difference is in the wall super heat values. Experiments have shown that heat-flux increases with wall-super heat, and this could be attributed to the additional supply of heat due to the increased temperature difference. The ground truth data for wall superheat and heatflux and the ANN model prediction of heatflux for the two points are shown in Table 6.
Wall superheat (C) | Actual heatflux () | Predicted heatflux () | Percent difference in MAPE |
---|---|---|---|
10.8 | 31,693 | 32,111 | 1.32% |
17.7 | 70,102 | 72,507 | 3.42% |
20.2 | 103,163 | 108,982 | 5.64% |
21.2 | 126,648 | 126,623 | 0.019% |
Wall superheat (C) | Actual heatflux () | Predicted heatflux () | Percent difference in MAPE |
---|---|---|---|
10.8 | 31,693 | 32,111 | 1.32% |
17.7 | 70,102 | 72,507 | 3.42% |
20.2 | 103,163 | 108,982 | 5.64% |
21.2 | 126,648 | 126,623 | 0.019% |
As can be seen from Table 6, the ANN model learns the behavior that heatflux increases with increase in wall superheat. Additionally, the accuracy of the model prediction is high which is evident from the low MAPE values. This shows that the model learns the behavior of individual parameters with heatflux and creates a universal functional mapping for all the parameters with heatflux.
3.5.3 Critical Heat Flux.
Here, C is constant with value of 0.149 for flat surfaces. The calculated CHF values were compared with the actual heatflux to see which data-points had reached CHF. It was determined that out of the 231 datapoints, only 27 datapoints had reached the CHF value. 18 out of those 27 were for reduced gravity or microgravity conditions. Out of those 27 datapoints, 5 datapoints were part of the randomly chosen test dataset which is unseen to the ANN model. Next, the ANN model's prediction accuracy was checked for the cases where CHF was reached. In order to do that, the results of the actual heatflux, predicted heatflux and MAPE for those 5 datapoints are provided in Table 7.
Actual heatflux () | Predicted heatflux () | MAPE | Average MAPE |
---|---|---|---|
30480 | 24,687 | 19.94% | 15.36% |
44060 | 47,285 | 7.32% | |
215000 | 215,755 | 0.35% | |
146040 | 124,243 | 14.92% | |
39310 | 25,835 | 34.27% |
Actual heatflux () | Predicted heatflux () | MAPE | Average MAPE |
---|---|---|---|
30480 | 24,687 | 19.94% | 15.36% |
44060 | 47,285 | 7.32% | |
215000 | 215,755 | 0.35% | |
146040 | 124,243 | 14.92% | |
39310 | 25,835 | 34.27% |
As can be seen from the table, that the average MAPE is about 15.3% for cases where the CHF was reached, hence the model is able to predict cases of nucleate boiling which are at the border of transition boiling. For comparison, the MAPE of the complete dataset was 25.77% which shows that the cases where CHF had reached has a lower error.
3.5.4 Parameter Significance.
One of the key novel contributions of this work includes the quantification of the importance of each parameter in heatflux prediction. This quantification had been provided in Table 2. In order to verify the claim that “the three most significant parameters for heatflux prediction in nucleate boiling are: Wall superheat, Gravity, Liquid subcooling,” a study has been performed. The ANN-model was trained only with these three parameters and the accuracy of this model was compared with the complete dataset. A second study was performed to verify if the seven parameters that were selected for the dimensional analysis, can predict heatflux with reasonable accuracy. The comparison is provided in Table 8.
MAPE-3 parameter dataset | MAPE-7 parameter dataset | MAPE-12 parameter dataset |
---|---|---|
43.43% | 26.54% | 25.77% |
MAPE-3 parameter dataset | MAPE-7 parameter dataset | MAPE-12 parameter dataset |
---|---|---|
43.43% | 26.54% | 25.77% |
The MAPE for the seven-parameter dataset is closer to the 12 parameter one than the 3-parameter one since it contains more relevant information. The seven-parameter dataset has a percentage difference of 2.9% from the 12-parameter one. This shows that the contribution of these seven parameters combined, namely, wall superheat, gravity, liquid subcooling, vapor density, thermal conductivity, surface tension, and liquid density is about 97% in the prediction of heatflux.
3.5.5 Boiling Regimes.
In order to explore the effect of different boiling regimes, the percentage contribution of the variables in both surface tension dominated boiling (SDB) and buoyancy dominated boiling (BDB) regimes has been quantified. Based on the threshold value of for BDB and for SDB, where Lh is the heater size, and as proposed by Raj and Kim [52], this dataset includes 60 datapoints in the SDB regime and remaining 171 datapoints in the BDB regime. The contribution of each parameter was determined by calculating the MAPE difference between (a) prediction from ANN model trained using complete dataset and (b) prediction from ANN model trained by removing that particular parameter which would show the contribution of the specific parameter. The MAPE thus calculated is based on the test cases of either only SDB regime or only BDB regime. Based on the equation of Ls, surface tension, gravity, and densities of liquid and vapor are significant terms for regime determination. The contribution of these parameters are provided in Table 9 to see the if the ANN model is able to predict the physics behind the regimes.
Variables | Contribution percentage in SDB | Contribution percentage in BDB |
---|---|---|
Gravity | 0.96% | 22.78% |
Surface tension | 44.86% | 0.57% |
Liquid and vapor density | 4.97% | 1.62% |
Variables | Contribution percentage in SDB | Contribution percentage in BDB |
---|---|---|
Gravity | 0.96% | 22.78% |
Surface tension | 44.86% | 0.57% |
Liquid and vapor density | 4.97% | 1.62% |
The results quantify the effect of gravity and surface tension in the SDB and BDB regimes. The higher percentage contribution of Surface Tension in the SDB regime and lower in the BDB regimes shows that surface tension is a key parameter in SDB regime. Similarly, gravity is a key parameter in BDB regime. This can also be verified with the physics behind the problem, as gravity is reduced, buoyancy reduces, and surface tension effect becomes stronger. With continued reduction in gravity, surface tension becomes the dominant parameter. The contribution of gravity in SDB regime is almost nonexistent, this was also reported by Raj et al. [46] and Raj and Kim [52] from their experiments. Additionally, the model predictions also highlight that surface tension and liquid subcooling are the two most significant parameters in SDB regime with a combined contribution of 60%. Similarly, wall superheat and gravity are the two most significant parameters in BDB regime, with a combined contribution of 72%.
3.6 Comparison With Rohsenow's Correlation.
Next, ANNs predictions are compared against predictions from the well-known correlation originally proposed by Rohsenow [6] and later improved by Liaw and Dhir [8]. Out of the 46 samples contact angle information was available only for 22 samples. So, those 22 samples were used to calculate the heat flux using the correlation. The MAPE for ANNs using Dataset-B for those 22 samples was also calculated in order to have a fair comparison with Rohsenow's correlation. Results of the experimental heat flux, Rohsenow's prediction, and the ANNs predictions are shown in Fig. 9.
It is evident in Fig. 9 that ANNs predictions are much closer to the experimental values than Rohsenow's correlation. In order to quantify the differences the MAPE values along with the standard deviation of the MAPE using Dataset-B for 22 samples of ANNs and Rohsenow's correlation are reported in Table 10.
Model | MAPE | Standard deviation |
---|---|---|
ANNs | 19.07% | 22.46 |
Rohsenow | 103.48% | 67.18 |
Model | MAPE | Standard deviation |
---|---|---|
ANNs | 19.07% | 22.46 |
Rohsenow | 103.48% | 67.18 |
Results in Table 10 show that that ANNs prediction with Dataset-B outperforms Rohsenow's correlation to a considerable extent. The overall conclusion for the results using the 22 samples in Table 10 is similar to that of the 46 samples reported in Table 4. It confirms that ANNs using Dataset-B: (i) Outperforms its own predictions of Dataset-A, (ii) Outperforms other machine learning models using both Dataset-A and Dataset-B, and (iii) Outperforms Rohsenow's correlation.
4 Conclusion
The key contributions of the paper are highlighted below:
An accurate data-driven model to predict nucleate boiling heatflux has been developed. The best published model is the Liaw and Dhir's modified equation of Rohsenow's correlation. The model provides a MAPE of about 102% for 46 independent sample points. ANN based proposed model has a MAPE of only 9%, which is about 10 times more accurate.
The paper quantifies the significance percentage of each parameter on which the nucleate boiling heat flux depends. Earlier work has discussed the roles of many parameters in boiling. However, the quantification of these parameters has not been reported by anyone, as per the author's knowledge. The current work would help researchers to determine the parameters to reject with minimum loss in accuracy.
A quantified percentage contribution of the significant variables in the SDB and BDB regimes of nucleate boiling have been provided. The key highlight of this result is that surface tension and liquid subcooling are the most significant parameters in SDB regime with a combined contribution percentage of 60%, while wall superheat and gravity are the most significant parameters in BDB regime with a combined contribution percentage of 70%.
Most of prior studies using deep learning did not consider variation in gravity. One of the studies did consider gravity, however they only considered only four other input parameters: wall superheat, gravity, surface tension, pressure. They did not consider liquid subcooling, vapor and liquid densities, thermal conductivity and other parameters which are shown to be significant in the feature importance study presented in this work. This work uses deep learning to create a model for nucleate boiling heat flux with a comprehensive set of all of the significant input parameters including gravity for five different test liquids. These were determined based on four different feature importance techniques.
A new way is proposed to handle challenges of small dataset in deep learning. Training a model of a large number of features on a small dataset could reduce the model accuracy. To solve that problem, using a combination of feature selection techniques and dimensional analysis has been proposed to reduce the number of input parameters by creating non-dimensional Π-terms from the most significant input parameters and then use these Π-terms as input. This helps in keeping the information of each variable intact, and yet reducing the number of parameters which aids in model convergence and increasing model accuracy. The reduction in error using this methodology has been highlighted as well.