Estimation of the Reference Evapotranspiration (ETo) is critical in water resources management under climate change, especially in arid and semi-arid regions. Thus, estimating baseline ETo poses significant challenges, particularly in inadequate climatological monitoring regions. In this study, a hybrid modeling approach based on the incorporation of empirical models, Particle Swarm Optimization (PSO), and XGBoost algorithm (EmpiricalPSO-XGBoost) was developed and evaluated to forecast ETo under limited climate variables. The results showed the Empirical-PSO-XGBoost outperformed the purely calibrated empirical and Temperature-PSO-XGBoost models for estimating monthly (daily) ETo with NSE reaching 0.99 (0.86) and 0.98 (0.67) for the calibration and validation phases, respectively. Besides, up to 63 CMIP6 projections were coupled with Empirical-PSO-XGBoost for forecasting the long-term ETo under SSP245 and SSP585 climate change scenarios. Thus, the simulation showed a significant increase in ETo and seasonal patterns compared to the baseline ETo where the change in range of [+5, +10] % is associated with probability values of 0.65 and 0.78 for SSP245 and SSP585, respectively. Overall, the developed framework is useful for implementing adaptation strategies to mitigate climate change effects on water resource allocation and agricultural management. It provides the ETo associated with Exceedance probability for each month which is useful for assessing the water availability-related-risk in scheduling irrigation and sowing date of crops.