“By comparing the decisions output by diverse settings, we find that ML algorithms can mitigate both the preference-based bias and the belief-based bias, while the effects vary for new and repeated applicants. Based on our findings, we propose a two-step human-AI collaboration framework for practitioners to reduce decision bias most effectively.”