Human-in-the-Loop Hiring: Evidence and Requirements
Last reviewed
Summary
Human-in-the-loop hiring keeps a person responsible for every consequential decision while AI prepares and explains the evidence. Research on automation bias shows that simply adding a person is not enough: the process has to make meaningful review possible.
What the evidence says
- People supervising automated systems are prone to complacency and automation bias, which can lead them to accept incorrect recommendations. [1]
- The EU AI Act requires high-risk AI systems to be designed so they can be effectively overseen by people, including understanding their limitations and being able to disregard or override their output. [2]
- The GDPR restricts decisions based solely on automated processing that significantly affect people, and provides a right to obtain human intervention in certain cases. [3]
- International AI principles call for human-centred values and appropriate human oversight of AI systems. [4]
AuraSync's interpretation
Human oversight has to be designed in, not declared. We take from this that reviewers need the evidence, the time and the authority to disagree, which is why AuraSync shows the answers behind each result, lets recruiters override any result and recommends that teams record their own reasoning.
What AuraSync claims
- A person at the hiring organization reviews results and decides who moves forward.
- Recruiters can disregard or override any score or recommendation.
- Integrity flags are reviewed by a person, and the candidate is entitled to explain what happened.
Limitations
Human review can itself be inconsistent or biased. Oversight reduces the risk of automated errors going unchecked; it does not remove the need to monitor outcomes. Legal summaries here are orientation, not legal advice.
Sources
- [1]Parasuraman, R., & Manzey, D. H. (2010). Complacency and bias in human use of automation: An attentional integration. Human Factors, 52(3), 381–410. https://doi.org/10.1177/0018720810376055
- [2]Regulation (EU) 2024/1689 of the European Parliament and of the Council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union. https://eur-lex.europa.eu/eli/reg/2024/1689/oj
- [3]Regulation (EU) 2016/679 of the European Parliament and of the Council (General Data Protection Regulation). Official Journal of the European Union. https://eur-lex.europa.eu/eli/reg/2016/679/oj
- [4]OECD. Recommendation of the Council on Artificial Intelligence (OECD AI Principles). https://oecd.ai/en/ai-principles
This page summarizes third-party research for orientation. It is not an evaluation of AuraSync, and any summary of law is not legal advice.