About Aethra & our research

Aethra Copilot is a set of AI tools for job seekers: a resume analyzer with an ATS score, a resume optimizer, cover letter and LinkedIn tools, a job tracker, and a community feed. It’s currently in beta.

AI career advice sounds equally confident whether it’s right or wrong. A suggestion like “add these keywords” or “lead with this project” reads the same either way — and usually nobody goes back to check whether it actually helped.

So the question we’re working on is simple to state: does career advice that’s checked against what really happened to people — did they get the interview? — before it’s trusted, do better than advice that isn’t checked?

To answer that honestly you need a way to measure how a different set of advice would haveperformed, using only records of the advice that was actually given. We’ve built that measuring method, and tested it on something where the right answer is already known.

The test used the Open Bandit Dataset, a public dataset from a real online fashion store that ran two recommendation approaches side by side. We gave our method the records of only one approach — more than 12 million of them — and asked it to predict how often shoppers clicked on the other one. Across three tests, its predictions landed within 0.1%, 0.5% and 2.0% of the real click rates.

That tells us the measuring tool itself works on real behaviour at a large scale. It does not tell us it works for career advice: that data is about clicks on a shopping site, not job applications, and it was a friendlier setting than ours.

• We haven’t run this test on Aethra’s own users. There isn’t enough data yet — too few people, and too few recorded outcomes — for a result to mean anything.
• Nothing in the product today is “verified” or proven to improve your chances. The scores and improvement estimates Aethra shows are the AI’s own assessments, not measured results.
• When there is enough data, we’ll run the test and say what it found — including if checked advice turns out to make no difference.

We’re working on grounding the analysis in public job-market data — starting with O*NET, the U.S. Department of Labor’s occupation database — so a suggestion can point to the skills a role actually lists, rather than relying on the AI’s general knowledge alone. It’s still being tested and isn’t part of the analysis you get today.

Questions about the research, or interested in working with us? Email support@aethrahq.com. Buying for a team? Book a demo.