Why Learning QA Automation Became Pointless
The idea for this post came to me during a regular meeting with my fellow mentors, SDETs from several international…
Modern application testing
How to Test AI Applications: The Grader’s Ruler for LLM-as-a-judge
If you are using LLMs to evaluate other LLMs, it is a bad idea to use adjectives for your evals…
How to Test AI Applications:Â The Golden Standard for LLM-as-a-judge
If you are using LLMs to evaluate other LLMs, it is always better to have a golden standard to compare…
How to Test AI Applications: Determinism vs. Probability
Why the traditional QA “A + B = C” rule is broken for AI application testing and what to do?…
A take-home assignment for an AI QA role
ML evaluation take-home task: how does it look like and what do employers expect? The Scenario:A medical consultation app is…
LLM-as-a-judge in QA terminology
If you’re thinking about transitioning from QA to ML engineer, you should learn the main concepts of large language models…
Working day of AI QA engineer
If you think ML Evaluation is just “testing of AI applications,” come spend a day in my shoes. 09:30 –…
What’s the difference: QA Engineer with AI tools, AI QA Engineer and ML Evaluation Engineer
There is a growing terminology crisis in the QA market, and it is bleeding into hiring decisions and team structures.…
How to Become an AI Application Tester
The shift from automating deterministic systems to evaluating probabilistic models is not a lateral career move — it's a fundamental…