AI Code Review Has a Correctness Problem
Over the past two years, AI code review has gone from novelty to something many developers use every day, and the feedback can be genuinely impressive. Ask a modern model to review a pull request and you'll often get thoughtful comments about readability, naming, architecture, test coverage — the kind of observations that would have taken a human reviewer considerably longer to make.
I've spent the past while benchmarking several leading models against real pull requests, and the longer I looked at the results, the more one observation kept surfacing.
The reviews were often excellent.
The software wasn't.