Copilot can review the code but is still pretty bad at reviewing the changes themselves. It misses a lot of potential issues and at the same time complains about many things that aren’t problems.
Another thing is that it kind of instills a false confidence. Reviewers are getting lazy when the LLM gives a ‘LGTM’ and letting stuff through that bites us in the ass…
GitHub’s Copilot review is pretty good. I thought it would just catch nitpick style things but it actually catches bugs and bad architecture.
I love it as a first pass, it’s quite good. It really gets hung up on some out the ghosts of our codebase though haha
Copilot can review the code but is still pretty bad at reviewing the changes themselves. It misses a lot of potential issues and at the same time complains about many things that aren’t problems.
Another thing is that it kind of instills a false confidence. Reviewers are getting lazy when the LLM gives a ‘LGTM’ and letting stuff through that bites us in the ass…