A Gentle Introduction to Code Generation Evaluation

An overview and comparison of the available code generation evaluation metrics

Photo by William Warby on Unsplash

With the release of the OpenAI Codex model, code generation using deep learning is becoming a hot topic primarily due to the impressive results of some models, and I think this will make us re-evaluate and re-image how we create software in the…