The Github API allows comparing two commits. When upgrading, compare the currently installed commit with the one the user selected and display the diff, nicely formatted, in a new window. This diff should only include the commit messages and the author.
Include a user preference to disable this.
In an ideal and future world where running LLMs locally isn't an issue, an integrated LLM could provide a summary of all the changes.