I've had a number of discussions with Rick on the issue of the COMMANDS file. We see this file going beyond just defining the set of commands deployed in IRIS. It in fact specifies what commands are in the KBase CLI. We plan to integrate the file with the release engineering process.