I wonder if they've done some Alpaca style training on it... Granted, what made Alpaca useful was that it was finetuned with GPT-3's instruction following completions as examples.

And, at least officially, OpenAI's outputs can't be used to train other AI models.

Otherwise, if GPT-4 outputs were used to finetune these models, they may become much more interesting.