Is this just to give priority to the London-bound services on the single line between Charlbury and Oxford?
In a nutshell, yes.
It needs to reach Charlbury before the 07:15 from there coming the other way gets held up too much otherwise there's deemed to be too much of a negative impact on that and the following London bound trains. Another reason to question the need for that additional morning train from Charlbury.