You can repot it now. With no problem, water in with the usual seasol and in semi shade on the very hot days we have a couple coming towards the end of the week after a couple of weeks back in full sun. Olives love the sun.
Love where you are taking the style of this one. Olives

Cheers
Kirky