You have to be wearing them when the spell goes off to get the benefit.
Just like the Enhances Ebullience/Rapture/Penury/Parsimony on the other AF3 pieces. You don't need them on when you activate the ability. You don't need them on when you START casting. You only need them on when the spell goes off, so right before the end of casting.