The actor says celebrations will be different but the spirit of the festival will remain intact since he will be with hi