Do I have to accept my shares?

Technically, No. You can choose not to accept the grant agreement and the shares will not be made available.