While you have the skull in your possession, you are invisible to mind flayers, as is anything you are wearing or carrying.