Businessman denies ‘intimidation’ of worker left in tears in row over annual leave for sister’s wedding