Harbour has spoken publicly for the first time since Allen’s album was released last fall