Cardinal Lofts in Foundry Lane near Ipswich Waterfront will be demolished after planning permission was granted.