Add patch to fix compilation with fmt 11.1. Remove upstreamed patch. Signed-off-by: Rosen Penev <rosenp@gmail.com>