Nowadays the Tk backend works pretty well and is available everywhere. Maybe we should just use it (or the Agg backend for non-interactive code) and drop support for all of the other backends (which complicate the code a lot for not much benefit).
@PaulSoderlind, you mentioned wanting the Qt5 backend; could you elaborate?