You should be getting better performance that that. I have a 6600 xt and it’ll generate a 512x512 image in about 7 seconds. Taking several minutes for a batch of 4 is a lot slower than you should be getting.
I will admit there are definitely VRAM issues for doing higher resolutions or some control net types (depth for example).
I haven’t tried Element X, but I’d like to recommend SchildiChat as a good matrix client for desktop and mobile. My understanding is it’s a fork of element, but it works much better and more reliably in my experience. Element was very inconsistent about fetching messages for example.