Thought I would talk about my setup.
I have a laptop, with 25kWh battery, 512 GB SSD and 8 GiB ram (out of which only ~6GiB is usable for some reason).
So for me power consumption and memory consumption are important factors, power being the most important.
What I have done is install a full blown debian desktop (I chose lxqt, but it’s better to get gnome, I will get in to why soon) then make a another user with sudo group (called it dwm) then setup dwm (window manager, gnome is a different window manager for example).
Now I have set the the default to multi-user.target instead of graphical.target, which simply means it boots into console instead of the default window manager, then I run startx with dwm.
If you like tinkering, this is a great option, there is alot of documentation and forums dedicated to this stuff, for most stuff I do (working in terminal, programming, etc.) you don’t need all the stuff provided by the defaults, but in case you need it set the default target back reboot and you have 'em all.
The reason I suggest installing a fullblown debian and gnome in perticular is because of it’s popularity, it will have the best working stuff, the lxqt’s network app doesn’t work few days after installing for me, I had to install NetworkManager (app used by old gnome).
You get convenience and efficiency, at the cost of storage, for me it’s a pretty great deal.
I have never used xfce, it seems pretty popular, you should try it and see how it goes. Use it for atleast a week, install it besides your existing system, it’s a lot easier than it sounds.