In 3 months or so Linux on the Ally should be in good shape. There’s a fix for sound coming in 6.5, and it sounds like wifi support has someone on it but the patch might not be ready or something. Then Chimera or some other Linux distro that tracks the latest kernels would be the way to go.
IMO you should wait at least for kernel 6.5 and for chimera or whatever distro to be using it, as some fixes for the Ally should be in place by then like sound and hopefully wifi.