USB devices are block devices like any other. Linux doesn't care if you install or boot from a SATA disk or a USB disk, it makes no differences in that regard. The only niggle is can be BIOS support, ...
I switch between computers a lot, so I use a persistent Linux USB that keeps my workspace consistent anywhere.