I finally had a reason to edit a website with VSCode directly on the server. VSCode comes with an extension, the Remote SSH extension. I thought this will connect with the SSH server and make the filesystem available like a mounted path.