One way to do that for C# is to build your model in PyTorch then transform it to ONNX which Microsoft has a bunch of C# tooling support for: https://docs.microsoft.com/en-us/windows/ai/windows-ml/train....

I am curious though, what mobile device are you trying to run on?