Can Universe be applied in normal DL algorithm instead of RL?


Currently my understanding is Universe can be used in RL algorithms(input are images and out put are actions).

But for a normal DL algorithm, for example, the demo from TensorFlow as CNN+supervising learning for MNIST , can I use Universe for it?

If can ,could you please share me some details?

Thanks very much!