Presenting Romae At Neurips

I’m quite excited to say that our paper introducing the Rotary Masked Autoencoder (RoMAE) has been accepted for a poster at this year’s NeurIPS. For anyone working with irregular time-series or rotary positional embeddings you may find it interesting. I’m looking forward to using RoMAE in future work for some interesting datasets. Specifically, I’d like to do a proper analysis of it’s potential uses with data from the LSST. Particularly exciting is the idea of (nearly) label-free classification through some combination of rep. learning and nearest-neighbors or something similar. Anyway, check the paper out!