We propose a method to improve the performance of the nonlinear Fourier transform (NFT)-based optical transmission system by applying the neural network post-processing of the nonlinear spectrum at the receiver. We demonstrate through numerical modeling about one order of magnitude bit error rate improvement and compare this method with machine learning processing based on the classification of the received symbols. The proposed approach also offers a way to improve numerical accuracy of the inverse NFT; therefore, it can find a range of applications beyond optical communications.
Bibliographical notePublished by The Optical Society under the terms of the Creative Commons Attribution 4.0 License. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.
Funding: H2020 Marie Skłodowska-Curie Actions (GA2015-713694, 751561); Engineering and Physical Sciences
Research Council (Project TRANSNET EP/R035342/1);
Leverhulme Trust (Grant RP-2018-063).