Semantic Communication Over Channels with Insertions, Deletions, and Substitutions

Happy to share the first semantic communication framework on insertion-deletion-substitution (IDS) channels as published in our latest paper titled “Semantic Communication over Channels with Insertions, Deletions, and Substitutions” published in IEEE Communications Letters!

A significant class of binary input channels are prone to synchronization errors, which are modeled as IDS channels. IDS channels occur in many scenarios like wireless communications, file synchronization, bit-patterned media, racetrack memories, and DNA storage.

In our paper, we propose the first joint semantic transmission scheme for binary channels with synchronization errors, a novel training strategy that utilizes a pre-trained error correction network in the joint-source channel coding schemes with a transfer learning approach.

Our proposed architecture consists of a three-stage training algorithm that combines, for the first time, gated recurrent unit (GRU) networks for marker detection, transformer-based semantic communication for continuous latent space, and lookup-free quantization for binarized latent space optimization, specifically tailored to IDS channels.

 

Check out the paper for more details!

Paper: https://ieeexplore.ieee.org/abstract/document/10852305
Code: https://github.com/koc-lab/deepjsoc

 

Abstract:

We present deep joint source-outer channel coding (DeepJSOC), an end-to-end deep learning-based semantic communication architecture designed for channels with insertions, deletions, and substitutions (IDS). We propose a three-stage training algorithm that combines, for the first time, gated recurrent unit (GRU) networks for marker detection, transformer-based semantic communication for continuous latent space, and lookup-free quantization for binarized latent space optimization, specifically tailored to IDS channels. The proposed DeepJSOC is the first to integrate deep learning-based error correction networks into joint-source channel coding schemes for binary channels with synchronization errors. We demonstrate the effectiveness of DeepJSOC by experiments, achieving significant improvements over existing methods in text transmission.