[en] The emergence of the AI era signifies a shift in the future landscape of global communication networks, wherein robots are expected to play a more prominent role compared to humans. The establishment of a novel paradigm for the development of next-generation 6G communication is of utmost importance for semantics task-oriented empowered communications. The goal of semantic communication lies in the integration of collaborative efforts between the intelligence of the transmission source and the joint design of source coding and channel coding. This characteristic represents a significant benefit of joint source-channel coding (JSCC), as it enables the generation of source alphabets with diverse lengths and achieves a code rate of unity. Therefore, we leverage not only quasi-cyclic (QC) characteristics to facilitate the utilization of flexible structural hardware design but also Unequal Error Protection (UEP) to ensure the recovery of semantic importance. In this study, the feasibility of using a semantic encoder/decoder that is aware of UEP can be explored based on the existing JSCC system. This approach is aimed at protecting the significance of semantic task-oriented information. Additionally, the deployment of a JSCC system can be facilitated by employing QC-Low-Density Parity-Check (LDPC) codes on a reconfigurable device. The QC-LDPC layered decoding technique, which has been specifically optimized for hardware parallelism and tailored for channel decoding applications, can be suitably adapted to accommodate the JSCC system. The performance of the proposed system is evaluated by conducting BER measurements using both floating-point and 6-bit quantization. This is done to assess the extent of performance deterioration in a fair manner. The fixed-point system is synthesized and subsequently used as a semantic feature transmission and reception system across a noisy channel, with the aim of presenting a prototype for semantic communications. This study concludes with some insights and potential research avenues for the JSCC prototype in the context of future communication.
Disciplines :
Electrical & electronics engineering
Author, co-author :
Zhong, Xinchao; The University of Auckland, School of Computer Science, Auckland, New Zealand
Sham, Chiu-Wing ; The University of Auckland, School of Computer Science, Auckland, New Zealand
Ma, Sean Longyu ; The University of Auckland, School of Computer Science, Auckland, New Zealand
Chou, Hong-Fu; University of Luxembourg, Interdisciplinary Centre for Security, Reliability and Trust (SnT), Esch-sur-Alzette, Luxembourg
MOSTAANI, Arsham ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust > SigCom > Team Symeon CHATZINOTAS
VU, Thang Xuan ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
CHATZINOTAS, Symeon ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
CHOU, Hung-Pu ✱; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
✱ These authors have contributed equally to this work.
External co-authors :
yes
Language :
English
Title :
Joint Source-Channel Coding System for 6G Communication: Design, Prototype and Future Directions
Publication date :
30 January 2024
Journal title :
IEEE Access
ISSN :
2169-3536
Publisher :
Institute of Electrical and Electronics Engineers Inc.
A. Mostaani, T. X. Vu, S. K. Sharma, V.-D. Nguyen, Q. Liao, and S. Chatzinotas, "Task-oriented communication design in cyber-physical systems: A survey on theory and applications," IEEE Access, vol. 10, pp. 133842-133868, 2022.
Z. Lu, R. Li, K. Lu, X. Chen, E. Hossain, Z. Zhao, and H. Zhang, "Semantics-empowered communication: A tutorial-cum-survey," 2022, arXiv:2212.08487.
J. Tang, Q. Yang, and Z. Zhang, "Information-theoretic limits on compression of semantic information," 2023, arXiv:2306.02305.
J. Xu, B. Ai,W. Chen, A. Yang, P. Sun, and M. Rodrigues, "Wireless image transmission using deep source channel coding with attention modules," IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 4, pp. 2315-2328, Apr. 2022.
Y. Shi, Y. Zhou, D. Wen, Y. Wu, C. Jiang, and K. B. Letaief, "Taskoriented communications for 6G: Vision, principles, and technologies," IEEE Wireless Commun., vol. 30, no. 3, pp. 78-85, Jun. 2023.
C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, no. 3, pp. 379-423, 1948. [Online]. Available: http://plan9.bell-labs.com/cm/ms/what/shannonday/shannon1948.pdf
Y. He, G. Yu, and Y. Cai, "Rate-adaptive coding mechanism for semantic communications with multi-modal data," 2023, arXiv:2305.10773.
E. C. Strinati and S. Barbarossa, "6G networks: Beyond Shannon towards semantic and goal-oriented communications," Comput. Netw., vol. 190, May 2021, Art. no. 107930.
N. Farsad, M. Rao, and A. Goldsmith, "Deep learning for joint sourcechannel coding of text," 2018, arXiv:1802.06832.
H. Xie, Z. Qin, G. Y. Li, and B.-H. Juang, "Deep learning enabled semantic communication systems," IEEE Trans. Signal Process., vol. 69, pp. 2663-2675, 2021.
A. Mostaani, T. X. Vu, S. Chatzinotas, and B. Ottersten, "Task-oriented data compression for multi-agent communications over bit-budgeted channels," IEEE Open J. Commun. Soc., vol. 3, pp. 1867-1886, 2022.
T.-Y. Tung, S. Kobus, J. R. Pujol, and D. Gunduz, "Effective communications: A joint learning and communication framework for multi-agent reinforcement learning over noisy channels," 2021, arXiv:2101.10369.
A. Mostaani, O. Simeone, S. Chatzinotas, and B. Ottersten, "Learningbased physical layer communications for multiagent collaboration," in Proc. IEEE 30th Annu. Int. Symp. Pers., Indoor Mobile Radio Commun. (PIMRC), Sep. 2019, pp. 1-6.
N. Shlezinger and Y. C. Eldar, "Deep task-based quantization," Entropy, vol. 23, no. 1, p. 104, Jan. 2021.
M. A. Gutierrez-Estevez, Y. Wu, and C. Zhou, "Learning to communicate with intent: An introduction," 2022, arXiv:2211.09613.
A. Mostaani, T. X. Vu, S. K. Sharma, V.-D. Nguyen, Q. Liao, and S. Chatzinotas, "Task-oriented communication design in cyber-physical systems: A survey on theory and applications," 2021, arXiv:2102.07166.
P. Agheli, N. Pappas, and M. Kountouris, "Semantic source coding for two users with heterogeneous goals," in Proc. IEEE Global Commun. Conf., Dec. 2022, pp. 4983-4988.
D. Gunduz, Z. Qin, I. E. Aguerri, H. S. Dhillon, Z. Yang, A. Yener, K. K. Wong, and C.-B. Chae, "Beyond transmitting bits: Context, semantics, and task-oriented communications," 2022, arXiv:2207.09353.
H. Xie, Z. Qin, X. Tao, and K. B. Letaief, "Task-oriented multi-user semantic communications," IEEE J. Sel. Areas Commun., vol. 40, no. 9, pp. 2584-2597, Sep. 2022.
F. A. Oliehoek, M. T. J. Spaan, and N. Vlassis, "Optimal and approximate Q-value functions for decentralized POMDPs," J. Artif. Intell. Res., vol. 32, pp. 289-353, May 2008.
M. Lanctot, V. Zambaldi, A. Gruslys, A. Lazaridou, K. Tuyls, J. Perolat, D. Silver, and T. Graepel, "A unified game-theoretic approach to multiagent reinforcement learning," 2017, arXiv:1711.00832.
G. E. Monahan, "State of the art-A survey of partially observable Markov decision processes: Theory, models, and algorithms," Manage. Sci., vol. 28, no. 1, pp. 1-16, Jan. 1982.
V. Kostina and B. Hassibi, "Rate-cost tradeoffs in control," 2018, arXiv:1612.02126.
A. Mostaani and O. Simeone, "On learning how to communicate over noisy channels for collaborative tasks," 2018, arXiv:1810.01155.
B. Larrousse, S. Lasaulce, and M. R. Bloch, "Coordination in distributed networks via coded actions with application to power control," IEEE Trans. Inf. Theory, vol. 64, no. 5, pp. 3633-3654, May 2018.
Y. E. Sagduyu, S. Ulukus, and A. Yener, "Task-oriented communications for NextG: End-to-end deep learning and AI security aspects," IEEE Wireless Commun., vol. 30, no. 3, pp. 52-60, Jun. 2023.
Y. E. Sagduyu, T. Erpek, S. Ulukus, and A. Yener, "Vulnerabilities of deep learning-driven semantic communications to backdoor (Trojan) attacks," in Proc. 57th Annu. Conf. Inf. Sci. Syst. (CISS), Mar. 2023, pp. 1-6.
J. Kang, J. He, H. Du, Z. Xiong, Z. Yang, X. Huang, and S. Xie, "Adversarial attacks and defenses for semantic communication in vehicular metaverses," 2023, arXiv:2306.03528.
I. Ullah, F. Ud Din, J. N. Chattha, and M. Uppal, "Compress-andforward relaying: Prototyping and experimental evaluation using SDRs," in Proc. IEEE 84th Veh. Technol. Conf. (VTC-Fall), Sep. 2016, pp. 1-5.
M. F. Brejza, R. G. Maunder, B. M. Al-Hashimi, and L. Hanzo, "A highthroughput FPGA architecture for joint source and channel decoding," IEEE Access, vol. 5, pp. 2921-2944, 2017.
S. M. Romero, M. Hassanin, J. Garcia-Frias, and G. R. Arce, "Analog joint source channel coding for wireless optical communications and image transmission," J. Lightw. Technol., vol. 32, no. 9, pp. 1654-1662, May 2014.
X. Zhao, V. Sadhu, and D. Pompili, "Low-power all-analog circuit for rectangular-type analog joint source channel coding," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), May 2016, pp. 1410-1413.
X. Zhao, V. Sadhu, A. Yang, and D. Pompili, "Improved circuit design of analog joint source channel coding for low-power and low-complexity wireless sensors," IEEE Sensors J., vol. 18, no. 1, pp. 281-289, Jan. 2018.
M. Liu, W. Chen, J. Xu, and B. Ai, "Real-time implementation and evaluation of SDR-based deep joint source-channel coding," in Proc. IEEE 96th Veh. Technol. Conf. (VTC-Fall), Sep. 2022, pp. 1-5.
H. Yoo, L. Dai, S. Kim, and C.-B. Chae, "On the role of ViT and CNN in semantic communications: Analysis and prototype validation," IEEE Access, vol. 11, pp. 71528-71541, 2023.
R. J. McEliece, The Theory of Information and Coding. Cambridge, U.K.: Cambridge Univ. Press, 2004.
K. Sayood and J. C. Borkenhagen, "Use of residual redundancy in the design of joint source/channel coders," IEEE Trans. Commun., vol. 39, no. 6, pp. 838-846, Jun. 1991.
J. Hagenauer, "Source-controlled channel decoding," IEEE Trans. Commun., vol. 43, no. 9, pp. 2449-2457, Sep. 1995.
M. Jeanne, J.-C. Carlach, and P. Siohan, "Joint source-channel decoding of variable-length codes for convolutional codes and turbo codes," IEEE Trans. Commun., vol. 53, no. 1, pp. 10-15, Jan. 2005.
A. Zribi, R. Pyndiah, S. Zaibi, F. Guilloud, and A. Bouallegue, "Lowcomplexity soft decoding of Huffman codes and iterative joint source channel decoding," IEEE Trans. Commun., vol. 60, no. 6, pp. 1669-1679, Jun. 2012.
M. Fresia, F. Perez-Cruz, H. V. Poor, and S. Verdu, "Joint source and channel coding," IEEE Signal Process. Mag., vol. 27, no. 6, pp. 104-113, Nov. 2010.
R. G. Gallager, "Low-density parity-check codes," IRE Trans. Inf. Theory, vol. 8, no. 1, pp. 21-28, Jan. 1962.
O. Y. Bursalioglu, G. Caire, and D. Divsalar, "Joint source-channel coding for deep-space image transmission using rateless codes," IEEE Trans. Commun., vol. 61, no. 8, pp. 3448-3461, Aug. 2013.
A. Gabay, P. Duhamel, and O. Rioul, "Real BCH codes as joint source channel codes for satellite images coding," in Proc. IEEE Global Telecommun. Conf., vol. 2, 2000, pp. 820-824.
Z. Xu, L. Wang, S. Hong, F. C. M. Lau, and C.-W. Sham, "Joint shuffled scheduling decoding algorithm for DP-LDPC codes-based JSCC systems," IEEE Wireless Commun. Lett., vol. 8, no. 6, pp. 1696-1699, Dec. 2019.
F. C. M. Lau and J. Zhan, "Joint source-channel codes based on a single protograph," in Proc. 11th Int. Symp. Topics Coding (ISTC), Montreal, QC, Canada, Aug. 2021, pp. 1-5.
R. Guo, P. Zhou, and J.-L. Liu, "A new JSCC scheme for image transmission over frequency selective fading channels," in Proc. 8th Int. Conf. Signal Process., vol. 3, 2006.
H. El Meddeb, H. Noureddine, and A. Bouallegue, "Efficient utilization of bandwidth in JSCC for wireless communication," in Proc. 3rd Int. Symp. Commun., Control Signal Process., Mar. 2008, pp. 1510-1515.
F.-X. Coudoux, M. G. Gazalet, C. Mouton-Goudemand, P. Corlay, and M. Gharbi, "Extended coverage for DSL video distribution using a qualityoriented JSCC architecture," IEEE Trans. Broadcast., vol. 54, no. 3, pp. 525-531, Sep. 2008.
Q. Chen, L.Wang, S. Hong, and Z. Xiong, "Performance improvement of JSCC scheme through redesigning channel code," IEEE Commun. Lett., vol. 20, no. 6, pp. 1088-1091, Jun. 2016.
Y. Lyu, S. Hong, L. Wang, and Z. Xiong, "Reliability-oriented decoding strategy for LDPC codes-based D-JSCC system," IEEE Commun. Lett., vol. 21, no. 11, pp. 2364-2367, Nov. 2017.
S. Liu, L. Wang, J. Chen, and S. Hong, "Joint component design for the JSCC system based on DP-LDPC codes," IEEE Trans. Commun., vol. 68, no. 9, pp. 5808-5818, Sep. 2020.
D. Slepian and J. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inf. Theory, vol. IT-19, no. 4, pp. 471-480, Jul. 1973.
R. Zarubica, S. G. Wilson, and E. Hall, "Multi-Gbps FPGA-based low density parity check (LDPC) decoder design," in Proc. IEEE Global Telecommun. Conf., Nov. 2007, pp. 548-552.
Y. Xiao, C. Luo, and C. Yang, "The comparative analysis of LDPC and RS code," in Proc. Int. Conf. Consum. Electron., Commun. Netw. (CECNet), Apr. 2011, pp. 4510-4513.
P. Hailes, L. Xu, R. G. Maunder, B. M. Al-Hashimi, and L. Hanzo, "Hardware-efficient node processing unit architectures for flexible LDPC decoder implementations," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 65, no. 12, pp. 1919-1923, Dec. 2018.
J. Tian, J. Lin, and Z. Wang, "A 21.66 Gbps nonbinary LDPC decoder for high-speed communications," IEEE Trans. Circuits Syst. II. Exp. Briefs, vol. 65, no. 2, pp. 226-230, Feb. 2018.
V. L. Petroviæ, M. M. Markoviæ, D. M. E. Mezeni, L. V. Saranovac, and A. Radoseviæ, "Flexible high throughput QC-LDPC decoder with perfect pipeline conflicts resolution and efficient hardware utilization," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 67, no. 12, pp. 5454-5467, Dec. 2020.
M. Kalya and S. Kumar, "Low complexity LDPC error correction code for modified Anderson PUF to improve its uniformity," in Proc. Int. Conf. Smart Electron. Commun. (ICOSEC), Sep. 2020, pp. 997-1002.
C.-W. Sham, X. Chen, W. M. Tam, Y. Zhao, and F. C. M. Lau, "A layered QC-LDPC decoder architecture for high speed communication system," in Proc. IEEE Asia Pacific Conf. Circuits Syst., Dec. 2012, pp. 475-478.
Q. Lu, Z. Shen, C.-W. Sham, and F. C. M. Lau, "A parallel-routing network for reliability inferences of single-parity-check decoder," in Proc. Int. Conf. Adv. Technol. Commun. (ATC), Oct. 2015, pp. 127-132.
X.-Y. Hu, E. Eleftheriou, D.-M. Arnold, and A. Dholakia, "Efficient implementations of the sum-product algorithm for decoding LDPC codes," in Proc. IEEE Global Telecommun. Conf., 2001, p. 1036.
H. D. Tiwari, H. N. Bao, and Y. B. Cho, "Flexible LDPC decoder using stream data processing for 802.11n and 802.16e," IEEE Trans. Consum. Electron., vol. 57, no. 4, pp. 1505-1512, Nov. 2011.
C.-W. Sham, X. Chen, F. C. M. Lau, Y. Zhao, and W. M. Tam, "A 2.0 Gb/s throughput decoder for QC-LDPC convolutional codes," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 60, no. 7, pp. 1857-1869, Jul. 2013.
Q. Lu, J. Fan, C.-W. Sham, W. M. Tam, and F. C. M. Lau, "A 3.0 Gb/s throughput hardware-efficient decoder for cyclically-coupled QC-LDPC codes," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 63, no. 1, pp. 134-145, Jan. 2016.
M.-R. Li, W.-X. Chu, H.-C. Lee, and Y.-L. Ueng, "An efficient highrate non-binary LDPC decoder architecture with early termination," IEEE Access, vol. 7, pp. 20302-20315, 2019.
H. Zhang, A. P. Hekstra, and B. Yin, "Performance evaluation of LDPC codes in bliss scheme-based storage systems using density evolution," IEEE Trans. Consum. Electron., vol. 52, no. 3, pp. 879-887, Aug. 2006.
Q. Lu, C.-W. Sham, and F. C. M. Lau, "On using the cyclicallycoupled QC-LDPC codes in future SSDs," in Proc. IEEE Asia-Pacific Conf. Circuits Syst. (APCCAS), Oct. 2016, pp. 625-628.
L. Ma, H.-F. Chou, and C.-W. Sham, "A novel data packing technique for QC-LDPC decoder architecture applied to NAND flash controller," in Proc. IEEE 8th Global Conf. Consum. Electron. (GCCE), Oct. 2019, pp. 897-898.
U. Uludag, S. Pankanti, S. Prabhakar, and A. K. Jain, "Biometric cryptosystems: Issues and challenges," Proc. IEEE, vol. 92, no. 6, pp. 948-960, Jun. 2004.
Y. Sutcu, S. Rane, J. S. Yedidia, S. C. Draper, and A. Vetro, "Feature extraction for a Slepian-Wolf biometric system using LDPC codes," in Proc. IEEE Int. Symp. Inf. Theory, Jul. 2008, pp. 2297-2301.
L. Ma, C. W. Sham, C. Y. Lo, and X. Zhong, "A dynamically reconfigurable QC-LDPC implementation for iris recognition," in Proc. IEEE 10th Global Conf. Consum. Electron. (GCCE), Oct. 2021, pp. 808-812.
V. Buttigieg and P. G. Farrell, "On variable-length error-correcting codes," in Proc. IEEE Int. Symp. Inf. Theory, 1994, p. 507.
R. G. Maunder, W. Zhang, T. Wang, and L. Hanzo, "A unary error correction code for the near-capacity joint source and channel coding of symbol values from an infinite set," IEEE Trans. Commun., vol. 61, no. 5, pp. 1977-1987, May 2013.
R. G. Maunder, "A fully-parallel turbo decoding algorithm," IEEE Trans. Commun., vol. 63, no. 8, pp. 2762-2775, Aug. 2015.
D. B. Kurka and D. Gündüz, "Bandwidth-agile image transmission with deep joint source-channel coding," 2021, arXiv:2009.12480.
T.-Y. Tung and D. Gunduz, "Deep joint source-channel and encryption coding: Secure semantic communications," 2022, arXiv:2208.09245.
D. B. Kurka and D. Gündüz, "DeepJSCC-f: Deep joint source-channel coding of images with feedback," IEEE J. Sel. Areas Inf. Theory, vol. 1, no. 1, pp. 178-193, May 2020.
S. Xie, S. Ma, M. Ding, Y. Shi, M. Tang, and Y. Wu, "Robust information bottleneck for task-oriented communication with digital modulation," 2023, arXiv:2209.10382.
H.Yoo, T. Jung, L. Dai, S. Kim, and C.-B. Chae, "Demo: Real-time semantic communications with a vision transformer," 2022, arXiv:2205.03886.
H.-F. Chou and C.-W. Sham, "An optimization approach for an RLLconstrained LDPC coded recording system using deliberate flipping," IEEE Commun. Lett., vol. 22, no. 10, pp. 1976-1979, Oct. 2018.
C. Chen, L. Wang, and F. C. M. Lau, "Joint optimization of protograph LDPC code pair for joint source and channel coding," IEEE Trans. Commun., vol. 66, no. 8, pp. 3255-3267, Aug. 2018.
D. Divsalar, S. Dolinar, C. Jones, and K. Andrews, "Capacity-approaching protograph codes," IEEE J. Sel. Areas Commun., vol. 27, no. 6, pp. 876-888, Aug. 2009.
J. Zhan and F. C. M. Lau, "Design of joint source-channel codes based on a generic protograph," 2022, arXiv:2205.08121.
M. P. C. Fossorier, "Quasi-cyclic low-density parity-check codes from circulant permutation matrices," IEEE Trans. Inf. Theory, vol. 50, no. 8, pp. 1788-1793, Aug. 2004.
K. K. Gunnam, G. S. Choi, M. B. Yeary, and M. Atiquzzaman, "VLSI architectures for layered decoding for irregular LDPC codes of Wimax," in Proc. IEEE Int. Conf. Commun., Jun. 2007, pp. 4542-4547.
H.-F. Chou and C.-W. Sham, "Unequal protection approach for RLLconstrained LDPC coded recording system using deliberate flipping," in Proc. Int. SoC Design Conf. (ISOCC), Nov. 2017, pp. 25-26.
A. Li, P. Hailes, R. G. Maunder, B. M. Al-Hashimi, and L. Hanzo, "1.5 Gbit/s FPGA implementation of a fully-parallel turbo decoder designed for mission-critical machine-type communication applications," IEEE Access, vol. 4, pp. 5452-5473, 2016.
X. Zhong and C.-W. Sham, "A RISC-V based SoC with configurable CPK sensor interface for ECU on motorcycle," in Proc. IEEE 12th Global Conf. Consum. Electron. (GCCE), Oct. 2023, pp. 321-322.
P. Jiang, D. Ergu, F. Liu, Y. Cai, and B. Ma, "A review of YOLO algorithm developments," Proc. Comput. Sci., vol. 199, pp. 1066-1073, Jan. 2022. [Online]. Available: https://www.sciencedirect.com/science/ article/pii/S1877050922001363
Z. Xu, L. Wang, and S. Hong, "Joint early stopping criterions for protograph LDPC codes-based JSCC system in images transmission," Entropy, vol. 23, no. 11, p. 1392, Oct. 2021. [Online]. Available: https://www.mdpi.com/1099-4300/23/11/1392
Y. Dong, J. Dai, K. Niu, S. Wang, and Y. Yuan, "Joint source-channel coding for 6G communications," China Commun., vol. 19, no. 3, pp. 101-115, Mar. 2022.
N. D. Pham, A. Abuadbba, Y. Gao, K. T. Phan, and N. Chilamkurti, "Binarizing split learning for data privacy enhancement and computation reduction," IEEE Trans. Inf. Forensics Security, vol. 18, pp. 3088-3100, 2023.
D. Liu and O. Simeone, "Privacy for free: Wireless federated learning via uncoded transmission with adaptive power control," 2021, arXiv:2006.05459.
