Information theory and coding [ LINGI2348 ]

solid basic knowledge in computer science and mathematics as taught in 1st and 2nd year of Bachelor in Engineering

• Information representation: decorrelation coding and entropic coding.
• Information security: cryptographic coding.
• Information correction: channel coding theory and error-correcting codes.

• To explain the notions, methods and results that are used in the analysis and design of information representation, protection and correction systems.
• To present not only general results that determine the possibilities offered by information theory, but also effective compression, security and correction methods.
• To provide some design tools for multimedia (image, sound, data) information coding.

Written examination (no document allowed)

• Basic notions in information theory; mutual information and entropy.
• Discrete source coding by fixed length-codes and variable-length codes.
• Decorrelation coding and coding gain notions.
• Basic notions in cryptology; secret-key and public-key cryptographic coding systems.
• Discrete memoryless channel; capacity notion; noisy channel coding theorem.
• General block coding theory; role of the minimum distance.  
• Linear codes: generator matrix and parity-check matrix; syndrome decoding.
• Study of certain classes of linear block codes: cyclic codes and Reed-Solomon codes.
• Introduction to convolution codes.

• R.G. Gallager, "Information Theory and Reliable Communication" , John Wiley, 1968.
• F.J. MacWilliams and N.J.A. Sloane, "The Theory of Error-Correcting Codes" , North-Holland, 1977.