Course detail

Multimedia

FIT-MULAcad. year: 2018/2019

Definition of multimedia technology, multimedia peripheral devices, connection between signal processing and multimedia, digital signal processors and their features, "case study" of system design with digital signal processor, Windows sound, video, and raster operation API, formats for image and sound digitization, formats for image and sound encoding, image compression, video compression, sound compression, DirectX raster operations, DirectX sound, OpenGL raster operations, multimedia programming interfaces.

Learning outcomes of the course unit

The students will learn and understand basic methods of image processing and sound processing as 2D and 1D digital signals. They will get acquainted with compression and decompression methods for image and sound data in PC environment. They will also learn how to exploit programmers interfaces' for image and sound and get acquainted with data formats for image and sound representation and with basic features of digital signal processors. They will learn about raster operations in Windows API, DirectX, and OpenGL and with sound interfaces of Windows API and DirectX, too. Finally, they will get acquainted with the anticipated development of multimedia data processing.
The students will learn to search team partners, to work in team, and to defend their work in public. They will also improve their skills in development tools usage and also in practical C/C++ programming.

Prerequisites

Basic knowledge of C/C++ programming, basics of signal processing.

Co-requisites

Not applicable.

Recommended optional programme components

Not applicable.

Recommended or required reading

  • Wodtke, M.: Mind Over Media, McGraw-Hill, New York, USA, 1993, ISBN 0-07-067633-X

  • Simon, R. J.: Multimedia & ODBC API Bible, Watte Group Press, Carte Madera, CA, USA, 1996, ISBN 1-57169-011-5
  • IEEE Multimedia, IEEE, USA - série časopisů - různé články
  • Oney, W.: Systems Programming for Windows, Microsoft Press, Redmond, WA, USA, 1996, ISBN 1-55615-949-8
  • Wodtke, M.: Mind Over Media, McGraw-Hill, New York, USA, 1993, ISBN 0-07-067633-X
  • Wodaski, R.: PC Video Madness, SAMS Publishing, Carmel, IN, USA, 1993, ISBN 0-672-30322-1
  • Wodaski, R.: Multimedia Madness, SAMS Publishing, Carmel, IN, USA, 1992, ISBN 0-672-30249-7

Planned learning activities and teaching methods

Not applicable.

Assesment methods and criteria linked to learning outcomes

Mid-term test, evaluated computer exercises, and individual project.

Language of instruction

Czech, English

Work placements

Not applicable.

Course curriculum

    Syllabus of lectures:
    1. Introduction to multimedia technology, multimedia peripheral devices, prerequisites overview
    2. Connection between signal processing and multimedia, examples
    3. Digital signal processors and their features, example of sound processing through signal processor
    4. "Case study" of system design with digital signal processor
    5. Windows sound and Video I API
    6. Windows video II and raster operations API
    7. Formats for image and sound, digitization, encoding
    8. Image and video compression
    9. Sound compression
    10. DirectX - raster operations
    11. DirectX - sound
    12. OpenGL - raster operations
    13. Multimedia programming interfaces

    Syllabus of computer exercises:
    1. Introductory lab, introduction to tools
    2. Sound filter design and implementation
    3. Raster operations in Windows API
    4. Video sequence processing
    5. JPEG compression - DCT settings
    6. DirectX interface for sound and image

    Syllabus - others, projects and individual work of students:
    1. Individually assigned examples for the duration of the course

Aims

To learn and understand basic methods of image processing and sound processing as 2D and 1D digital signals. To get acquainted with compression and decompression methods for image and sound data in PC environment. To learn how to exploit programmers' interfaces for image and sound. To get acquainted with data formats for image and sound representation. To get acquainted with basic features of digital signal processors. To learn about raster operations in Windows API, DirectX, and OpenGL and sound interfaces of Windows API and DirectX. To get acquainted with the anticipated development of multimedia data processing.

Specification of controlled education, way of implementation and compensation for absences

The monitored teaching activities include mid-term test, evaluated computer exercises, individual project, and final exam. The mid-term test does not have correction option, the final exam has two possible correction terms.

The minimal number of points which can be obtained from the final exam is 17. Otherwise, no points will be assigned to a student.

Classification of course in study plans

  • Programme IT-MGR-2 Master's

    branch MBI , any year of study, summer semester, 5 credits, optional
    branch MPV , any year of study, summer semester, 5 credits, optional
    branch MSK , any year of study, summer semester, 5 credits, optional
    branch MIS , any year of study, summer semester, 5 credits, compulsory-optional
    branch MBS , any year of study, summer semester, 5 credits, optional
    branch MIN , any year of study, summer semester, 5 credits, optional
    branch MMI , any year of study, summer semester, 5 credits, optional
    branch MMM , any year of study, summer semester, 5 credits, optional
    branch MGM , 1. year of study, summer semester, 5 credits, compulsory

Type of course unit

 

Lecture

26 hours, optionally

Teacher / Lecturer

Syllabus


  1. Introduction to multimedia (6. 2. 2019, Zemčík, slides)
  2. Compression techniques (13. 2. 2019, Bařina, slides)
  3. Filtering (20. 2. 2019, Zemčík, slides)
  4. Sound formats (27. 2. 2019, Grézl, slides)
  5. Sound interfaces (6. 3. 2019, Bařina, slides)
  6. Image and video compression principles (13. 3. 2019, Zemčík, slides)
  7. Image formats (20. 3. 2019, Bařina, slides)
  8. Video formats (27. 3. 2019, Bařina, slides)
  9. Test, Multimedia frameworks (3. 4. 2019, Bařina, slides)
  10. OpenGL (10. 4. 2019, Milet, slides)
  11. DirectX (17. 4. 2019, Kobrtek, slides)
  12. Formats and technology of TV (24. 4. 2019, guest lecturer Novotný, slides)
  13. no lecture - Labour Day (1. 5. 2019)

Exercise in computer lab

13 hours, compulsory

Teacher / Lecturer

Syllabus


  1. Sound filter design and implementation
  2. JPEG compression, DCT settings
  3. Video sequence processing
  4. OpenGL interface
  5. DirectX interface for sound and image

Project

13 hours, compulsory

Teacher / Lecturer

Syllabus


  1. Individually assigned projects for the duration of the course.

eLearning