Fundamentals of multimedia = 多媒体技术教程 (英文版)PDF|Epub|txt|kindle电子书版本网盘下载

Fundamentals of multimedia = 多媒体技术教程 (英文版)PDF格式电子书版下载

注意：本站所有压缩包均有解压码： 点击下载压缩包解压工具

Ⅰ Multimedia Authoring and Data Representations1

1 Introduction to Multimedia3

1.1 What is Multimedia？3

1.1.1 Components of Multimedia3

1.1.2 Multimedia Research Topics and Projects4

1.2 Multimedia and Hypermedia5

1.2.1 History of Multimedia5

1.2.2 Hypermedia and Multimedia7

1.3 World Wide Web8

1.3.1 History of the WWW8

1.3.2 HyperText Transfer Protocol （HTTP）9

1.3.3 HyperText Markup Language （HTML）10

1.3.4 Extensible Markup Language （XML）11

1.3.5 Synchronized Multimedia Integration Language （SMIL）12

1.4 Overview of Multimedia Software Tools14

1.4.1 Music Sequencing and Notation14

1.4.2 Digital Audio15

1.4.3 Graphics and Image Editing15

1.4.4 Video Editing15

1.4.5 Animation16

1.4.6 Multimedia Authoring17

1.5 Further Exploration17

1.6 Exercises18

1.7 References19

2 Multimedia Authoring and Tools20

2.1 Multimedia Authoring20

2.1.1 Multimedia Authoring Metaphors21

2.1.2 Multimedia Production23

2.1.3 Multimedia Presentation25

2.1.4 Automatic Authoring33

2.2 Some Useful Editing and Authoring Tools37

2.2.1 Adobe Premiere37

2.2.2 Macromedia Director40

2.2.3 Macromedia Flash46

2.2.4 Dreamweaver51

2.3 VRML51

2.3.1 Overview51

2.3.2 Animation and Interactions54

2.3.3 VRML Specifics54

2.4 Further Exploration55

2.5 Exercises56

2.6 References59

3 Graphics and Image Data Representations60

3.1 Graphics/Image Data Types60

3.1.1 1-Bit Images61

3.1.2 8-Bit Gray-Level Images61

3.1.3 Image Data Types64

3.1.4 24-Bit Color Images64

3.1.5 8-Bit Color Images65

3.1.6 Color Lookup Tables （LUTs）67

3.2 Popular File Formats71

3.2.1 GIF71

3.2.2 JPEG75

3.2.3 PNG76

3.2.4 TIFF77

3.2.5 EXIF77

3.2.6 Graphics Animation Files77

3.2.7 PS and PDF78

3.2.8 Windows WMF78

3.2.9 Windows BMP78

3.2.10 Macintosh PAINT and PICT78

3.2.11 X Windows PPM79

3.3 Further Exploration79

3.4 Exercises79

3.5 References81

4 Color in Image and Video82

4.1 Color Science82

4.1.1 Light and Spectra82

4.1.2 Human Vision84

4.1.3 Spectral Sensitivity of the Eye84

4.1.4 Image Formation85

4.1.5 Camera Systems86

4.1.6 Gamma Correction87

4.1.7 Color-Matching Functions89

4.1.8 CIE Chromaticity Diagram91

4.1.9 Color Monitor Specifications94

4.1.10 Out-of-Gamut Colors95

4.1.11 White-Point Correction96

4.1.12 XYZ to RGB Transform97

4.1.13 Transform with Gamma Correction97

4.1.14 L*a*b* （CIELAB） Color Model98

4.1.15 More Color-Coordinate Schemes100

4.1.16 Munsell Color Naming System100

4.2 Color Models in Images100

4.2.1 RGB Color Model for CRT Displays100

4.2.2 Subtractive Color：CMY Color Model101

4.2.3 Transformation from RGB to CMY101

4.2.4 Undercolor Removal：CMYK System102

4.2.5 Printer Gamuts102

4.3 Color Models in Video104

4.3.1 Video Color Transforms104

4.3.2 YUV Color Model104

4.3.3 YIQ Color Model105

4.3.4 YCbCr Color Model107

4.4 Further Exploration107

4.5 Exercises108

4.6 References111

5 Fundamental Concepts in Video112

5.1 Types of Video Signals112

5.1.1 Component Video112

5.1.2 Composite Video113

5.1.3 S-Video113

5.2 Analog Video113

5.2.1 NTSC Video116

5.2.2 PAL Video119

5.2.3 SECAM Video119

5.3 Digital Video119

5.3.1 Chroma Subsampling120

5.3.2 CCIR Standards for Digital Video120

5.3.3 High Definition TV （HDTV）122

5.4 Further Exploration124

5.5 Exercises124

5.6 References125

6 Basics of Digital Audio126

6.1 Digitization of Sound126

6.1.1 What Is Sound？126

6.1.2 Digitization127

6.1.3 Nyquist Theorem128

6.1.4 Signal-to-Noise Ratio （SNR）131

6.1.5 Signal-to-Quantization-Noise Ratio （SQNR）131

6.1.6 Linear and Nonlinear Quantization133

6.1.7 Audio Filtering136

6.1.8 Audio Quality versus Data Rate136

6.1.9 Synthetic Sounds137

6.2 MIDI：Musical Instrument Digital Interface139

6.2.1 MIDI Overview139

6.2.2 Hardware Aspects of MIDI142

6.2.3 Structure of MIDI Messages143

6.2.4 General MIDI147

6.2.5 MIDI-to-WAV Conversion147

6.3 Quantization and Transmission of Audio147

6.3.1 Coding of Audio147

6.3.2 Pulse Code Modulation148

6.3.3 Differential Coding of Audio150

6.3.4 Lossless Predictive Coding151

6.3.5 DPCM154

6.3.6 DM157

6.3.7 ADPCM158

6.4 Further Exploration159

6.5 Exercises160

6.6 References163

Ⅱ Multimedia Data Compression165

7 Lossless Compression Algorithms167

7.1 Introduction167

7.2 Basics of Information Theory168

7.3 Run-Length Coding171

7.4 Variable-Length Coding （VLC）171

7.4.1 Shannon-Fano Algorithm171

7.4.2 Huffman Coding173

7.4.3 Adaptive Huffman Coding176

7.5 Dictionary-Based Coding181

7.6 Arithmetic Coding187

7.7 Lossless Image Compression191

7.7.1 Differential Coding of Images191

7.7.2 Lossless JPEG193

7.8 Further Exploration194

7.9 Exercises195

7.10 References197

8 Lossy Compression Algorithms199

8.1 Introduction199

8.2 Distortion Measures199

8.3 The Rate-Distortion Theory200

8.4 Quantization200

8.4.1 Uniform Scalar Quantization201

8.4.2 Nonuniform Scalar Quantization204

8.4.3 Vector Quantization206

8.5 Transform Coding207

8.5.1 Discrete Cosine Transform （DCT）207

8.5.2 Karhunen-Loeve Transform220

8.6 Wavelet-Based Coding222

8.6.1 Introduction222

8.6.2 Continuous Wavelet Transform227

8.6.3 Discrete Wavelet Transform230

8.7 Wavelet Packets240

8.8 Embedded Zerotree of Wavelet Coefficients241

8.8.1 The Zerotree Data Structure242

8.8.2 Successive Approximation Quantization244

8.8.3 EZW Example244

8.9 Set Partitioning in Hierarchical Trees （SPIHT）247

8.10 Further Exploration248

8.11 Exercises249

8.12 References252

9 Image Compression Standards253

9.1 The JPEG Standard253

9.1.1 Main Steps in JPEG Image Compression253

9.1.2 JPEG Modes262

9.1.3 A Glance at the JPEG Bitstream265

9.2 The JPEG2000 Standard265

9.2.1 Main Steps of JPEG2000 Image Compression267

9.2.2 Adapting EBCOT to JPEG2000275

9.2.3 Region-of-Interest Coding275

9.2.4 Comparison of JPEG and JPEG2000 Performance277

9.3 The JPEG-LS Standard277

9.3.1 Prediction280

9.3.2 Context Determination281

9.3.3 Residual Coding281

9.3.4 Near-Lossless Mode281

9.4 Bilevel Image Compression Standards282

9.4.1 The JBIG Standard282

9.4.2 The JBIG2 Standard282

9.5 Further Exploration284

9.6 Exercises285

9.7 References287

10 Basic Video Compression Techniques288

10.1 Introduction to Video Compression288

10.2 Video Compression Based on Motion Compensation288

10.3 Search for Motion Vectors290

10.3.1 Sequential Search290

10.3.2 2D Logarithmic Search291

10.3.3 Hierarchical Search293

10.4 H.261295

10.4.1 Intra-Frame （I-Frame） Coding297

10.4.2 Inter-Frame （P-Frame） Predictive Coding297

10.4.3 Quantization in H.261297

10.4.4 H.261 Encoder and Decoder298

10.4.5 A Glance at the H.261 Video Bitstream Syntax301

10.5 H.263303

10.5.1 Motion Compensation in H.263304

10.5.2 Optional H.263 Coding Modes305

10.5.3 H.263＋ and H.263＋＋307

10.6 Further Exploration308

10.7 Exercises309

10.8 References310

11 MPEG Video Coding Ⅰ—MPEG-1 and 2312

11.1 Overview312

11.2 MPEG-1312

11.2.1 Motion Compensation in MPEG-1313

11.2.2 Other Major Differences from H.261315

11.2.3 MPEG-1 Video Bitstream318

11.3 MPEG-2319

11.3.1 Supporting Interlaced Video320

11.3.2 MPEG-2 Scalabilities323

11.3.3 Other Major Differences from MPEG-1329

11.4 Further Exploration330

11.5 Exercises330

11.6 References331

12 MPEG Video Coding Ⅱ—MPEG-4，7，and Beyond332

12.1 Overview of MPEG-4332

12.2 Object-Based Visual Coding in MPEG-4335

12.2.1 VOP-Based Coding vs.Frame-Based Coding335

12.2.2 Motion Compensation337

12.2.3 Texture Coding341

12.2.4 Shape Coding343

12.2.5 Static Texture Coding346

12.2.6 Sprite Coding347

12.2.7 Global Motion Compensation348

12.3 Synthetic Object Coding in MPEG-4349

12.3.1 2D Mesh Object Coding349

12.3.2 3D Model-based Coding354

12.4 MPEG-4 Object types，Profiles and Levels356

12.5 MPEG-4 Part 10/H.264357

12.5.1 Core Features358

12.5.2 Baseline Profile Features360

12.5.3 Main Profile Features360

12.5.4 Extended Profile Features361

12.6 MPEG-7361

12.6.1 Descriptor （D）363

12.6.2 Description Scheme （DS）365

12.6.3 Description Definition Language （DDL）368

12.7 MPEG-21369

12.8 Further Exploration370

12.9 Exercises370

12.10 References371

13 Basic Audio Compression Techniques374

13.1 ADPCM in Speech Coding374

13.1.1 ADPCM374

13.2 G.726 ADPCM376

13.3 Vocoders378

13.3.1 Phase Insensitivity378

13.3.2 Channel Vocoder378

13.3.3 Formant Vocoder380

13.3.4 Linear Predictive Coding380

13.3.5 CELP383

13.3.6 Hybrid Excitation Vocoders389

13.4 Further Exploration392

13.5 Exercises392

13.6 References393

14 MPEG Audio Compression395

14.1 Psychoacoustics395

14.1.1 Equal-Loudness Relations396

14.1.2 Frequency Masking398

14.1.3 Temporal Masking403

14.2 MPEG Audio405

14.2.1 MPEG Layers405

14.2.2 MPEG Audio Strategy406

14.2.3 MPEG Audio Compression Algorithm407

14.2.4 MPEG-2 AAC （Advanced Audio Coding）412

14.2.5 MPEG-4 Audio414

14.3 Other Commercial Audio Codecs415

14.4 The Future：MPEG-7 and MPEG-21415

14.5 Further Exploration416

14.6 Exercises416

14.7 References417

Ⅲ Multimedia Communication and Retrieval419

15 Computer and Multimedia Networks421

15.1 Basics of Computer and Multimedia Networks421

15.1.1 OSI Network Layers421

15.1.2 TCP/IP Protocols422

15.2 Multiplexing Technologies425

15.2.1 Basics of Multiplexing425

15.2.2 Integrated Services Digital Network （ISDN）427

15.2.3 Synchronous Optical NETwork （SONET）428

15.2.4 Asymmetric Digital Subscriber Line （ADSL）429

15.3 LAN and WAN430

15.3.1 Local Area Networks （LANs）431

15.3.2 Wide Area Networks （WANs）434

15.3.3 Asynchronous Transfer Mode （ATM）435

15.3.4 Gigabit and 10-Gigabit Ethemets438

15.4 Access Networks439

15.5 Common Peripheral Interfaces441

15.6 Further Exploration441

15.7 Exercises442

15.8 References442

16 Multimedia Network Communications and Applications443

16.1 Quality of Multimedia Data Transmission443

16.1.1 Quality of Service （QoS）443

16.1.2 QoS for IP Protocols446

16.1.3 Prioritized Delivery447

16.2 Multimedia over IP447

16.2.1 IP-Multicast447

16.2.2 RTP （Real-time Transport Protocol）449

16.2.3 Real Time Control Protocol （RTCP）451

16.2.4 Resource ReSerVation Protocol （RSVP）451

16.2.5 Real-Time Streaming Protocol （RTSP）453

16.2.6 Internet Telephony455

16.3 Multimedia over ATM Networks459

16.3.1 Video Bitrates over ATM459

16.3.2 ATM Adaptation Layer （AAL）460

16.3.3 MPEG-2 Convergence to ATM461

16.3.4 Multicast over ATM462

16.4 Transport of MPEG-4462

16.4.1 DMIF in MPEG-4462

16.4.2 MPEG-4 over IP463

16.5 Media-on-Demand （MOD）464

16.5.1 Interactive TV （ITV） and Set-Top Box （STB）464

16.5.2 Broadcast Schemes for Video-on-Demand465

16.5.3 Buffer Management472

16.6 Further Exploration475

16.7 Exercises476

16.8 References477

17 Wireless Networks479

17.1 Wireless Networks479

17.1.1 Analog Wireless Networks480

17.1.2 Digital Wireless Networks481

17.1.3 TDMA and GSM481

17.1.4 Spread Spectrum and CDMA483

17.1.5 Analysis of CDMA486

17.1.6 3G Digital Wireless Networks488

17.1.7 Wireless LAN （WLAN）492

17.2 Radio Propagation Models493

17.2.1 Multipath Fading494

17.2.2 Path Loss496

17.3 Multimedia over Wireless Networks496

17.3.1 Synchronization Loss497

17.3.2 Error Resilient Entropy Coding499

17.3.3 Error Concealment501

17.3.4 Forward Error Correction （FEC）503

17.3.5 Trends in Wireless Interactive Multimedia506

17.4 Further Exploration508

17.5 Exercises508

17.6 References510

18 Content-Based Retrieval in Digital Libraries511

18.1 How Should We Retrieve Images？511

18.2 C-BIRD—A Case Study513

18.2.1 C-BIRD GUI514

18.2.2 Color Histogram514

18.2.3 Color Density516

18.2.4 Color Layout516

18.2.5 Texture Layout517

18.2.6 Search by Illumination Invariance519

18.2.7 Search by Object Model520

18.3 Synopsis of Current Image Search Systems533

18.3.1 QBIC535

18.3.2 UC Santa Barbara Search Engines536

18.3.3 Berkeley Digital Library Project536

18.3.4 Chabot536

18.3.5 Blobworld537

18.3.6 Columbia University Image Seekers537

18.3.7 Informedia537

18.3.8 MetaSEEk537

18.3.9 Photobook and FourEyes538

18.3.10 MARS538

18.3.11 Virage538

18.3.12 Viper538

18.3.13 Visual RetrievalWare538

18.4 Relevance Feedback539

18.4.1 MARS539

18.4.2 iFind541

18.5 Quantifying Results541

18.6 Querying on Videos542

18.7 Querying on Other Formats544

18.8 Outlook for Content-Based Retrieval544

18.9 Further Exploration545

18.10 Exercises546

18.11 References547

Index551