Preface xiii
1 A Signal Theoretic Introduction to Random Processes 1
1.1 Introduction 1
1.2 Motivation 2
1.3 Book Overview 8
2 Background: Mathematics 11
2.1 Introduction 11
2.2 Set Theory 11
2.3 Function Theory 13
2.4 Measure Theory 18
2.5 Measurable Functions 24
2.6 Lebesgue Integration 28
2.7 Convergence 37
2.8 LebesgueStieltjes Measure 39
2.9 LebesgueStieltjes Integration 50
2.10 Miscellaneous Results 61
2.11 Problems 62
3 Background: Signal Theory 71
3.1 Introduction 71
3.2 Signal Orthogonality 71
3.3 Theory for Dirichlet Points 75
3.4 Dirac Delta 78
3.5 Fourier Theory 79
3.6 Signal Power 82
3.7 The Power Spectral Density 84
3.8 The Autocorrelation Function 91
3.9 Power Spectral DensityAutocorrelation Function 95
3.10 Results for the Infinite Interval 96
3.11 Convergence of Fourier Coefficients 103
3.12 Cramers Representation and Transform 106
3.13 Problems 125
4 Background: Probability and Random Variable Theory 153
4.1 Introduction 153
4.2 Basic Concepts: Experiments-Probability Theory 153
4.3 The Random Variable 160
4.4 Discrete and Continuous Random Variables 162
4.5 Standard Random Variables 165
4.6 Functions of a Random Variable 165
4.7 Expectation 166
4.8 Generation of Data Consistent with Defined PDF 172
4.9 Vector Random Variables 173
4.10 Pairs of Random Variables 175
4.11 Covariance and Correlation 186
4.12 Sums of Random Variables 191
4.13 Jointly Gaussian Random Variables 193
4.14 Stirlings Formula and Approximations to Binomial 194
4.15 Problems 199
5 Introduction to Random Processes 219
5.1 Random Processes 219
5.2 Definition of a Random Process 219
5.3 Examples of Random Processes 221
5.4 Experiments and Experimental Outcomes 225
5.5 Prototypical Experiments 228
5.6 Random Variables Defined by a Random Process 232
5.7 Classification of Random Processes 233
5.8 Classification: One-Dimensional RPs 236
5.9 Sums of Random Processes 239
5.10 Problems 239
6 Prototypical Random Processes 243
6.1 Introduction 243
6.2 Bernoulli Random Processes 243
6.3 Poisson Random Processes 246
6.4 Clustered Random Processes 255
6.5 Signalling Random Processes 257
6.6 Jitter 262
6.7 White Noise 265
6.8 1/f Noise 272
6.9 BirthDeath Random Processes 275
6.10 Orthogonal Increment Random Processes 278
6.11 Linear Filtering of Random Processes 282
6.12 Summary of Random Processes 283
6.13 Problems 285
7 Characterizing Random Processes 289
7.1 Introduction 289
7.2 Time Evolution of PMF or PDF 291
7.3 First-, Second-, and Higher-Order Characterization 292
7.4 Autocorrelation and Power Spectral Density 297
7.5 Correlation 308
7.6 Notes on Average Power and Average Energy 310
7.7 Classification: Stationarity vs Non-Stationarity 316
7.8 Cramers Representation 323
7.9 State Space Characterization of Random Processes 335
7.10 Time Series Characterization 347
7.11 Problems 347
8 PMF and PDF Evolution 369
8.1 Introduction 369
8.2 Probability Mass/Density Function Estimation 370
8.3 Non/Semi-parametric PDF Estimation 372
8.4 PMF/PDF Evolution: Signal Plus Noise 378
8.5 PMF Evolution of a Random Walk 381
8.6 PDF Evolution: Brownian Motion 384
8.7 PDF Evolution: Signalling Random Process 388
8.8 PDF Evolution: Generalized Shot Noise 390
8.9 PDF Evolution: Switching in a CMOS Inverter 396
8.10 PDF Evolution: General Case 400
8.11 Problems 405
9 The Autocorrelation Function 417
9.1 Introduction 417
9.2 Notation and Definitions 417
9.3 Basic Results and Independence Information 419
9.4 Sinusoid with Random Amplitude and Phase 421
9.5 Random Telegraph Signal 423
9.6 Generalized Shot Noise 424
9.7 Signalling Random Process-Fixed Pulse Case 434
9.8 Generalized Signalling Random Process 441
9.9 Autocorrelation: Jittered Random Processes 453
9.10 Random Walk 456
9.11 Problems 457
10 Power Spectral Density Theory 481
10.1 Introduction 481
10.2 Power Spectral Density Theory 481
10.3 Power Spectral Density of a Periodic Pulse Train 485
10.4 PSD of a Signalling Random Process 487
10.5 Digital to Analogue Conversion 501
10.6 PSD of Shot Noise Random Processes 505
10.7 White Noise 509
10.8 1/f Noise 510
10.9 PSD of a Jittered Binary Random Process 513
10.10 PSD of a Jittered Pulse Train 517
10.11 Problems 525
11 Order Statistics 553
11.1 Introduction 553
11.2 Ordered Random Variable Theory 557
11.3 Identical RVs With Uniform Distribution 574
11.4 Uniform Distribution and Infinite Interval 584
11.5 Problems 590
12 Poisson Point Random Processes 621
12.1 Introduction 621
12.2 Characterizing Poisson Random Processes 623
12.3 PMF: Number of Points in a Subset of an Interval 625
12.4 Results From Order Statistics 630
12.5 Alternative Characterization for Infinite Interval 634
12.6 Modelling with Unordered or Ordered Times 636
12.7 Zero Crossing Times of Random Telegraph Signal 638
12.8 Point Processes: The General Case 639
12.9 Problems 639
13 BirthDeath Random Processes 649
13.1 Introduction 649
13.2 Defining and Characterizing BirthDeath Processes 649
13.3 Constant Birth Rate, Zero Death Rate Process 656
13.4 State Dependent Birth Rate - Zero Death Rate 662
13.5 Constant Death Rate, Zero Birth Rate, Process 665
13.6 Constant Birth and Constant Death Rate Process 667
13.7 Problems 669
14 The First Passage Time 677
14.1 Introduction 677
14.2 First Passage Time 677
14.3 Approaches: Establishing the First Passage Time 681
14.4 Maximum Level and the First Passage Time 685
14.5 Solutions for the First Passage Time PDF 690
14.6 Problems 695
Reference Material 709
References 717
Index 721
