LTI systems, impulse response, and convolution

Linearity and time invariance turn a complicated input into a sum of simple responses. The same idea works in discrete and continuous time.

Why LTI systems matter

An LTI system has two useful promises. Linearity lets us split an input into pieces, process each piece, and add the results. Time invariance says that moving an input in time moves its output by exactly the same amount. Together, these promises mean that one impulse response characterizes the entire system.

Linearity

T{ax1+bx2}=aT{x1}+bT{x2}T\{a x_1+b x_2\}=aT\{x_1\}+bT\{x_2\}

Scaling and addition pass through the system.

Time invariance

T{x[nk]}=y[nk]T\{x[n-k]\}=y[n-k]

A delayed input has the same output, delayed.

This is why filters, communication channels, and many physical circuits can be analyzed systematically. In the frequency domain, complex sinusoids are eigenfunctions of an LTI system: their frequency stays put while amplitude and phase change.

Building a signal from impulses

In discrete time, δ[nk]\delta[n-k] is 1 only when n=kn=k. Multiply by x[k]x[k] to recover one sample; sum the weighted impulses to reconstruct the whole sequence.

x[n]=k=x[k]δ[nk]x[n]=\sum_{k=-\infty}^{\infty}x[k]\,\delta[n-k]

Continuous time has the parallel “sifting” identity. A Dirac impulse is not an ordinary finite-height spike: it is an idealized object whose integral picks out the signal value at one instant.

x(t)=x(τ)δ(tτ)dτx(t)=\int_{-\infty}^{\infty}x(\tau)\,\delta(t-\tau)\,d\tau

From impulse response to convolution

Let the response to an impulse at zero be h[n]=T{δ[n]}h[n]=T\{\delta[n]\} in discrete time, or h(t)=T{δ(t)}h(t)=T\{\delta(t)\} in continuous time. By time invariance, shifting the impulse shifts that response; by linearity, scaling the impulse scales it.

Discrete time

y[n]=T ⁣{kx[k]δ[nk]}=kx[k]T{δ[nk]}=kx[k]h[nk]=(xh)[n]\begin{aligned}y[n]&=T\!\left\{\sum_k x[k]\delta[n-k]\right\}\\&=\sum_k x[k]T\{\delta[n-k]\}\\&=\sum_k x[k]h[n-k]\\&=(x*h)[n]\end{aligned}

Continuous time

y(t)=T ⁣{x(τ)δ(tτ)dτ}=x(τ)T{δ(tτ)}dτ=x(τ)h(tτ)dτ=(xh)(t)\begin{aligned}y(t)&=T\!\left\{\int x(\tau)\delta(t-\tau)\,d\tau\right\}\\&=\int x(\tau)T\{\delta(t-\tau)\}\,d\tau\\&=\int x(\tau)h(t-\tau)\,d\tau\\&=(x*h)(t)\end{aligned}

The second line in each derivation uses linearity; the third uses time invariance. The sum runs over all integer kk, and the integral over all time. The result is convolution: add a shifted, scaled copy of the impulse response for every piece of the input.

Analog and digital

A digital sequence is assembled from impulses at integer indices, so its convolution is a sum. An analog signal has a contribution from every instant, so its convolution is an integral. Both describe the same LTI principle: the response to an input is the superposition of responses to its pieces.

The two formulas look alike, but sampling an analog input and convolving its samples does not, in general, give the samples of its analog convolution. That correspondence depends on how the signal and system are sampled and reconstructed.

Videos

These videos show the motion behind the formulas: first for a sequence, then for a continuous signal.

But what is a convolution?

3Blue1Brown

Start here for the discrete-time picture. The animation makes the flip, slide, multiply, and sum in convolution feel concrete, then connects that operation to other uses of convolution.

Convolution and Unit Impulse Response

Physics Videos by Eugene Khutoryansky

Then watch the continuous-time counterpart: shifted responses overlap and accumulate over time. This is the integral version of the same idea used in the analog derivation above.