Techniques are described for performing forward and backward extrapolation of data to compensate for data that has been lost due to network packet loss. The forward and backward extrapolation can be used to perform packet loss concealment. For example, when network packet loss is detected, network packets before and after the lost data can be identified. Forward and backward extrapolation can then be applied to cover the period of lost data. For example, the network packets before the period of lost data can be used to perform forward extrapolation to cover a first portion of the period of lost data. The network packets after the period of lost data can be used to perform backward extrapolation to cover a remaining portion of the period of lost data. The period of lost data can be reconstructed based at least in part on the extrapolation.