The present invention relates to a prediction-based technique for encoding light field data by removing redundant information of light field data, reducing a number of bits by employing a prediction of a pixel value in all four dimensions of the light field. Using this technique to represent light field data, allows it to be transferred through a limited-bandwidth medium and/or to significantly reduce the required storage capacity for this purpose.