A method for signaling adaptive loop filter (ALF) settings is provided. A video decoder receives data from a bitstream for a block of pixels to be decoded as a current block of a current picture of a video. The video decoder parses whether to use adaptive parameter set (APS) for filtering the current block without determining whether to select a particular APS from a plurality of APSs. When the APS is used to filter the current block, the video decoder parses a first filter selection index for selecting a filter from a set of filters in the APS. When the APS is not used to filter the current block, the video decoder signals a second filter selection index for selecting a filter from a set of default fixed filters. The video decoder filters the current block based on the selected filter. The video decoder outputs the filtered current block.