A method of video processing includes maintaining tables, wherein each table includes a set of motion candidates and each motion candidate is associated with corresponding motion information; and performing a conversion between a first video block and a bitstream representation of a video including the first video block based on at least some of tables, the performing including checking motion candidates in a table in an order defined in a rule until a checking termination criteria is met.