Based on the challenges above, the desired properties of a scheduler for video analytics are: (1) allocate more resources to queries whose qualities will improve more, (2) allow queries with built up lag in their processing to “catch up,” and (3) adjust query configuration based on the resource allocated.