CGP Grey addresses this in the video (commented elsewhere here). This strategy minimizes the Seat Shuffle, but it turns out that isn't the major slowdown when boarding, so overall this is only slightly faster than boarding in random order.