I'm not too familiar with how a table view in OS X compares to UITableView on iOS, but are cells reused? I feel that that optimization alone would at least limit what needs to be rendered to what's on screen.