[NPUW] Support generate more than 1 token per inference #40518
| Job | Run time | 
|---|---|
| 21s | |
| 56s | |
| 22m 55s | |
| 4m 45s | |
| 11m 2s | |
| 0s | |
| 2m 57s | |
| 0s | |
| 0s | |
| 2s | |
| 1m 40s | |
| 1m 42s | |
| 6m 9s | |
| 23m 50s | |
| 4m 26s | |
| 36m 20s | |
| 3m 14s | |
| 12m 8s | |
| 14m 27s | |
| 45m 26s | |
| 5m 23s | |
| 3m 15s | |
| 0s | |
| 0s | |
| -1s | |
| -1s | |
| 2m 40s | |
| 6m 8s | |
| 14m 36s | |
| 10m 54s | |
| 47m 14s | |
| 2s | |
| 21s | |
| 56s | |
| 22m 55s | |
| 0s | |
| 11m 59s | |
| 0s | |
| 2m 57s | |
| 0s | |
| 6m 9s | |
| 4m 45s | |
| 5m 23s | |
| 3m 15s | |
| 12m 8s | |
| 23m 50s | |
| 2s | |
| 1m 42s | |
| 14m 27s | |
| 3m 14s | |
| 45m 26s | |
| 4m 26s | |
| 1m 40s | |
| 36m 20s | |
| 0s | |
| 0s | |
| 0s | |
| 0s | |
| 10m 54s | |
| 6m 8s | |
| 47m 14s | |
| 14m 36s | |
| 2m 40s | |
| 2s | |
| 9h 25m 59s |