Retrieval and Inference

[kiucho]

Thank you for sharing your research.

Regarding the ODQA task, I understand that there is only one inference without stride, so there is no need for retrieval again. However, in the case of language modeling, I had assumed that retrieval would occur during inference for a specific stride. I would be grateful if you could explain why retrieval and evaluation are not aligned in the implementation.

[dhjoo98]

same question. It seems like in the code, 'stride' is not used in the same way as described paper.