from megatron import get_args, get_timers, print_rank_0 ...

This directory contains a collection of tools for building the retrieval database and pretraining neighbors for Retro. This preprocessing pipeline is broken into 3 main stages: In this tutorial ...