NeMo Common Collection API

The common collection contains things that could be used across all collections.

• Callbacks
  • Exponential Moving Average (EMA)
• Losses
• Metrics
• Tokenizers
• Data
  • ConcatDataset
    • ConcatDataset.get_iterable()
    • ConcatDataset.random_generator()
    • ConcatDataset.round_robin_generator()
    • ConcatDataset.temperature_generator()
  • ConcatMapDataset
• S3 Checkpointing
  • S3CheckpointIO
  • S3Utils and Dependencies
  • s3_dirpath_utils
  • S3 Demands and ExpManager Details When Running at Scale