{ai}[foss/2024a] PyTorch-bundle v2.7.1 w/ CUDA 12.6.0 by Flamefire · Pull Request #25924 · easybuilders/easybuild-easyconfigs

Flamefire · 2026-05-06T12:41:03Z

(created using eb --new-pr)

In Slack it was discussed to rather update PyTorch-bundle than having those as single easyconfigs.
So I used torchaudio (patches) from #24922 which can then be removed from there. CC @pavelToman

On A100 torchaudio worked quite well but on H100 tests started failing. So I (heavily) relaxed some tolerances on top of those already done in #24922

Requires:

Move pytest-mock to extra EC in 2024a toolchain #25682

github-actions · 2026-05-06T12:41:37Z

Updated software `PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb`

Diff against PyTorch-bundle-2.6.0-foss-2024a.eb

easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.6.0-foss-2024a.eb

diff --git a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.6.0-foss-2024a.eb b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb
index 8fc5c7faf2..ff3d39fc3a 100644
--- a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.6.0-foss-2024a.eb
+++ b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb
@@ -1,7 +1,8 @@
 easyblock = 'PythonBundle'
 
 name = 'PyTorch-bundle'
-version = '2.6.0'
+version = '2.7.1'
+versionsuffix = '-CUDA-%(cudaver)s'
 
 homepage = 'https://pytorch.org/'
 description = """PyTorch with compatible versions of official Torch extensions."""
@@ -11,73 +12,141 @@ toolchain = {'name': 'foss', 'version': '2024a'}
 builddependencies = [
     ('CMake', '3.29.3'),
     ('git', '2.45.1'),
-    ('RE2', '2024-07-02'),  # for torchtext
-    ('NLTK', '3.9.1'),  # for torchtext tests
-    ('parameterized', '0.9.0'),  # for torchtext tests
     ('hatchling', '1.24.2'),  # for pytorch-ignite
     ('dill', '0.3.9'),  # for pytorch-ignite tests
     ('scikit-learn', '1.5.2'),  # for pytorch-ignite tests
     ('scikit-image', '0.25.0'),  # for pytorch-ignite tests
     ('visdom', '0.2.4'),  # for pytorch-ignite tests
     ('Java', '17', '', SYSTEM),  # needed by ANTLR runtime
+    ('pytest-mock', '3.14.1'),  # for torchvision tests
+    ('parameterized', '0.9.0'),  # for torchtext and torchaudio tests
+    ('librosa', '0.10.2.post1'),  # for torchaudio tests
+    ('NLTK', '3.9.1'),  # for torchaudio tests
 ]
 
 dependencies = [
+    ('CUDA', '12.6.0', '', SYSTEM),
     ('Python', '3.12.3'),
-    ('PyTorch', version),
-    ('torchaudio', version),
-    ('torchvision', '0.21.0'),
-    ('double-conversion', '3.3.0'),  # for torchtext
-    ('SentencePiece', '0.2.1'),  # for torchtext
-    ('tqdm', '4.66.5'),  # for torchtext
-    ('utf8proc', '2.9.0'),  # for torchtext
-    ('tensorboard', '2.18.0'),  # for torch-tb-profiler
-    ('orjson', '3.10.13'),  # for torchrl
-    ('lxml', '5.3.0'),  # for torchtune
+    ('PyTorch', version, versionsuffix),
+    ('FFmpeg', '7.0.2'),  # for torchvision and torchaudio
     ('HF-Datasets', '4.0.0'),  # for torchtune
+    ('libjpeg-turbo', '3.0.1'),  # for torchvision
+    ('lxml', '5.3.0'),  # for torchtune
+    ('orjson', '3.10.13'),  # for torchrl
+    ('Pillow-SIMD', '10.4.0'),  # for torchvision
     ('Safetensors', '0.6.2'),  # for torchtune
+    ('SentencePiece', '0.2.1'),  # for torchtune
+    ('SoX', '14.4.2'),  # for torchaudio
+    ('tensorboard', '2.18.0'),  # for torch-tb-profiler
     ('tiktoken', '0.9.0'),  # for torchtune
     ('tokenizers', '0.21.4'),  # for torchtune
 ]
 
+local_preinstall_opts = ' '.join([
+    'USE_SYSTEM_LIBS=1',
+    'USE_OPENMP=1',
+    'USE_CUDA=1', 'TORCH_CUDA_ARCH_LIST="%(cuda_cc_semicolon_sep)s"',
+    'USE_CUDNN=1',
+    'USE_FFMPEG=1', 'FFMPEG_ROOT="$EBROOTFFMPEG"',
+    'CMAKE_BUILD_PARALLEL_LEVEL=%(parallel)s',
+])
+
+exts_default_options = {
+    'preinstallopts': local_preinstall_opts,
+    'prebuildopts': local_preinstall_opts,
+    # Workaround for nvrtcCompileProgram in CUDA < 12.6.2 changing the locale  potentially causing UnicodeDecodeError
+    'pretestopts': ('PYTHONUTF8=1 '
+                    'MAX_JOBS=%(parallel)s TRITON_HOME="%(builddir)s/ttHome" TRITON_CACHE_DIR="%(builddir)s/ttCache"'),
+}
+
+local_gh_source = {'download_filename': V_VERSION_TAR_GZ, 'filename': SOURCE_TAR_GZ}
+local_cutlass_path = "$EBROOTNVIDIAMINCUTLASS/lib/python%(pyshortver)s/site-packages/cutlass_library/source"
+
 exts_list = [
     ('pynvml', '11.5.3', {
         # needed by torch-ignite
         # see https://github.com/pytorch/ignite/blob/adb2a557650d55db25082f9cb06ea59c7c69e562/requirements-dev.txt#L24
         'checksums': ['183d223ae487e5f00402d8da06c68c978ef8a9295793ee75559839c6ade7b229'],
     }),
-    ('torchtext', '0.18.0', {
+    ('torchvision', '0.21.0', {
+        'source_urls': ['https://github.com/pytorch/vision/archive'],
+        'sources': [local_gh_source],
+        'patches': [{'name': 'torchvision-0.17.0_quantized_tol.patch', 'alt_location': 'torchvision'}],
+        'checksums': [
+            {'torchvision-0.21.0.tar.gz': '0a4a967bbb7f9810f792cd0289a07fb98c8fb5d1303fae8b63e3a6b05d720058'},
+            {'torchvision-0.17.0_quantized_tol.patch':
+             '991b959f7d5e0fd418a163fa3ad828a2b60a64d0ce894cf579847138b13b62af'},
+        ],
+        'installopts': '-v',
+        'runtest': (
+            'pytest'
+            ' -m "not xfail"'  # don't run tests that are expected that they might fail
+            ' -k "not test_frame_reading_mem_vs_file"'  # this one hangs
+            '" and not test_antialias_default_warning"'  # flaky test which is removed in later versions
+            '" and not test_internet"'  # Online access
+            '" and not test_classification_model"'  # torch.OutOfMemoryError during tests for "small" GPUs
+            '" and not test_videoapi"'  # video support is unstable
+            '" and not avif and not heic"'  # requires torchvision-extra-decoders, libavif PyTorch support, libheic
+            '" and not test_pretrained_pos and not test_equivalent_behavior_weights"'  # tests out of date?
+        ),
+        'testinstall': True,
+    }),
+    ('torchaudio', version, {
         'patches': [
-            'torchtext-0.14.1_use-system-libs.patch',
-            'torchtext-0.16.2_download-to-project-root.patch',
-            'torchtext-0.18.0-fix-torch-load-tests.patch',
+            'torchaudio-2.1.2_transform_test_tol.patch',
+            'torchaudio-2.3.0_remove-librosa-version-check.patch',
+            'torchaudio-2.3.0_use-external-sox.patch',
+            {'name': 'torchaudio-2.6.0_use_ffmpeg7.patch', 'alt_location': 'torchaudio'},
+            {'name': 'torchaudio-2.7.0_fix-encode-process.patch', 'alt_location': 'torchaudio'},
+            {'name': 'torchaudio-2.7.0_fix_tests_gpu.patch', 'alt_location': 'torchaudio'},
         ],
-        'source_urls': ['https://github.com/pytorch/text/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'preinstallopts': ('unset BUILD_VERSION && '
+                           'rm -r third_party/{sox,ffmpeg/multi}; '  # Don't fail because it runs twice (testinstall)
+                           + local_preinstall_opts),
+        'source_urls': ['https://github.com/pytorch/audio/archive'],
+        'sources': [local_gh_source],
         'checksums': [
-            {'torchtext-0.18.0.tar.gz': 'fe4eb4b361388ef7840dcad117ae95b32252db5520c4eb2b3bead627468fbdf2'},
-            {'torchtext-0.14.1_use-system-libs.patch':
-             'a29ce29259d8c1cf3533cdc23c66e68eec660d6206ae04ced0220a7c02712b53'},
-            {'torchtext-0.16.2_download-to-project-root.patch':
-             '9d5599a9983729cf1fc7ab2a2f65d1887f223f528e15662ba1b4a5e359c9686d'},
-            {'torchtext-0.18.0-fix-torch-load-tests.patch':
-             'accf43278cc5c293c515ce2b28e2d1788182401ffb73ba673c33724bd6ddf2aa'},
+            {'torchaudio-2.7.1.tar.gz': 'fc8159476d1b3b5978d5e66746fc34be168170800ff4c5e356433d8c9c57cbea'},
+            {'torchaudio-2.1.2_transform_test_tol.patch':
+             '57f315c60db70ed2bd9711bcf6f7c7c24dac8c2f04e00488996eb2dc507bdfd2'},
+            {'torchaudio-2.3.0_remove-librosa-version-check.patch':
+             'a98ce800ef0f3bd551b5f7ecec00f7164c4066e1799bdc9838c3f231e2b06622'},
+            {'torchaudio-2.3.0_use-external-sox.patch':
+             'da765487aa7ec83f9ebe603b11365bfe3a70b3492982a6aa504d945b9aa91da8'},
+            {'torchaudio-2.6.0_use_ffmpeg7.patch': '1a2f7505efee9852ef393e6f4583cef209ad302db241171bf41be8d4a88920bd'},
+            {'torchaudio-2.7.0_fix-encode-process.patch':
+             'a00772c8869b4202491e043c38f2be20f6da650c105ea72b6b47001e84081999'},
+            {'torchaudio-2.7.0_fix_tests_gpu.patch':
+             '6354639636075920dfbb533631f0e22fd2e846490aabe202c5b27d63f58e0f00'},
         ],
-        'preinstallopts': "sed -i '92d' setup.py &&",  # skip fetching repo submodules
         'runtest': (
-            'pytest test/torchtext_unittest'
-            ' -k "not test_vocab_from_raw_text_file"'  # segfaults
-            '" and not test_get_tokenizer_moses"'  # requires sacremoses
-            '" and not test_get_tokenizer_spacy"'  # requires spaCy
-            '" and not test_download_charngram_vectors"'  # requires internet access and required host may fail
-            '" and not test_builtin_pretrained_sentencepiece_processor"'  # missing file
+            # Make CUBLAS deterministic
+            'CUBLAS_WORKSPACE_CONFIG=:16:8 '
+            'pytest test/torchaudio_unittest/'
+            " -k 'not " + " and not ".join((
+                'TestProcessPoolExecutor',  # hang maybe related https://github.com/pytorch/audio/issues/1021
+                'FilterGraphWithCudaAccel',  # requires FFmpeg with CUDA support
+                # Large difference, caused by numba<0.62.0, torchaudio 2.9 uses mocks instead avoiding this
+                'test_phase_vocoder',
+                'kaldi_io_test',  # requires kaldi_io
+                'test_dup_hw_acel',  # requires special render device permissions
+                'test_h264_cuvid',  # requires special render device permissions
+                'test_hevc_cuvid',  # requires special render device permissions
+                'test_hevc_cuvid',  # requires special render device permissions
+                'test_requests_',   # requires internet access
+                'TestFileObjectHttp',   # requires internet access
+                '_large',   # Speed up our test runs
+            )) + "'"
         ),
         'testinstall': True,
     }),
+    ('pytorch-fid', '0.3.0', {
+        'checksums': ['1c80d112c9cf5ebcbcc428a0b7ea615c302805ad6780ec29e8e2955ba31571c8'],
+    }),
     ('pytorch-ignite', '0.5.2', {
         'modulename': 'ignite',
         'source_urls': ['https://github.com/pytorch/ignite/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
         'patches': [
             'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch',
             'torch-ignite-0.5.2_fix-conftest-options.patch',
@@ -93,39 +162,35 @@ exts_list = [
              'a5ddc55eaa2255e5a8643c5974eb1354cc4a6b4a26290bfc2c4d681aa4a5aeda'},
         ],
         'runtest': (
-            'pytest'
-            ' -m "not distributed"'
-            ' --ignore=tests/ignite/contrib/handlers/test_clearml_logger.py'  # requires clearml
-            ' --ignore=tests/ignite/contrib/handlers/test_mlflow_logger.py'  # requires mlflow
-            ' --ignore=tests/ignite/contrib/handlers/test_neptune_logger.py'  # requires neptune
-            ' --ignore=tests/ignite/contrib/handlers/test_polyaxon_logger.py'  # requires polyaxon
-            ' --ignore=tests/ignite/contrib/handlers/test_tensorboard_logger.py'  # requires tensorboardX
-            ' --ignore=tests/ignite/contrib/handlers/test_wandb_logger.py'  # requires wandb
-            ' --ignore=tests/ignite/metrics/gan/test_fid.py'  # requires pytorch_fid
-            ' --ignore=tests/ignite/metrics/nlp/test_rouge.py'  # requires rouge
-            ' --ignore=tests/ignite/metrics/vision/test_object_detection_map.py'  # requires pycocotools
-            ' --ignore=tests/ignite/handlers/test_checkpoint.py'  # fails by comparing tensors on different devices
-            ' --ignore=tests/ignite/handlers/test_clearml_logger.py'  # requires clearml
-            ' --ignore=tests/ignite/handlers/test_mlflow_logger.py'  # requires mlflow
-            ' --ignore=tests/ignite/handlers/test_neptune_logger.py'  # requires neptune
-            ' --ignore=tests/ignite/handlers/test_polyaxon_logger.py'  # requires polyaxon
-            ' --ignore=tests/ignite/handlers/test_tensorboard_logger.py'  # requires tensorboardX
-            ' --ignore=tests/ignite/handlers/test_wandb_logger.py'  # requires wandb
-            ' --ignore=tests/ignite/contrib/handlers/test_tqdm_logger.py'  # fragile tests on some platforms
-            ' -k "not test_setup_plx_logging"'  # requires polyaxon
-            '" and not test_setup_mlflow_logging"'  # requires mlflow
-            '" and not test_setup_clearml_logging"'  # requires clearml
-            '" and not test_setup_neptune_logging"'  # requires neptune
-            '" and not test_setup_tb_logging"'  # requires tesorboardX
-            '" and not test__setup_ddp_vars_from_slurm_env_bad_configs"'  # fails sometimes
-            '" and not test__native_dist_model_create_from_backend_bad_config"'  # fails sometimes
-            '" and not test_inception_score"'  # fails sometimes due to connection problem with download.pytorch.org
+            'pytest -m "not distributed"' +
+            ' --ignore='.join((
+                '',  # Empty for join()
+                'tests/ignite/handlers/test_checkpoint.py',  # fails by comparing tensors on different devices
+                'tests/ignite/handlers/test_clearml_logger.py',  # requires clearml
+                'tests/ignite/handlers/test_mlflow_logger.py',  # requires mlflow
+                'tests/ignite/handlers/test_neptune_logger.py',  # requires neptune
+                'tests/ignite/handlers/test_polyaxon_logger.py',  # requires polyaxon
+                'tests/ignite/handlers/test_tensorboard_logger.py',  # requires tensorboardX
+                'tests/ignite/handlers/test_visdom_logger.py',  # Spins up local server which may fail
+                'tests/ignite/handlers/test_wandb_logger.py',  # requires wandb
+                'tests/ignite/metrics/vision/test_object_detection_map.py',  # requires pycocotools
+                'tests/ignite/metrics/nlp/test_rouge.py',  # requires rouge
+            )) +
+            " -k 'not " + " and not ".join((
+                'test_setup_plx_logging',  # requires polyaxon
+                'test_setup_mlflow_logging',  # requires mlflow
+                'test_setup_clearml_logging',  # requires clearml
+                'test_setup_neptune_logging',  # requires neptune
+                'test_setup_tb_logging',  # requires tesorboardX
+                'test__setup_ddp_vars_from_slurm_env_bad_configs',  # fails sometimes
+                'test__native_dist_model_create_from_backend_bad_config',  # fails sometimes
+                'test_inception_score',  # fails sometimes due to connection problem with download.pytorch.org
+            )) + "'"
         ),
         'testinstall': True,
     }),
     ('torch-tb-profiler', '0.4.3', {
         'modulename': 'torch.profiler',
-        'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
         'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
         'runtest': (
             'pytest'
@@ -140,12 +205,12 @@ exts_list = [
     }),
     ('tensordict', '0.7.2', {
         'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
         'checksums': ['7ae5edfd8f5b7da8bf10ca81a34b7a3013058bd7bfaa32837cd3fd97e7b755c6'],
     }),
     ('torchrl', '0.7.2', {
         'source_urls': ['https://github.com/pytorch/rl/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
         'checksums': ['1621b621ee8c73b51dca3e52ee9f7704019c8b3bad70a67bb10f02559f4558ac'],
     }),
     # requirements for torchtune
@@ -167,23 +232,26 @@ exts_list = [
         'checksums': ['222d0bd05381dd25c32dd6065c071ebf084212ab79bab4599ba9e6a3e0009e6c'],
     }),
     ('torchao', '0.12.0', {
-        'preinstallopts': "USE_SYSTEM_LIBS=1 ",
         'source_urls': ['https://github.com/pytorch/ao/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
         'checksums': ['c477d78ca5268187979934d3eb38590758adc5415526b3705a9a85099e40ad21'],
+        # Need path to installed cutlass, as third_party folder is not populated
+        'preinstallopts': (
+            f'export CPATH="$CPATH:{local_cutlass_path}/include:{local_cutlass_path}/tools/util/include" && '
+            + local_preinstall_opts),
     }),
     ('torchdata', '0.11.0', {
-        'preinstallopts': "USE_SYSTEM_LIBS=1 ",
         'source_urls': ['https://github.com/pytorch/data/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
         'checksums': ['945c53a8587567624aaad2d66204fbae9acb9535696554c53ffeb83320c308b9'],
         'runtest': False,  # circular test requirements
     }),
     ('torchtune', '0.6.1', {
         'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
         'checksums': ['80a06ba0760741aa91f5f7bfb49ef6bb779c8044409dd7ef116f5420f122214b'],
-        'preinstallopts': """sed -i 's/^dynamic.*/version = "%(version)s"/' pyproject.toml && USE_SYSTEM_LIBS=1 """,
+        'preinstallopts': ("""sed -i 's/^dynamic.*/version = "%(version)s"/' pyproject.toml && """
+                           + local_preinstall_opts),
         'runtest': False,  # circular test requirements
     }),
 ]

Diff against PyTorch-bundle-2.1.2-foss-2023a.eb

easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a.eb

diff --git a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a.eb b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb
index 7fed5f0285..ff3d39fc3a 100644
--- a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a.eb
+++ b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb
@@ -1,44 +1,52 @@
 easyblock = 'PythonBundle'
 
 name = 'PyTorch-bundle'
-version = '2.1.2'
+version = '2.7.1'
+versionsuffix = '-CUDA-%(cudaver)s'
 
 homepage = 'https://pytorch.org/'
 description = """PyTorch with compatible versions of official Torch extensions."""
 
-toolchain = {'name': 'foss', 'version': '2023a'}
+toolchain = {'name': 'foss', 'version': '2024a'}
 
 builddependencies = [
-    ('CMake', '3.26.3'),
-    ('RE2', '2023-08-01'),  # for torchtext
+    ('CMake', '3.29.3'),
+    ('git', '2.45.1'),
+    ('hatchling', '1.24.2'),  # for pytorch-ignite
+    ('dill', '0.3.9'),  # for pytorch-ignite tests
+    ('scikit-learn', '1.5.2'),  # for pytorch-ignite tests
+    ('scikit-image', '0.25.0'),  # for pytorch-ignite tests
+    ('visdom', '0.2.4'),  # for pytorch-ignite tests
+    ('Java', '17', '', SYSTEM),  # needed by ANTLR runtime
+    ('pytest-mock', '3.14.1'),  # for torchvision tests
     ('parameterized', '0.9.0'),  # for torchtext and torchaudio tests
-    ('scikit-learn', '1.3.1'),  # for torchaudio and pytorch-ignite tests
-    ('scikit-image', '0.22.0'),  # for pytorch-ignite tests
-    ('dill', '0.3.7'),  # for pytorch-ignite tests
-    ('matplotlib', '3.7.2'),  # for pytorch-ignite tests
-    ('librosa', '0.10.1'),  # for torchaudio tests
-    ('NLTK', '3.8.1'),  # for torchtext tests
-    ('Scalene', '1.5.26'),  # for pynvml in ignite tests
+    ('librosa', '0.10.2.post1'),  # for torchaudio tests
+    ('NLTK', '3.9.1'),  # for torchaudio tests
 ]
 
 dependencies = [
-    ('Python', '3.11.3'),
-    ('PyTorch', version),
-    ('Pillow-SIMD', '9.5.0'),  # for torchvision
-    ('libjpeg-turbo', '2.1.5.1'),  # for torchvision
-    ('SentencePiece', '0.2.0'),  # for torchtext
-    ('tqdm', '4.66.1'),  # for torchtext
-    ('double-conversion', '3.3.0'),  # for torchtext
-    ('utf8proc', '2.8.0'),  # for torchtext
-    ('tensorboard', '2.15.1'),  # for torch-tb-profiler
-    ('FFmpeg', '6.0'),  # for torchvision and torchaudio
+    ('CUDA', '12.6.0', '', SYSTEM),
+    ('Python', '3.12.3'),
+    ('PyTorch', version, versionsuffix),
+    ('FFmpeg', '7.0.2'),  # for torchvision and torchaudio
+    ('HF-Datasets', '4.0.0'),  # for torchtune
+    ('libjpeg-turbo', '3.0.1'),  # for torchvision
+    ('lxml', '5.3.0'),  # for torchtune
+    ('orjson', '3.10.13'),  # for torchrl
+    ('Pillow-SIMD', '10.4.0'),  # for torchvision
+    ('Safetensors', '0.6.2'),  # for torchtune
+    ('SentencePiece', '0.2.1'),  # for torchtune
     ('SoX', '14.4.2'),  # for torchaudio
+    ('tensorboard', '2.18.0'),  # for torch-tb-profiler
+    ('tiktoken', '0.9.0'),  # for torchtune
+    ('tokenizers', '0.21.4'),  # for torchtune
 ]
 
 local_preinstall_opts = ' '.join([
     'USE_SYSTEM_LIBS=1',
     'USE_OPENMP=1',
-    'USE_CUDA=0',
+    'USE_CUDA=1', 'TORCH_CUDA_ARCH_LIST="%(cuda_cc_semicolon_sep)s"',
+    'USE_CUDNN=1',
     'USE_FFMPEG=1', 'FFMPEG_ROOT="$EBROOTFFMPEG"',
     'CMAKE_BUILD_PARALLEL_LEVEL=%(parallel)s',
 ])
@@ -46,135 +54,143 @@ local_preinstall_opts = ' '.join([
 exts_default_options = {
     'preinstallopts': local_preinstall_opts,
     'prebuildopts': local_preinstall_opts,
+    # Workaround for nvrtcCompileProgram in CUDA < 12.6.2 changing the locale  potentially causing UnicodeDecodeError
+    'pretestopts': ('PYTHONUTF8=1 '
+                    'MAX_JOBS=%(parallel)s TRITON_HOME="%(builddir)s/ttHome" TRITON_CACHE_DIR="%(builddir)s/ttCache"'),
 }
 
-# Check with https://pytorch.org/audio/stable/installation.html#compatibility-matrix
+local_gh_source = {'download_filename': V_VERSION_TAR_GZ, 'filename': SOURCE_TAR_GZ}
+local_cutlass_path = "$EBROOTNVIDIAMINCUTLASS/lib/python%(pyshortver)s/site-packages/cutlass_library/source"
+
 exts_list = [
-    ('portalocker', '2.8.2', {
-        'checksums': ['2b035aa7828e46c58e9b31390ee1f169b98e1066ab10b9a6a861fe7e25ee4f33'],
+    ('pynvml', '11.5.3', {
+        # needed by torch-ignite
+        # see https://github.com/pytorch/ignite/blob/adb2a557650d55db25082f9cb06ea59c7c69e562/requirements-dev.txt#L24
+        'checksums': ['183d223ae487e5f00402d8da06c68c978ef8a9295793ee75559839c6ade7b229'],
     }),
-    ('torchdata', '0.7.1', {
-        'source_urls': ['https://github.com/pytorch/data/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['ef9bbdcee759b53c3c9d99e76eb0a66da33d36bfb7f859a25a9b5e737a51fa23'],
-        'runtest': False,  # circular test requirements
-    }),
-    ('torchtext', '0.16.2', {
-        'patches': [
-            'torchtext-0.14.1_use-system-libs.patch',
-            'torchtext-0.16.2_download-to-project-root.patch',
-        ],
-        'source_urls': ['https://github.com/pytorch/text/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': [
-            {'torchtext-0.16.2.tar.gz': '6574b012804f65220329a2ad34a95c18e4df0d4cff2f862fb7862d57b374b013'},
-            {'torchtext-0.14.1_use-system-libs.patch':
-             'a29ce29259d8c1cf3533cdc23c66e68eec660d6206ae04ced0220a7c02712b53'},
-            {'torchtext-0.16.2_download-to-project-root.patch':
-             '9d5599a9983729cf1fc7ab2a2f65d1887f223f528e15662ba1b4a5e359c9686d'},
-        ],
-        'runtest': (
-            'pytest test/torchtext_unittest'
-            ' -k "not test_vocab_from_raw_text_file"'  # segfaults
-            '" and not test_get_tokenizer_moses"'  # requires sacremoses
-            '" and not test_get_tokenizer_spacy"'  # requires spaCy
-            '" and not test_download_charngram_vectors"'  # requires internet access and required host may fail
-        ),
-        'testinstall': True,
-    }),
-    ('pytest-mock', '3.11.1', {  # for torchvision tests
-        'checksums': ['7f6b125602ac6d743e523ae0bfa71e1a697a2f5534064528c6ff84c2f7c2fc7f'],
-    }),
-    ('torchvision', '0.16.2', {
-        'installopts': '-v',
-        'patches': [
-            'torchvision-0.16.2_ffmpeg-6.0-fix.patch',
-            'torchvision-0.16.2_quantized_tol.patch',
-        ],
+    ('torchvision', '0.21.0', {
         'source_urls': ['https://github.com/pytorch/vision/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
+        'patches': [{'name': 'torchvision-0.17.0_quantized_tol.patch', 'alt_location': 'torchvision'}],
         'checksums': [
-            {'torchvision-0.16.2.tar.gz': '8c1f2951e98d8ada6e5a468f179af4be9f56d2ebc3ab057af873da61669806d7'},
-            {'torchvision-0.16.2_ffmpeg-6.0-fix.patch':
-             'a49336e7bfa1c950e886852bff37a3ea2146ac7bda87241e3ffb31c5cb869cce'},
-            {'torchvision-0.16.2_quantized_tol.patch':
-             '457cdf8ad6653838c552890bce95dbe30b7573b1643334284f5f4a58f74f6e40'},
+            {'torchvision-0.21.0.tar.gz': '0a4a967bbb7f9810f792cd0289a07fb98c8fb5d1303fae8b63e3a6b05d720058'},
+            {'torchvision-0.17.0_quantized_tol.patch':
+             '991b959f7d5e0fd418a163fa3ad828a2b60a64d0ce894cf579847138b13b62af'},
         ],
+        'installopts': '-v',
         'runtest': (
             'pytest'
             ' -m "not xfail"'  # don't run tests that are expected that they might fail
             ' -k "not test_frame_reading_mem_vs_file"'  # this one hangs
             '" and not test_antialias_default_warning"'  # flaky test which is removed in later versions
+            '" and not test_internet"'  # Online access
+            '" and not test_classification_model"'  # torch.OutOfMemoryError during tests for "small" GPUs
+            '" and not test_videoapi"'  # video support is unstable
+            '" and not avif and not heic"'  # requires torchvision-extra-decoders, libavif PyTorch support, libheic
+            '" and not test_pretrained_pos and not test_equivalent_behavior_weights"'  # tests out of date?
         ),
         'testinstall': True,
     }),
     ('torchaudio', version, {
-        'installopts': "--no-use-pep517 -v",
         'patches': [
-            'torchaudio-2.1.2_use-external-sox.patch',
             'torchaudio-2.1.2_transform_test_tol.patch',
+            'torchaudio-2.3.0_remove-librosa-version-check.patch',
+            'torchaudio-2.3.0_use-external-sox.patch',
+            {'name': 'torchaudio-2.6.0_use_ffmpeg7.patch', 'alt_location': 'torchaudio'},
+            {'name': 'torchaudio-2.7.0_fix-encode-process.patch', 'alt_location': 'torchaudio'},
+            {'name': 'torchaudio-2.7.0_fix_tests_gpu.patch', 'alt_location': 'torchaudio'},
         ],
         'preinstallopts': ('unset BUILD_VERSION && '
-                           'rm -r third_party/{sox,ffmpeg/multi}; '  # runs twice when testinstall
+                           'rm -r third_party/{sox,ffmpeg/multi}; '  # Don't fail because it runs twice (testinstall)
                            + local_preinstall_opts),
         'source_urls': ['https://github.com/pytorch/audio/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
         'checksums': [
-            {'torchaudio-2.1.2.tar.gz': '82c2745a73172b495327ec36c6970ad5ad9d5d2ac44feeaea2617152f9393bf7'},
-            {'torchaudio-2.1.2_use-external-sox.patch':
-             'a93ebe0b4e7b10b0a264a09d5c49375674e24666258820738ede07e5b457010c'},
+            {'torchaudio-2.7.1.tar.gz': 'fc8159476d1b3b5978d5e66746fc34be168170800ff4c5e356433d8c9c57cbea'},
             {'torchaudio-2.1.2_transform_test_tol.patch':
              '57f315c60db70ed2bd9711bcf6f7c7c24dac8c2f04e00488996eb2dc507bdfd2'},
+            {'torchaudio-2.3.0_remove-librosa-version-check.patch':
+             'a98ce800ef0f3bd551b5f7ecec00f7164c4066e1799bdc9838c3f231e2b06622'},
+            {'torchaudio-2.3.0_use-external-sox.patch':
+             'da765487aa7ec83f9ebe603b11365bfe3a70b3492982a6aa504d945b9aa91da8'},
+            {'torchaudio-2.6.0_use_ffmpeg7.patch': '1a2f7505efee9852ef393e6f4583cef209ad302db241171bf41be8d4a88920bd'},
+            {'torchaudio-2.7.0_fix-encode-process.patch':
+             'a00772c8869b4202491e043c38f2be20f6da650c105ea72b6b47001e84081999'},
+            {'torchaudio-2.7.0_fix_tests_gpu.patch':
+             '6354639636075920dfbb533631f0e22fd2e846490aabe202c5b27d63f58e0f00'},
         ],
         'runtest': (
+            # Make CUBLAS deterministic
+            'CUBLAS_WORKSPACE_CONFIG=:16:8 '
             'pytest test/torchaudio_unittest/'
-            ' -k "not TestProcessPoolExecutor"'  # hang maybe related https://github.com/pytorch/audio/issues/1021
-            '" and not FilterGraphWithCudaAccel"'  # requires FFmpeg with CUDA support
-            '" and not kaldi_io_test"'  # requires kaldi_io
-            '" and not test_dup_hw_acel"'  # requires special render device permissions
-            '" and not test_h264_cuvid"'  # requires special render device permissions
-            '" and not test_hevc_cuvid"'  # requires special render device permissions
+            " -k 'not " + " and not ".join((
+                'TestProcessPoolExecutor',  # hang maybe related https://github.com/pytorch/audio/issues/1021
+                'FilterGraphWithCudaAccel',  # requires FFmpeg with CUDA support
+                # Large difference, caused by numba<0.62.0, torchaudio 2.9 uses mocks instead avoiding this
+                'test_phase_vocoder',
+                'kaldi_io_test',  # requires kaldi_io
+                'test_dup_hw_acel',  # requires special render device permissions
+                'test_h264_cuvid',  # requires special render device permissions
+                'test_hevc_cuvid',  # requires special render device permissions
+                'test_hevc_cuvid',  # requires special render device permissions
+                'test_requests_',   # requires internet access
+                'TestFileObjectHttp',   # requires internet access
+                '_large',   # Speed up our test runs
+            )) + "'"
         ),
         'testinstall': True,
     }),
-    ('pytorch-ignite', '0.4.13', {
+    ('pytorch-fid', '0.3.0', {
+        'checksums': ['1c80d112c9cf5ebcbcc428a0b7ea615c302805ad6780ec29e8e2955ba31571c8'],
+    }),
+    ('pytorch-ignite', '0.5.2', {
         'modulename': 'ignite',
         'source_urls': ['https://github.com/pytorch/ignite/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'patches': ['torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch'],
+        'sources': [local_gh_source],
+        'patches': [
+            'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch',
+            'torch-ignite-0.5.2_fix-conftest-options.patch',
+            'torch-ignite-0.5.2_fix-pynvml-smi.patch',
+        ],
         'checksums': [
-            {'pytorch-ignite-0.4.13.tar.gz': 'bfe4b6f1cd96e78c021a65a0c51350cdb89d6ef5a8b9609638666ca95bae51d7'},
+            {'pytorch-ignite-0.5.2.tar.gz': 'f11777f5ab9f74d72c66adfb9214ae16ad1752ca0e866d6bf6f1c0738c5e99c2'},
             {'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch':
              'fd5dfe99f4c8804d6c57e4d9140d9e556e0724b379f9eaae8aeaf1b7bd058686'},
+            {'torch-ignite-0.5.2_fix-conftest-options.patch':
+             '6347914a76f21a5134f920f02d3c4dc509c5e2bc52c46e46fe524824a637def0'},
+            {'torch-ignite-0.5.2_fix-pynvml-smi.patch':
+             'a5ddc55eaa2255e5a8643c5974eb1354cc4a6b4a26290bfc2c4d681aa4a5aeda'},
         ],
         'runtest': (
-            'pytest'
-            ' -m "not distributed"'
-            ' --ignore=tests/ignite/contrib/handlers/test_clearml_logger.py'  # requires clearml
-            ' --ignore=tests/ignite/contrib/handlers/test_mlflow_logger.py'  # requires mlflow
-            ' --ignore=tests/ignite/contrib/handlers/test_neptune_logger.py'  # requires neptune
-            ' --ignore=tests/ignite/contrib/handlers/test_polyaxon_logger.py'  # requires polyaxon
-            ' --ignore=tests/ignite/contrib/handlers/test_tensorboard_logger.py'  # requires tensorboardX
-            ' --ignore=tests/ignite/contrib/handlers/test_visdom_logger.py'  # requires visdom
-            ' --ignore=tests/ignite/contrib/handlers/test_wandb_logger.py'  # requires wandb
-            ' --ignore=tests/ignite/metrics/gan/test_fid.py'  # requires pytorch_fid
-            ' --ignore=tests/ignite/metrics/nlp/test_rouge.py'  # requires rouge
-            ' --ignore=tests/ignite/handlers/test_checkpoint.py'  # fails by comparing tensors on different devices
-            ' --ignore=tests/ignite/contrib/handlers/test_tqdm_logger.py'  # fragile tests on some platforms
-            ' -k "not test_setup_visdom_logging"'  # requires visdom
-            '" and not test_setup_plx_logging"'  # requires polyaxon
-            '" and not test_setup_mlflow_logging"'  # requires mlflow
-            '" and not test_setup_clearml_logging"'  # requires clearml
-            '" and not test_setup_neptune_logging"'  # requires neptune
-            '" and not test__setup_ddp_vars_from_slurm_env_bad_configs"'  # fails sometimes
-            '" and not test__native_dist_model_create_from_backend_bad_config"'  # fails sometimes
-            '" and not test_inception_score"'  # fails sometimes due to connection problem with download.pytorch.org
+            'pytest -m "not distributed"' +
+            ' --ignore='.join((
+                '',  # Empty for join()
+                'tests/ignite/handlers/test_checkpoint.py',  # fails by comparing tensors on different devices
+                'tests/ignite/handlers/test_clearml_logger.py',  # requires clearml
+                'tests/ignite/handlers/test_mlflow_logger.py',  # requires mlflow
+                'tests/ignite/handlers/test_neptune_logger.py',  # requires neptune
+                'tests/ignite/handlers/test_polyaxon_logger.py',  # requires polyaxon
+                'tests/ignite/handlers/test_tensorboard_logger.py',  # requires tensorboardX
+                'tests/ignite/handlers/test_visdom_logger.py',  # Spins up local server which may fail
+                'tests/ignite/handlers/test_wandb_logger.py',  # requires wandb
+                'tests/ignite/metrics/vision/test_object_detection_map.py',  # requires pycocotools
+                'tests/ignite/metrics/nlp/test_rouge.py',  # requires rouge
+            )) +
+            " -k 'not " + " and not ".join((
+                'test_setup_plx_logging',  # requires polyaxon
+                'test_setup_mlflow_logging',  # requires mlflow
+                'test_setup_clearml_logging',  # requires clearml
+                'test_setup_neptune_logging',  # requires neptune
+                'test_setup_tb_logging',  # requires tesorboardX
+                'test__setup_ddp_vars_from_slurm_env_bad_configs',  # fails sometimes
+                'test__native_dist_model_create_from_backend_bad_config',  # fails sometimes
+                'test_inception_score',  # fails sometimes due to connection problem with download.pytorch.org
+            )) + "'"
         ),
         'testinstall': True,
     }),
     ('torch-tb-profiler', '0.4.3', {
         'modulename': 'torch.profiler',
-        'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
         'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
         'runtest': (
             'pytest'
@@ -187,15 +203,56 @@ exts_list = [
         ),
         'testinstall': True,
     }),
-    ('tensordict', '0.3.0', {
+    ('tensordict', '0.7.2', {
         'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['f0d95e8f055c3f82838fdbeb03c6a907f8786c1046791db7e39cdcd9cb8f1889'],
+        'sources': [local_gh_source],
+        'checksums': ['7ae5edfd8f5b7da8bf10ca81a34b7a3013058bd7bfaa32837cd3fd97e7b755c6'],
     }),
-    ('torchrl', '0.3.0', {
+    ('torchrl', '0.7.2', {
         'source_urls': ['https://github.com/pytorch/rl/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['3ddb63dd33590c37f8edc9784cee718c20e2ced0c6bf0135600eb2dda7014814'],
+        'sources': [local_gh_source],
+        'checksums': ['1621b621ee8c73b51dca3e52ee9f7704019c8b3bad70a67bb10f02559f4558ac'],
+    }),
+    # requirements for torchtune
+    ('antlr4-python3-runtime', '4.9.3', {
+        'modulename': 'antlr4',
+        'checksums': ['f224469b4168294902bb1efa80a8bf7855f24c99aef99cbefc1bcd3cce77881b'],
+    }),
+    ('omegaconf', '2.3.0', {
+        'checksums': ['d5d4b6d29955cc50ad50c46dc269bcd92c6e00f5f90d23ab5fee7bfca4ba4cc7'],
+    }),
+    ('blobfile', '3.0.0', {
+        'checksums': ['32ec777414de7bb2a76ca812a838f0d33327ca28ae844a253503cde625cdf2f1'],
+    }),
+    ('kagglehub', '0.3.12', {
+        'checksums': ['45e75854630a30605b794eb786b3757beccbbea1acca71600642f67b60e0d7bf'],
+    }),
+    ('pycryptodomex', '3.21.0', {
+        'modulename': 'Crypto',
+        'checksums': ['222d0bd05381dd25c32dd6065c071ebf084212ab79bab4599ba9e6a3e0009e6c'],
+    }),
+    ('torchao', '0.12.0', {
+        'source_urls': ['https://github.com/pytorch/ao/archive'],
+        'sources': [local_gh_source],
+        'checksums': ['c477d78ca5268187979934d3eb38590758adc5415526b3705a9a85099e40ad21'],
+        # Need path to installed cutlass, as third_party folder is not populated
+        'preinstallopts': (
+            f'export CPATH="$CPATH:{local_cutlass_path}/include:{local_cutlass_path}/tools/util/include" && '
+            + local_preinstall_opts),
+    }),
+    ('torchdata', '0.11.0', {
+        'source_urls': ['https://github.com/pytorch/data/archive'],
+        'sources': [local_gh_source],
+        'checksums': ['945c53a8587567624aaad2d66204fbae9acb9535696554c53ffeb83320c308b9'],
+        'runtest': False,  # circular test requirements
+    }),
+    ('torchtune', '0.6.1', {
+        'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
+        'sources': [local_gh_source],
+        'checksums': ['80a06ba0760741aa91f5f7bfb49ef6bb779c8044409dd7ef116f5420f122214b'],
+        'preinstallopts': ("""sed -i 's/^dynamic.*/version = "%(version)s"/' pyproject.toml && """
+                           + local_preinstall_opts),
+        'runtest': False,  # circular test requirements
     }),
 ]

Diff against PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb

easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb

diff --git a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb
index 257b0c90e2..ff3d39fc3a 100644
--- a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb
+++ b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb
@@ -1,40 +1,45 @@
 easyblock = 'PythonBundle'
 
 name = 'PyTorch-bundle'
-version = '2.1.2'
+version = '2.7.1'
 versionsuffix = '-CUDA-%(cudaver)s'
 
 homepage = 'https://pytorch.org/'
 description = """PyTorch with compatible versions of official Torch extensions."""
 
-toolchain = {'name': 'foss', 'version': '2023a'}
+toolchain = {'name': 'foss', 'version': '2024a'}
 
 builddependencies = [
-    ('CMake', '3.26.3'),
-    ('RE2', '2023-08-01'),  # for torchtext
+    ('CMake', '3.29.3'),
+    ('git', '2.45.1'),
+    ('hatchling', '1.24.2'),  # for pytorch-ignite
+    ('dill', '0.3.9'),  # for pytorch-ignite tests
+    ('scikit-learn', '1.5.2'),  # for pytorch-ignite tests
+    ('scikit-image', '0.25.0'),  # for pytorch-ignite tests
+    ('visdom', '0.2.4'),  # for pytorch-ignite tests
+    ('Java', '17', '', SYSTEM),  # needed by ANTLR runtime
+    ('pytest-mock', '3.14.1'),  # for torchvision tests
     ('parameterized', '0.9.0'),  # for torchtext and torchaudio tests
-    ('scikit-learn', '1.3.1'),  # for torchaudio and pytorch-ignite tests
-    ('scikit-image', '0.22.0'),  # for pytorch-ignite tests
-    ('dill', '0.3.7'),  # for pytorch-ignite tests
-    ('matplotlib', '3.7.2'),  # for pytorch-ignite tests
-    ('librosa', '0.10.1'),  # for torchaudio tests
-    ('NLTK', '3.8.1'),  # for torchtext tests
-    ('Scalene', '1.5.26'),  # for pynvml in ignite tests
+    ('librosa', '0.10.2.post1'),  # for torchaudio tests
+    ('NLTK', '3.9.1'),  # for torchaudio tests
 ]
 
 dependencies = [
-    ('CUDA', '12.1.1', '', SYSTEM),
-    ('Python', '3.11.3'),
+    ('CUDA', '12.6.0', '', SYSTEM),
+    ('Python', '3.12.3'),
     ('PyTorch', version, versionsuffix),
-    ('Pillow-SIMD', '9.5.0'),  # for torchvision
-    ('libjpeg-turbo', '2.1.5.1'),  # for torchvision
-    ('SentencePiece', '0.2.0'),  # for torchtext
-    ('tqdm', '4.66.1'),  # for torchtext
-    ('double-conversion', '3.3.0'),  # for torchtext
-    ('utf8proc', '2.8.0'),  # for torchtext
-    ('tensorboard', '2.15.1'),  # for torch-tb-profiler
-    ('FFmpeg', '6.0'),  # for torchvision and torchaudio
+    ('FFmpeg', '7.0.2'),  # for torchvision and torchaudio
+    ('HF-Datasets', '4.0.0'),  # for torchtune
+    ('libjpeg-turbo', '3.0.1'),  # for torchvision
+    ('lxml', '5.3.0'),  # for torchtune
+    ('orjson', '3.10.13'),  # for torchrl
+    ('Pillow-SIMD', '10.4.0'),  # for torchvision
+    ('Safetensors', '0.6.2'),  # for torchtune
+    ('SentencePiece', '0.2.1'),  # for torchtune
     ('SoX', '14.4.2'),  # for torchaudio
+    ('tensorboard', '2.18.0'),  # for torch-tb-profiler
+    ('tiktoken', '0.9.0'),  # for torchtune
+    ('tokenizers', '0.21.4'),  # for torchtune
 ]
 
 local_preinstall_opts = ' '.join([
@@ -44,141 +49,148 @@ local_preinstall_opts = ' '.join([
     'USE_CUDNN=1',
     'USE_FFMPEG=1', 'FFMPEG_ROOT="$EBROOTFFMPEG"',
     'CMAKE_BUILD_PARALLEL_LEVEL=%(parallel)s',
-]) + ' '
+])
 
 exts_default_options = {
     'preinstallopts': local_preinstall_opts,
     'prebuildopts': local_preinstall_opts,
+    # Workaround for nvrtcCompileProgram in CUDA < 12.6.2 changing the locale  potentially causing UnicodeDecodeError
+    'pretestopts': ('PYTHONUTF8=1 '
+                    'MAX_JOBS=%(parallel)s TRITON_HOME="%(builddir)s/ttHome" TRITON_CACHE_DIR="%(builddir)s/ttCache"'),
 }
 
-# Check with https://pytorch.org/audio/stable/installation.html#compatibility-matrix
+local_gh_source = {'download_filename': V_VERSION_TAR_GZ, 'filename': SOURCE_TAR_GZ}
+local_cutlass_path = "$EBROOTNVIDIAMINCUTLASS/lib/python%(pyshortver)s/site-packages/cutlass_library/source"
+
 exts_list = [
-    ('portalocker', '2.8.2', {
-        'checksums': ['2b035aa7828e46c58e9b31390ee1f169b98e1066ab10b9a6a861fe7e25ee4f33'],
+    ('pynvml', '11.5.3', {
+        # needed by torch-ignite
+        # see https://github.com/pytorch/ignite/blob/adb2a557650d55db25082f9cb06ea59c7c69e562/requirements-dev.txt#L24
+        'checksums': ['183d223ae487e5f00402d8da06c68c978ef8a9295793ee75559839c6ade7b229'],
     }),
-    ('torchdata', '0.7.1', {
-        'source_urls': ['https://github.com/pytorch/data/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['ef9bbdcee759b53c3c9d99e76eb0a66da33d36bfb7f859a25a9b5e737a51fa23'],
-        'runtest': False,  # circular test requirements
-    }),
-    ('torchtext', '0.16.2', {
-        'patches': [
-            'torchtext-0.14.1_use-system-libs.patch',
-            'torchtext-0.16.2_download-to-project-root.patch',
-        ],
-        'source_urls': ['https://github.com/pytorch/text/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': [
-            {'torchtext-0.16.2.tar.gz': '6574b012804f65220329a2ad34a95c18e4df0d4cff2f862fb7862d57b374b013'},
-            {'torchtext-0.14.1_use-system-libs.patch':
-             'a29ce29259d8c1cf3533cdc23c66e68eec660d6206ae04ced0220a7c02712b53'},
-            {'torchtext-0.16.2_download-to-project-root.patch':
-             '9d5599a9983729cf1fc7ab2a2f65d1887f223f528e15662ba1b4a5e359c9686d'},
-        ],
-        'runtest': (
-            'pytest test/torchtext_unittest'
-            ' -k "not test_vocab_from_raw_text_file"'  # segfaults
-            '" and not test_get_tokenizer_moses"'  # requires sacremoses
-            '" and not test_get_tokenizer_spacy"'  # requires spaCy
-            '" and not test_download_charngram_vectors"'  # requires internet access and required host may fail
-            '" and not test_download_glove_vectors"'  # requires internet access and required host may fail
-            '" and not test_vectors_get_vecs"'  # requires internet access and required host may fail
-        ),
-        'testinstall': True,
-    }),
-    ('pytest-mock', '3.11.1', {  # for torchvision tests
-        'checksums': ['7f6b125602ac6d743e523ae0bfa71e1a697a2f5534064528c6ff84c2f7c2fc7f'],
-    }),
-    ('torchvision', '0.16.2', {
-        'installopts': '-v',
-        'patches': [
-            'torchvision-0.16.2_ffmpeg-6.0-fix.patch',
-            'torchvision-0.16.2_quantized_tol.patch',
-        ],
+    ('torchvision', '0.21.0', {
         'source_urls': ['https://github.com/pytorch/vision/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
+        'patches': [{'name': 'torchvision-0.17.0_quantized_tol.patch', 'alt_location': 'torchvision'}],
         'checksums': [
-            {'torchvision-0.16.2.tar.gz': '8c1f2951e98d8ada6e5a468f179af4be9f56d2ebc3ab057af873da61669806d7'},
-            {'torchvision-0.16.2_ffmpeg-6.0-fix.patch':
-             'a49336e7bfa1c950e886852bff37a3ea2146ac7bda87241e3ffb31c5cb869cce'},
-            {'torchvision-0.16.2_quantized_tol.patch':
-             '457cdf8ad6653838c552890bce95dbe30b7573b1643334284f5f4a58f74f6e40'},
+            {'torchvision-0.21.0.tar.gz': '0a4a967bbb7f9810f792cd0289a07fb98c8fb5d1303fae8b63e3a6b05d720058'},
+            {'torchvision-0.17.0_quantized_tol.patch':
+             '991b959f7d5e0fd418a163fa3ad828a2b60a64d0ce894cf579847138b13b62af'},
         ],
+        'installopts': '-v',
         'runtest': (
             'pytest'
             ' -m "not xfail"'  # don't run tests that are expected that they might fail
             ' -k "not test_frame_reading_mem_vs_file"'  # this one hangs
+            '" and not test_antialias_default_warning"'  # flaky test which is removed in later versions
+            '" and not test_internet"'  # Online access
+            '" and not test_classification_model"'  # torch.OutOfMemoryError during tests for "small" GPUs
+            '" and not test_videoapi"'  # video support is unstable
+            '" and not avif and not heic"'  # requires torchvision-extra-decoders, libavif PyTorch support, libheic
+            '" and not test_pretrained_pos and not test_equivalent_behavior_weights"'  # tests out of date?
         ),
         'testinstall': True,
     }),
     ('torchaudio', version, {
-        'installopts': "--no-use-pep517 -v",
         'patches': [
-            'torchaudio-2.1.2_use-external-sox.patch',
             'torchaudio-2.1.2_transform_test_tol.patch',
+            'torchaudio-2.3.0_remove-librosa-version-check.patch',
+            'torchaudio-2.3.0_use-external-sox.patch',
+            {'name': 'torchaudio-2.6.0_use_ffmpeg7.patch', 'alt_location': 'torchaudio'},
+            {'name': 'torchaudio-2.7.0_fix-encode-process.patch', 'alt_location': 'torchaudio'},
+            {'name': 'torchaudio-2.7.0_fix_tests_gpu.patch', 'alt_location': 'torchaudio'},
         ],
         'preinstallopts': ('unset BUILD_VERSION && '
-                           'rm -r third_party/{sox,ffmpeg/multi}; '  # runs twice when testinstall
+                           'rm -r third_party/{sox,ffmpeg/multi}; '  # Don't fail because it runs twice (testinstall)
                            + local_preinstall_opts),
         'source_urls': ['https://github.com/pytorch/audio/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'sources': [local_gh_source],
         'checksums': [
-            {'torchaudio-2.1.2.tar.gz': '82c2745a73172b495327ec36c6970ad5ad9d5d2ac44feeaea2617152f9393bf7'},
-            {'torchaudio-2.1.2_use-external-sox.patch':
-             'a93ebe0b4e7b10b0a264a09d5c49375674e24666258820738ede07e5b457010c'},
+            {'torchaudio-2.7.1.tar.gz': 'fc8159476d1b3b5978d5e66746fc34be168170800ff4c5e356433d8c9c57cbea'},
             {'torchaudio-2.1.2_transform_test_tol.patch':
              '57f315c60db70ed2bd9711bcf6f7c7c24dac8c2f04e00488996eb2dc507bdfd2'},
+            {'torchaudio-2.3.0_remove-librosa-version-check.patch':
+             'a98ce800ef0f3bd551b5f7ecec00f7164c4066e1799bdc9838c3f231e2b06622'},
+            {'torchaudio-2.3.0_use-external-sox.patch':
+             'da765487aa7ec83f9ebe603b11365bfe3a70b3492982a6aa504d945b9aa91da8'},
+            {'torchaudio-2.6.0_use_ffmpeg7.patch': '1a2f7505efee9852ef393e6f4583cef209ad302db241171bf41be8d4a88920bd'},
+            {'torchaudio-2.7.0_fix-encode-process.patch':
+             'a00772c8869b4202491e043c38f2be20f6da650c105ea72b6b47001e84081999'},
+            {'torchaudio-2.7.0_fix_tests_gpu.patch':
+             '6354639636075920dfbb533631f0e22fd2e846490aabe202c5b27d63f58e0f00'},
         ],
         'runtest': (
+            # Make CUBLAS deterministic
+            'CUBLAS_WORKSPACE_CONFIG=:16:8 '
             'pytest test/torchaudio_unittest/'
-            ' -k "not TestProcessPoolExecutor"'  # hang maybe related https://github.com/pytorch/audio/issues/1021
-            '" and not FilterGraphWithCudaAccel"'  # requires FFmpeg with CUDA support
-            '" and not kaldi_io_test"'  # requires kaldi_io
-            '" and not test_dup_hw_acel"'  # requires special render device permissions
-            '" and not test_h264_cuvid"'  # requires special render device permissions
-            '" and not test_hevc_cuvid"'  # requires special render device permissions
+            " -k 'not " + " and not ".join((
+                'TestProcessPoolExecutor',  # hang maybe related https://github.com/pytorch/audio/issues/1021
+                'FilterGraphWithCudaAccel',  # requires FFmpeg with CUDA support
+                # Large difference, caused by numba<0.62.0, torchaudio 2.9 uses mocks instead avoiding this
+                'test_phase_vocoder',
+                'kaldi_io_test',  # requires kaldi_io
+                'test_dup_hw_acel',  # requires special render device permissions
+                'test_h264_cuvid',  # requires special render device permissions
+                'test_hevc_cuvid',  # requires special render device permissions
+                'test_hevc_cuvid',  # requires special render device permissions
+                'test_requests_',   # requires internet access
+                'TestFileObjectHttp',   # requires internet access
+                '_large',   # Speed up our test runs
+            )) + "'"
         ),
         'testinstall': True,
     }),
-    ('pytorch-ignite', '0.4.13', {
+    ('pytorch-fid', '0.3.0', {
+        'checksums': ['1c80d112c9cf5ebcbcc428a0b7ea615c302805ad6780ec29e8e2955ba31571c8'],
+    }),
+    ('pytorch-ignite', '0.5.2', {
         'modulename': 'ignite',
         'source_urls': ['https://github.com/pytorch/ignite/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'patches': ['torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch'],
+        'sources': [local_gh_source],
+        'patches': [
+            'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch',
+            'torch-ignite-0.5.2_fix-conftest-options.patch',
+            'torch-ignite-0.5.2_fix-pynvml-smi.patch',
+        ],
         'checksums': [
-            {'pytorch-ignite-0.4.13.tar.gz': 'bfe4b6f1cd96e78c021a65a0c51350cdb89d6ef5a8b9609638666ca95bae51d7'},
+            {'pytorch-ignite-0.5.2.tar.gz': 'f11777f5ab9f74d72c66adfb9214ae16ad1752ca0e866d6bf6f1c0738c5e99c2'},
             {'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch':
              'fd5dfe99f4c8804d6c57e4d9140d9e556e0724b379f9eaae8aeaf1b7bd058686'},
+            {'torch-ignite-0.5.2_fix-conftest-options.patch':
+             '6347914a76f21a5134f920f02d3c4dc509c5e2bc52c46e46fe524824a637def0'},
+            {'torch-ignite-0.5.2_fix-pynvml-smi.patch':
+             'a5ddc55eaa2255e5a8643c5974eb1354cc4a6b4a26290bfc2c4d681aa4a5aeda'},
         ],
         'runtest': (
-            'pytest'
-            ' -m "not distributed"'
-            ' --ignore=tests/ignite/contrib/handlers/test_clearml_logger.py'  # requires clearml
-            ' --ignore=tests/ignite/contrib/handlers/test_mlflow_logger.py'  # requires mlflow
-            ' --ignore=tests/ignite/contrib/handlers/test_neptune_logger.py'  # requires neptune
-            ' --ignore=tests/ignite/contrib/handlers/test_polyaxon_logger.py'  # requires polyaxon
-            ' --ignore=tests/ignite/contrib/handlers/test_tensorboard_logger.py'  # requires tensorboardX
-            ' --ignore=tests/ignite/contrib/handlers/test_visdom_logger.py'  # requires visdom
-            ' --ignore=tests/ignite/contrib/handlers/test_wandb_logger.py'  # requires wandb
-            ' --ignore=tests/ignite/metrics/gan/test_fid.py'  # requires pytorch_fid
-            ' --ignore=tests/ignite/metrics/nlp/test_rouge.py'  # requires rouge
-            ' --ignore=tests/ignite/handlers/test_checkpoint.py'  # fails by comparing tensors on different devices
-            ' --ignore=tests/ignite/contrib/handlers/test_tqdm_logger.py'  # fragile tests on some platforms
-            ' -k "not test_setup_visdom_logging"'  # requires visdom
-            '" and not test_setup_plx_logging"'  # requires polyaxon
-            '" and not test_setup_mlflow_logging"'  # requires mlflow
-            '" and not test_setup_clearml_logging"'  # requires clearml
-            '" and not test_setup_neptune_logging"'  # requires neptune
-            '" and not test__setup_ddp_vars_from_slurm_env_bad_configs"'  # fails sometimes
-            '" and not test__native_dist_model_create_from_backend_bad_config"'  # fails sometimes
-            '" and not test_inception_score"'  # fails sometimes due to connection problem with download.pytorch.org
+            'pytest -m "not distributed"' +
+            ' --ignore='.join((
+                '',  # Empty for join()
+                'tests/ignite/handlers/test_checkpoint.py',  # fails by comparing tensors on different devices
+                'tests/ignite/handlers/test_clearml_logger.py',  # requires clearml
+                'tests/ignite/handlers/test_mlflow_logger.py',  # requires mlflow
+                'tests/ignite/handlers/test_neptune_logger.py',  # requires neptune
+                'tests/ignite/handlers/test_polyaxon_logger.py',  # requires polyaxon
+                'tests/ignite/handlers/test_tensorboard_logger.py',  # requires tensorboardX
+                'tests/ignite/handlers/test_visdom_logger.py',  # Spins up local server which may fail
+                'tests/ignite/handlers/test_wandb_logger.py',  # requires wandb
+                'tests/ignite/metrics/vision/test_object_detection_map.py',  # requires pycocotools
+                'tests/ignite/metrics/nlp/test_rouge.py',  # requires rouge
+            )) +
+            " -k 'not " + " and not ".join((
+                'test_setup_plx_logging',  # requires polyaxon
+                'test_setup_mlflow_logging',  # requires mlflow
+                'test_setup_clearml_logging',  # requires clearml
+                'test_setup_neptune_logging',  # requires neptune
+                'test_setup_tb_logging',  # requires tesorboardX
+                'test__setup_ddp_vars_from_slurm_env_bad_configs',  # fails sometimes
+                'test__native_dist_model_create_from_backend_bad_config',  # fails sometimes
+                'test_inception_score',  # fails sometimes due to connection problem with download.pytorch.org
+            )) + "'"
         ),
         'testinstall': True,
     }),
     ('torch-tb-profiler', '0.4.3', {
         'modulename': 'torch.profiler',
-        'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
         'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
         'runtest': (
             'pytest'
@@ -191,15 +203,56 @@ exts_list = [
         ),
         'testinstall': True,
     }),
-    ('tensordict', '0.3.0', {
+    ('tensordict', '0.7.2', {
         'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['f0d95e8f055c3f82838fdbeb03c6a907f8786c1046791db7e39cdcd9cb8f1889'],
+        'sources': [local_gh_source],
+        'checksums': ['7ae5edfd8f5b7da8bf10ca81a34b7a3013058bd7bfaa32837cd3fd97e7b755c6'],
     }),
-    ('torchrl', '0.3.0', {
+    ('torchrl', '0.7.2', {
         'source_urls': ['https://github.com/pytorch/rl/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['3ddb63dd33590c37f8edc9784cee718c20e2ced0c6bf0135600eb2dda7014814'],
+        'sources': [local_gh_source],
+        'checksums': ['1621b621ee8c73b51dca3e52ee9f7704019c8b3bad70a67bb10f02559f4558ac'],
+    }),
+    # requirements for torchtune
+    ('antlr4-python3-runtime', '4.9.3', {
+        'modulename': 'antlr4',
+        'checksums': ['f224469b4168294902bb1efa80a8bf7855f24c99aef99cbefc1bcd3cce77881b'],
+    }),
+    ('omegaconf', '2.3.0', {
+        'checksums': ['d5d4b6d29955cc50ad50c46dc269bcd92c6e00f5f90d23ab5fee7bfca4ba4cc7'],
+    }),
+    ('blobfile', '3.0.0', {
+        'checksums': ['32ec777414de7bb2a76ca812a838f0d33327ca28ae844a253503cde625cdf2f1'],
+    }),
+    ('kagglehub', '0.3.12', {
+        'checksums': ['45e75854630a30605b794eb786b3757beccbbea1acca71600642f67b60e0d7bf'],
+    }),
+    ('pycryptodomex', '3.21.0', {
+        'modulename': 'Crypto',
+        'checksums': ['222d0bd05381dd25c32dd6065c071ebf084212ab79bab4599ba9e6a3e0009e6c'],
+    }),
+    ('torchao', '0.12.0', {
+        'source_urls': ['https://github.com/pytorch/ao/archive'],
+        'sources': [local_gh_source],
+        'checksums': ['c477d78ca5268187979934d3eb38590758adc5415526b3705a9a85099e40ad21'],
+        # Need path to installed cutlass, as third_party folder is not populated
+        'preinstallopts': (
+            f'export CPATH="$CPATH:{local_cutlass_path}/include:{local_cutlass_path}/tools/util/include" && '
+            + local_preinstall_opts),
+    }),
+    ('torchdata', '0.11.0', {
+        'source_urls': ['https://github.com/pytorch/data/archive'],
+        'sources': [local_gh_source],
+        'checksums': ['945c53a8587567624aaad2d66204fbae9acb9535696554c53ffeb83320c308b9'],
+        'runtest': False,  # circular test requirements
+    }),
+    ('torchtune', '0.6.1', {
+        'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
+        'sources': [local_gh_source],
+        'checksums': ['80a06ba0760741aa91f5f7bfb49ef6bb779c8044409dd7ef116f5420f122214b'],
+        'preinstallopts': ("""sed -i 's/^dynamic.*/version = "%(version)s"/' pyproject.toml && """
+                           + local_preinstall_opts),
+        'runtest': False,  # circular test requirements
     }),
 ]

…d patches: torchaudio-2.6.0_fix_tests_cpu.patch, torchaudio-2.6.0_use_ffmpeg7.patch, torchaudio-2.7.0_fix-encode-process.patch, torchaudio-2.7.0_fix_tests_gpu.patch

Flamefire · 2026-05-06T17:16:46Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 10 mins 16 secs) (1 easyconfigs in total)
c49 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.65.06, Python 3.9.21
See https://gist.github.com/Flamefire/25c50b3616eea76d7f90611bba2c7114 for a full test report.

Flamefire · 2026-05-07T08:36:17Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 3 hours 43 mins 21 secs) (1 easyconfigs in total)
i8021 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 7352 24-Core Processor (zen2), 8 x NVIDIA NVIDIA A100-SXM4-40GB, 580.65.06, Python 3.9.21
See https://gist.github.com/Flamefire/4350a2e465068553fac89de46f00d67f for a full test report.

Flamefire · 2026-05-07T15:52:53Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 13 mins 22 secs) (1 easyconfigs in total)
c112 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.65.06, Python 3.9.21
See https://gist.github.com/Flamefire/503aee12772d9d20a4aba46aa45e8f40 for a full test report.

Flamefire · 2026-05-09T17:45:08Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 12 mins 24 secs) (1 easyconfigs in total)
c49 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.65.06, Python 3.9.21
See https://gist.github.com/Flamefire/0588e0b55df212bda12943975131859a for a full test report.

Flamefire · 2026-05-14T07:53:03Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 3 hours 36 mins 58 secs) (1 easyconfigs in total)
i8020 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 7352 24-Core Processor (zen2), 8 x NVIDIA NVIDIA A100-SXM4-40GB, 580.65.06, Python 3.9.21
See https://gist.github.com/Flamefire/e48410a5512eb6cca7750745d817cf8c for a full test report.

Flamefire · 2026-05-18T13:00:30Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 25 mins 27 secs) (1 easyconfigs in total)
c80 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.65.06, Python 3.9.21
See https://gist.github.com/Flamefire/18e2ae4a20996cedfa684e0e44f59b8f for a full test report.

Flamefire · 2026-05-18T16:21:37Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 28 mins 37 secs) (1 easyconfigs in total)
c102 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.65.06, Python 3.9.21
See https://gist.github.com/Flamefire/98dc32ae71d568e0a57dede683cdc7b0 for a full test report.

Flamefire · 2026-05-20T22:15:24Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 53 mins 59 secs) (1 easyconfigs in total)
c41 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.65.06, Python 3.9.21
See https://gist.github.com/Flamefire/9cd54e2194272a6f8032a75103651bc2 for a full test report.

Flamefire · 2026-05-26T17:46:52Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 53 mins 47 secs) (1 easyconfigs in total)
c151 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.159.04, Python 3.9.21
See https://gist.github.com/Flamefire/8d3c5f47f9b116a31d5a6f28697a1f1e for a full test report.

Flamefire · 2026-05-26T18:33:00Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 3 hours 47 mins 29 secs) (1 easyconfigs in total)
i8012 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 7352 24-Core Processor (zen2), 8 x NVIDIA NVIDIA A100-SXM4-40GB, 580.159.04, Python 3.9.21
See https://gist.github.com/Flamefire/fbb3f825401e148b507d02d4ade799ef for a full test report.

Flamefire · 2026-05-27T17:22:29Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 48 mins 5 secs) (1 easyconfigs in total)
c112 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.159.04, Python 3.9.21
See https://gist.github.com/Flamefire/4fc7d6b8892905da7e9b1013f316f407 for a full test report.

Flamefire · 2026-05-28T13:39:36Z

Test report by @Flamefire
FAILED
Build succeeded for 0 out of 1 (total: 2 hours 48 mins 10 secs) (1 easyconfigs in total)
c150 - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9334 32-Core Processor (zen4), 4 x NVIDIA NVIDIA H100, 580.159.04, Python 3.9.21
See https://gist.github.com/Flamefire/3f76a86d72037663b632adab9c3e83b0 for a full test report.

github-actions Bot added 2024a issues & PRs related to 2024a common toolchains update labels May 6, 2026

branfosj mentioned this pull request May 6, 2026

update homepage for magma #25923

Closed

adding easyconfigs: PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb an…

4d63bdd

…d patches: torchaudio-2.6.0_fix_tests_cpu.patch, torchaudio-2.6.0_use_ffmpeg7.patch, torchaudio-2.7.0_fix-encode-process.patch, torchaudio-2.7.0_fix_tests_gpu.patch

Flamefire force-pushed the 20260506144058_new_pr_PyTorch-bundle271 branch from a6296da to 4d63bdd Compare May 6, 2026 14:44

Fix exclusion and add missing patches

8e6aaad

Update excluded tests

e436853

Update excluded test

bb739c1

pavelToman mentioned this pull request May 12, 2026

{ai}[foss/2024a] WhisperX v3.7.4, ONNX-Runtime v1.23.2, ONNX v1.20.0, pyannote.audio v3.4.0, torchaudio v2.7.1, ... w/ CUDA 12.6.0 #24922

Open

Add missing commas

f60c19e

Exclude ignite test requiering pycocotools

1d4e450

Add pytorch-fid and fix pytorch-ignite test command

fb9d47d

Flamefire added 3 commits May 21, 2026 17:19

Consistenly add preinstallopts

3349253

Make sure cutlass is found in torachao

b04dc1e

Fix preinstallopts

d580721

jfgrimm mentioned this pull request May 27, 2026

{data,vis}[foss/2024a] Detectron2 v0.6, pycocotools v2.0.9 w/ CUDA 12.6.0 #26086

Open

1 task

Fix quoting in CPATH

27e92ea

Add SentencePiece

37ba217

Conversation

Flamefire commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented May 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Updated software PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb

Uh oh!

Flamefire commented May 6, 2026

Uh oh!

Flamefire commented May 7, 2026

Uh oh!

Flamefire commented May 7, 2026

Uh oh!

Flamefire commented May 9, 2026

Uh oh!

Flamefire commented May 14, 2026

Uh oh!

Flamefire commented May 18, 2026

Uh oh!

Flamefire commented May 18, 2026

Uh oh!

Flamefire commented May 20, 2026

Uh oh!

Flamefire commented May 26, 2026

Uh oh!

Flamefire commented May 26, 2026

Uh oh!

Flamefire commented May 27, 2026

Uh oh!

Flamefire commented May 28, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Flamefire commented May 6, 2026 •

edited

Loading

github-actions Bot commented May 6, 2026 •

edited

Loading

Updated software `PyTorch-bundle-2.7.1-foss-2024a-CUDA-12.6.0.eb`