Official codebase for Orbital Transformers for Predicting Wavefunctions in Time-Dependent Density Functional Theory (ICLR 2026).
- Paper (OpenReview): https://openreview.net/pdf?id=06I7jcrkW2
- Datasets (Hugging Face): https://huggingface.co/datasets/divelab/OrbEvo
This repository contains code for training and evaluating autoregressive models for TDDFT dynamics.
conda create -n orbevo python=3.11 pip
conda activate orbevo
pip install torch==2.2.2 torchvision==0.17.2 torchaudio==2.2.2 --index-url https://download.pytorch.org/whl/cu121
pip install pyg_lib torch_scatter torch_sparse torch_cluster torch_spline_conv -f https://data.pyg.org/whl/torch-2.2.2+cu121.html
pip install torch_geometric==2.5.3
pip install numpy==1.26.4 hydra-core tensorboard e3nn tqdm huggingface_hubcurl -LsSf https://astral.sh/uv/install.sh | sh
source "$HOME/.local/bin/env"
uv venv --python 3.11
source .venv/bin/activate
uv pip install torch==2.2.2 torchvision==0.17.2 torchaudio==2.2.2 --index-url https://download.pytorch.org/whl/cu121
uv pip install pyg_lib torch_scatter torch_sparse torch_cluster torch_spline_conv -f https://data.pyg.org/whl/torch-2.2.2+cu121.html
uv pip install torch_geometric==2.5.3
uv pip install numpy==1.26.4 hydra-core tensorboard e3nn tqdm huggingface_hubPlease check the data release notes.
Data will be downloaded and processed automatically when running training for the first time.
Dataset conventions, initialization, and collate_fn usage are documented in orbevo/datasets/README.md
Example:
CUDA_VISIBLE_DEVICES=0 python -m orbevo.train +experiment=debugFor custom launches, edit experiment configs in orbevo/configs/experiment/ and run:
python -m orbevo.train +experiment=<experiment_name>Example:
python -m orbevo.eval \
--dataset QM9 \
--ckpt_path /path/to/ckpt/best_s1.pt \
--split test- OrbEvo-DM, QM9: https://huggingface.co/divelab/orbevo_model/blob/main/qm9_dm_pf_tb8_s8_395k_bs16.pt
- OrbEvo-DM, MDA: https://huggingface.co/divelab/orbevo_model/blob/main/MDA_dm_pf_tb8_s8_300k.pt
@inproceedings{
zhang2026orbital,
title={Orbital Transformers for Predicting Wavefunctions in Time-Dependent Density Functional Theory},
author={Xuan Zhang and Haiyang Yu and Chengdong Wang and Jacob Helwig and Shuiwang Ji and Xiaofeng Qian},
booktitle={The Fourteenth International Conference on Learning Representations},
year={2026},
url={https://openreview.net/forum?id=06I7jcrkW2}
}This work was supported in part by the U.S. Department of Energy Office of Basic Energy Sciences under grant DE-SC0023866, National Science Foundation under grant MOMS-2331036, National Institutes of Health under grant U01AG070112, and Advanced Research Projects Agency for Health under 1AY1AX000053.
