tensorboard

TensorBoard 训练可视化

补充说明

TensorBoard 读取训练事件文件,展示 loss、指标、计算图、直方图和超参数。它是本地和离线环境最常用的训练可视化工具。

常用示例

启动:

tensorboard --logdir runs --host 0.0.0.0 --port 6006

PyTorch 记录:

from torch.utils.tensorboard import SummaryWriter
writer = SummaryWriter("runs/exp1")
writer.add_scalar("loss/train", loss, step)
writer.add_scalar("acc/val", acc, step)
writer.add_text("config", str(config), 0)
writer.close()

比较多个实验:

tensorboard --logdir runs --reload_interval 5

记录超参数:

writer.add_hparams(
    {"lr": 1e-4, "batch_size": 8},
    {"hparam/accuracy": 0.91},
)

远程访问:

ssh -L 6006:localhost:6006 user@server

易错点与排错