maelic/REACTPlusPlus_PSG

REACT++ Scene Graph Generation — PSG (yolo12l, yolo12m, yolo12s, yolo12n, yolov8m)

This repository contains REACT++ model checkpoints for scene graph generation (SGG) on the PSG benchmark, across 5 backbone sizes.

REACT++ is a parameter-efficient, attention-augmented relation predictor built on top of a YOLO12 backbone. It uses:

• DAMP (Detection-Anchored Multi-Scale Pooling), a new simple pooling algorithm for one-stage object detectors such as YOLO
• SwiGLU gated MLP for all feed-forward blocks (½ the params of ReLU-MLP at equal capacity)
• Visual x Semantic cross-attention — visual tokens attend to GloVe prototype embeddings
• Geometry RoPE — box-position encoded as a rotary frequency bias on the Q matrix
• Prototype Momentum Buffer — per-class EMA prototype bank
• P5 Scene Context — AIFI-enhanced P5 tokens provide global context via cross-attention

The models were trained with the SGG-Benchmark framework and described in the REACT++ paper (Neau et al., 2026).

Results — SGDet on PSG test split (ONNX, CUDA)

Metrics from end-to-end ONNX evaluation (tools/eval_onnx_psg.py). E2E Latency = image load + pre-process + ONNX forward.

Checkpoints

Usage

ONNX (recommended — no Python dependencies beyond onnxruntime)

from huggingface_hub import hf_hub_download

onnx_path = hf_hub_download(
    repo_id="maelic/REACTPlusPlus_PSG",
    filename="yolo12l/react_pp_yolo12m.onnx",
    repo_type="model",
)
# Run with tools/eval_onnx_psg.py or load directly via onnxruntime

PyTorch

# 1. Clone the repository
#    git clone https://github.com/Maelic/SGG-Benchmark

# 2. Install dependencies
#    pip install -e .

# 3. Download checkpoint + config
from huggingface_hub import hf_hub_download

ckpt_path = hf_hub_download(
    repo_id="maelic/REACTPlusPlus_PSG",
    filename="yolo12l/best_model.pth",
    repo_type="model",
)
cfg_path = hf_hub_download(
    repo_id="maelic/REACTPlusPlus_PSG",
    filename="yolo12l/config.yml",
    repo_type="model",
)

# 4. Run evaluation
import subprocess
subprocess.run([
    "python", "tools/relation_eval_hydra.py",
    "--config-path", str(cfg_path),
    "--task", "sgdet",
    "--eval-only",
    "--checkpoint", str(ckpt_path),
])

Citation

@article{neau2026reactpp,
  title   = {REACT++: Efficient Cross-Attention for Real-Time Scene Graph Generation
},
  author  = {Neau, Maëlic and Falomir, Zoe},
  year    = {2026},
  url     = {https://arxiv.org/abs/2603.06386},
}