- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes MARKER, a mixture of LoRA experts for incomplete image–text learning. Results on three datasets are competitive, and the routing analyses provide useful evidence that expert selection varies with modality availability and individual inputs. However, several major concerns remain.
Critical strengths
-
Addresses a practical problem through parameter-efficient adaptation.
-
Routing diagnostics provide evidence of sample-dependent expert selection.
-
Reports computational cost and measured inference speed transparently.
Critical weaknesses
-
The architectural contribution is incremental, combining established LoRA experts, softmax routing, and top-k selection without a clearly new mechanism.
-
Related-work positioning is inadequate: previously requested Flex-MoE and DCP are absent, as are closely related Omni-SMoLA, LLaVA-MoLE, and MLE-SAM.
-
Comparisons with ordinary LoRA, per-missingness adapters, and existing LoRA-MoE methods under matched parameter budgets are missing.
-
Evaluation is restricted to ViLT and two modalities, leaving broader scalability and generalisation unverified.
-
Efficiency benefits are mixed, as lower FLOPs accompany substantially higher inference latency than prompt-based baselines.
-
Presentation requires substantial revision: Figure 1 contains accidental editing-interface artifacts, its caption mischaracterises prompt-based methods, and grammatical and notation issues persist.
Questions for authors
See weakness.