acceptodds
Under review as a conference paper at ICLR 2027

Vibe Research Drives Scientific Inquiry Shallower Unless Human Judgment Is Scaffolded

Abstract

As AI systems grow more capable, researchers increasingly collaborate with them in scientific inquiry, a practice we term vibe research. This position paper argues that vibe research drives scientific inquiry shallower unless human judgment is scaffolded. We identify the root cause as Knowledge-Judgment (K-J) decoupling: at the research frontier, where no established ground truth exists, human judgment is the primary means of evaluating AI-generated knowledge, yet it is fallible, and its errors may go undetected. We propose the Asymmetric Coupling Framework (ACF), which models human–AI research collaboration as two nested loops. An exploratory study provides initial support for the framework's core implication: human judgment, not AI usage volume, determines the quality of AI-assisted research. To address K-J decoupling, we propose decision readiness scaffolding, through which AI helps researchers build the evaluative capacity needed at specific decision points. Scaffolding substantially reduces the expertise deficit: all 13 participants working outside their expertise produce ideas that meet or exceed the quality baseline they set within it. These results point to a broader principle: as AI takes a larger role in science, reliable research depends less on more capable AI than on deliberately cultivating the human judgment it cannot replace.

Primary area:
other topics in machine learning (i.e., none of the above)
Keywords:
vibe research, human-AI collaboration, AI for scientific research, human judgment

Reviews

Among:
Shape:
1234this paper, Bottom 27%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.00 over 3 reviews, above 27% of the others.
Reviewer_KAv1OpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper argues that AI-assisted research becomes vulnerable when generated material exceeds researchers' evaluative capacity. It proposes an Asymmetric Coupling Framework and a four-stage scaffolding workflow. Evidence includes observational ideation and within-person scaffolding studies with 13 researchers, plus an automated comparison of human-AI and autonomous research outputs. Guidance improves AI-rated idea quality in both expertise conditions.

Critical strengths
  1. Distinguishing research production from the ability to evaluate it is consequential for AI-assisted science. The nested-loop framework translates this concern into a concrete workflow, and Sections 3.2 and 5.2 usefully specify its scope and possible falsifiers.

  2. The within-person experiment provides an informative initial result: guided idea scores improve in expert and non-expert areas. The protocol, examples, and reported null results provide a useful starting point for studying structured research assistance.

Critical weaknesses
  1. The judgment measure does not support the central empirical inference. Section 3.3 and Appendix A.2 define higher judgment as lower research self-efficacy and lower actively open-minded thinking. Low confidence is not calibrated confidence; lower evidence-based openness is not established resistance to misleading persuasion. The negative correlations and sign-reversal checks do not validate this reinterpretation. The reported association therefore cannot establish that judgment determines quality.

  2. The scaffolding study measures improved proposals, not improved human evaluation. The authors acknowledge these limitations, but the central interpretation still exceeds the evidence. Structured prompting or closer alignment with evaluation rubrics remain viable explanations for the gains.

Questions for authors
  1. What independent evidence supports reversing both scales, especially AOT, to measure judgment rather than confidence and thinking disposition?

  2. Is there condition-blind expert assessment or interaction evidence separating improved human evaluation from improved proposal generation? If not, which empirical claims can be narrowed while retaining the position?

Reviewer_4YajOpenReview ↗
Rating
3
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This position paper discuessed the risks of AI-assisted scientific research. It emphasizes the situations when the complexity of AI-generated output exceeds researchers' ability to understand them. The author introduces K-J decoupling and propose the asymmetric coupling framework that models human-AI research colaboration through two nested loops. This paper also shows some human studies that shows structured scaffolding improves LLM-evalauted idea quality in both expert and non-expert domains.

Critical strengths
  1. timely topic: nowadays auto-research becomes an increasingly important problem. This is an importatn concern when the ability of research agents become stronger and stronger.

  2. well-defined framework: The proposed Knowledge-Judgement decoupling and Asymmetric Coupling Framework provide an intuitive perspective on human-AI collaboration. These two frameworks are relatively novel at the same time.

Critical weaknesses
  1. unclear measurement of human judgement: research judgement quality should be linked with domain expertise, research experience and maybe publication numbers and citations. It should not be measured with confidence. The assumption that researchers with lower confidence have better judgement does not quite hold.

  2. lack of fair baselines: The improvement from scaffolding may simply come from participants spending more time and effort on the task. The authors should compare against a simpler baseline where researchers receive clear instructions and guidance at the beginning, with similar time and AI usage budgets. This would help determine whether scaffolding itself provides additional benefits.

  3. lack of validation of the scaffolding mechanism: The paper proposes to break down complex research judgments into smaller, more manageable tasks. While this is reasonable, there is no direct evidence on checking whether researchers can actually evaluate these subtasks more easily after scaffolding. As a positon paper, i think it is relatively ok, but needs to be pointed out.

Questions for authors

see the weaknesses

Reviewer_dq2cOpenReview ↗
Rating
1
Confidence
3
Informativeness
2
Presentation
2
Soundness
1
Read review
Paper summary

This paper discusses the risks of vibe research, where researchers rely on AI to produce scientific work that they may not be able to fully evaluate. The authors propose a framework emphasizing the importance of human judgment and introduce a scaffolding approach to help researchers make better decisions. They provide preliminary experiments suggesting that structured guidance improves the quality of AI-assisted research ideas.

Critical strengths
  • The paper addresses an interesting and timely problem in AI-assisted scientific research.

  • The proposed framework offers a useful perspective on the role of human judgment in AI-assisted research.

  • The preliminary experimental results are promising, particularly when researchers work outside their expertise.

  • I appreciate that the authors acknowledge many of the limitations of their experiments.

Critical weaknesses

My main concern is that the experiments need to be more rigorous, particularly in terms of controls and evaluation.

  1. Small sample size. Only 13 participants, all from AI/ML, making it difficult to generalize the findings.

  2. AI-based evaluation. Research quality is assessed by AI reviewers, without independent human evaluation or validation.

  3. No control for time spent. Participants using scaffolding may simply have spent more time thinking about their ideas.

  4. Missing control conditions. It is unclear whether the improvements come from scaffolding human judgment or simply from following a more structured brainstorming process.

  5. No direct measurement of human judgment. This is my main concern. The authors claim that scaffolding improves human judgment, but they only measure the quality of the generated ideas, not whether participants actually become better at evaluating research decisions.

  6. Potential evaluation bias. AI reviewers might favor the structure of scaffolded ideas rather than their actual scientific quality.

Overall, I think the paper has an interesting message and promising initial results. However, the experiments leave too many alternative explanations open. I see this as a good position paper, but not yet a sufficiently validated contribution for the ICLR main track.

Questions for authors

NA

Comments on the paper

2 comments

The authors acknowledge that their submission is a position paper. While I understand that ICLR does not have a dedicated position paper track, I recognize that this does not necessarily preclude such submissions from being considered in the main track.

Nevertheless, I believe that position papers should be held to the same standards of novelty, significance, and scientific contribution as other ICLR submissions. In my assessment, this paper does not meet those standards. While it presents a perspective on the topic, I do not find that it offers sufficiently novel insights, rigorous analysis, or substantive contributions to justify acceptance at ICLR.

I therefore maintain my recommendation to reject the paper and encourage the authors to consider submitting their work to a conference with a dedicated position paper track, where it may be a better fit.

We thank the reviewer for reading our response and for the follow-up comment. We respect the reviewer's assessment, and we appreciate the clear statement of the standard being applied.

The review has been valuable to us. It led us to narrow the empirical claims and to state more plainly what the paper argues and what remains to be tested. We will also consider the reviewer's suggestion of a venue with a dedicated position paper track.

Thank you again for your time and feedback.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.