- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes a complementary approach to investigating how AI impact our lives using four historical analogies such as Alchemy, Plastic Industry, Free Will, and White Elephants and learning from examples. Using these narratives, they help structure the discussions across disciplinary and professional boundaries, including discussions of where each analogy holds and where it breaks.
Critical strengths
-
The paper is relevant and attempts a complementary approach to investigate the role of AI in society using analogies from the past.
-
I like the counterarguments in the alchemy section, where the authors talk about competing arguments of Rahimi and LeCun, and the white elephant section uses railways and broadbands as counterexamples where they differentiate between poor financial returns and lasting social value.
Critical weaknesses
-
Novelty and contribution: The contribution of the paper remains unclear beyond the four already existing theories. Furthermore, several analogies already appear in existing literature. The paper explains each analogy and the history behind it well, but the novelty beyond that seems lacking.
-
The authors draw on how each analogy could be used to better understand AI's role; however, there is no worked example on how these could be used in real-life examples of AI usage.
-
The motivation behind choosing these four historical analogies is not systematic. The authors do mention that these are not helpful in all aspects and can be used informally, but I'd request an explanation as to why the authors chose these specific analogies.
-
Regarding emergent abilities, the authors cite works that show they are an artifact of evaluation metrics. These are useful, but at the same time, it is important to also consider that it is important to consider possible collective abilities (see OpenAI-Hugging Face incident).
Questions for authors
See above.