I recently finished my PhD studies in social sciences. Even though it did not lead me to career improvements as I initially expected, I am happy I had the opportunity to undertake an academic endeavor before LLMs became cheap and ubiquitous.
I bring up my studies because what the author is talking about strikes me as not having been ambitious enough in his thinking. If you prompt current LLMs with your idea and find the generated arguments and reasoning satisfactory, then you aren't really being rigorous or you're not having big enough ideas.
I say this confidently because my studies showed me not only the methods in finding and contrasting evidence around any given issue, but also how much more there is to learn about the universe. So, if you're being rigorous enough to look at implications of your theories, finding datapoints that speak to your conclusions and find that your question has been answered, then your idea is too small for what the state of knowledge is in 2025.
replies(1):