←back to thread

293 points carabiner | 1 comments | | HN request time: 0.204s | source
Show context
intoamplitudes ◴[] No.44007496[source]
First impressions:

1. The data in most of the plots (see the appendix) look fake. Real life data does not look that clean.

2. In May of 2022, 6 months before chatGPT put genAI in the spotlight, how does a second-year PhD student manage to convince a large materials lab firm to conduct an experiment with over 1,000 of its employees? What was the model used? It only says GANs+diffusion. Most of the technical details are just high-level general explanations of what these concepts are, nothing specific.

"Following a short pilot program, the lab began a large-scale rollout of the model in May of 2022." Anyone who has worked at a large company knows -- this just does not happen.

replies(8): >>44007628 #>>44007719 #>>44007830 #>>44008308 #>>44009207 #>>44009339 #>>44009549 #>>44012142 #
raphman ◴[] No.44009207[source]
FWIW, in the q&a after a talk, he claims that it was a GNN (graph neural network), not a GAN.

(In this q&a, the audience does not really question the validity of the research.)

https://doi.org/10.52843/cassyni.n74lq7

replies(2): >>44010079 #>>44010434 #
rdtsc ◴[] No.44010434[source]
Oh interesting. I haven't talked to any recent graduates but I would expect an MIT PhD student to be more articulate and not say "like" every other word.

There was a question at the end that made him a little uncomfortable:

[1:00:20]

   Q: Did you use academic labs only or did you use private labs?

   A: (uncomfortable pause) Oh private, yeah, so like all corporate, yeah...

   Q: So, no academic labs?

   A: I think it's a good question (scratches head uncomfortably, seemingly trying to hide), what this would look like in an academic setting, cause like, ... the goals are driven by what product we're going make ... academia is all, like "we're looking around trying to create cool stuff"...
My 8 year-old is more articulated than this person. Perhaps they are just nervous, I'll give them that I guess.
replies(5): >>44010936 #>>44011162 #>>44011282 #>>44011415 #>>44011568 #
dguest ◴[] No.44011282[source]
Don't confuse a polished TED talk from a practiced speaker with a seminar from any random person in academia. I'm sad to admit I've given talks (many recorded) that are much worse than this.

These seminar-style talks in particular have a strong Goodheart bias: academic scientists judge each other on the papers they write, but the highest honors usually come in the form of invited talks. The result is that everyone is scrambling to have their students give talks.

In larger scientific collaborations it can get a bit perverse: you want to get everyone together for discussions, but the institutes will only pay for travel if you give their students a 20 minute talk. You'll often have conferences where everyone crams into a room and listens to back-to-back 20 minute lectures for a week straight (sometimes split into multiple "parallel sessions"), and the only real questions are from a few senior people.

It's a net positive, of course: there's still some time around the lectures and even in 2025 there's no good replacement for face-to-face interaction. But I often wish more people could just go to conferences to discuss their work rather than "giving a talk" on it.

replies(2): >>44011324 #>>44011629 #
1. jll29 ◴[] No.44011629[source]
> But I often wish more people could just go to conferences to discuss their work rather than "giving a talk" on it.

Very true point. I've been wondering why academics "suffer" so much from a system that they themselves created and are actively running (unpaid, all volunteers-based). Conferences are organized by academics for academics. Grants are subitted by and evalated by academics. Journals' editorial boards are staffed by academics to review the work of their peers. Even metrics of merit are defined by scholars of scientrometrics, also academics, to rate the works of their peers. Yet we have a system where peer review has a high element of arbitrariness, lacks minimal professional standards, conferences organizers take too much of their valuable time to do a job (rotational, even!) that is often mediocre, and authors donate their papers for free to commercial publishers from which their institutions then buy these same papers back for a lot of money. After a quick analysis of these entrenched systems in my first months of doctoral studies, I questioned the intelligence of people who first created such a system and then keep complaining about it, yet they make no move to change anything.

Let's invent a new meeting format where people basically travel to a nice place with few distractions in order to discuss their research informally, no talks.

In my field (computer science), it's what workshops once were before they became mini-conferences with three minutes question time (for all the questions from the whole audience after one talk, not per person asking) after talks.

PS [edit]: I once saw two older professors discussing something on the corridor floor of a conference while talks were going on inside the various rooms. They were sitting on the floor, both held pens and there were some loose papers scattered on the floor. This was right were people coming out of talks would have had to walk over them. I had skipped that session, so I asked them what they were doing. They said "Oh, we're writing a paper. We only meet twice a yeara some conference, that's when we need to get most of our important work done." At the time I found it funny, but with the benefit of hindsight isn't it a sad state of affairs?