←back to thread

392 points lairv | 2 comments | | HN request time: 0.603s | source
Show context
HAL3000 ◴[] No.45528648[source]
All of the examples in videos are cherry picked. Go ask anyone working on humanoid robots today, almost everything you see here, if repeated 10 times, will enter failure mode because the happy path is so narrow. There should really be benchmarks where you invite robots from different companies, ask them beforehand about their capabilities, and then create an environment that is within those capabilities but was not used in the training data, and you will see the real failure rate. These things are not ready for anything besides tech demos currently. Most of the training is done in simulations that approximate physics, and the rest is done manually by humans using joysticks (almost everything they do with hands). Failure rates are staggering.
replies(17): >>45529270 #>>45529335 #>>45529542 #>>45529760 #>>45529839 #>>45529903 #>>45529962 #>>45530530 #>>45531634 #>>45532178 #>>45532431 #>>45532651 #>>45533534 #>>45533814 #>>45534991 #>>45539498 #>>45542410 #
pizzathyme ◴[] No.45529962[source]
How does this square with the video where they showed it running continuously for an hour doing an actual Amazon package sorting job? https://www.youtube.com/watch?v=lkc2y0yb89U
replies(3): >>45530162 #>>45530759 #>>45542843 #
dust42 ◴[] No.45530162[source]
> How does this square with the video where they showed it running continuously for an hour doing an actual Amazon package sorting job? https://www.youtube.com/watch?v=lkc2y0yb89U

The video shows several of glitches. From the comments:

  14:18 the Fall
  28:40 the Fall 2
  41:23 the Fall 3 
Also many of the packages on the left are there throughout the video.

But then I think lots of this can be solved in software and having seen how LLMs have advanced in the last few years, I'd not be surprised to see these robots useful in 5 years.

replies(3): >>45530438 #>>45532346 #>>45537320 #
tyre ◴[] No.45530438[source]
Three mistakes in an hour isn’t terrible, especially if that’s the last generation. As another commenter put it, this is the worst it’s ever going to be.
replies(2): >>45536539 #>>45542857 #
1. fragmede ◴[] No.45536539[source]
> this is the worst it’s ever going to be.

People keep parroting this line, but it's not a given, especially for such an ill-defined metric as "better". If I ask an LLM how its day was, there's no one right answer. (Users anthropomorphizing the LLM is a given these days, no matter how you may feel about that.)

replies(1): >>45538022 #
2. tim333 ◴[] No.45538022[source]
Yeah but for things like packets dropped per hour there will probably be improvement.