Most active commenters

    ←back to thread

    Figure 03, our 3rd generation humanoid robot

    (www.figure.ai)
    392 points lairv | 17 comments | 09 Oct 25 13:27 UTC | HN request time: 0s | source | bottom
    Show context
    HAL3000 ◴[09 Oct 25 14:59 UTC] No.45528648[source]▶
    All of the examples in videos are cherry picked. Go ask anyone working on humanoid robots today, almost everything you see here, if repeated 10 times, will enter failure mode because the happy path is so narrow. There should really be benchmarks where you invite robots from different companies, ask them beforehand about their capabilities, and then create an environment that is within those capabilities but was not used in the training data, and you will see the real failure rate. These things are not ready for anything besides tech demos currently. Most of the training is done in simulations that approximate physics, and the rest is done manually by humans using joysticks (almost everything they do with hands). Failure rates are staggering.
    replies(17): >>45529270 #>>45529335 #>>45529542 #>>45529760 #>>45529839 #>>45529903 #>>45529962 #>>45530530 #>>45531634 #>>45532178 #>>45532431 #>>45532651 #>>45533534 #>>45533814 #>>45534991 #>>45539498 #>>45542410 #
    1. pizzathyme ◴[09 Oct 25 16:31 UTC] No.45529962[source]▶
    How does this square with the video where they showed it running continuously for an hour doing an actual Amazon package sorting job? https://www.youtube.com/watch?v=lkc2y0yb89U
    replies(3): >>45530162 #>>45530759 #>>45542843 #
    2. dust42 ◴[09 Oct 25 16:48 UTC] No.45530162[source]▶
    > How does this square with the video where they showed it running continuously for an hour doing an actual Amazon package sorting job? https://www.youtube.com/watch?v=lkc2y0yb89U

    The video shows several of glitches. From the comments:

      14:18 the Fall
  28:40 the Fall 2
  41:23 the Fall 3
    Also many of the packages on the left are there throughout the video.

    But then I think lots of this can be solved in software and having seen how LLMs have advanced in the last few years, I'd not be surprised to see these robots useful in 5 years.

    replies(3): >>45530438 #>>45532346 #>>45537320 #
    3. tyre ◴[09 Oct 25 17:12 UTC] No.45530438[source]▶
    Three mistakes in an hour isn’t terrible, especially if that’s the last generation. As another commenter put it, this is the worst it’s ever going to be.
    replies(2): >>45536539 #>>45542857 #
    4. daveguy ◴[09 Oct 25 17:40 UTC] No.45530759[source]▶
    Is it really sorting? All I see is the humanoid robot moving similarly shaped / sized packages from one conveyor belt to a platform to another conveyor belt. A little industrial automation design would be much more effective, cheaper, and faster compared to the task it is performing.
    replies(2): >>45530956 #>>45533149 #
    5. flutas ◴[09 Oct 25 17:57 UTC] No.45530956[source]▶
    Plus it's missing the large stack of packages already in the corner that...seems like they will forever be stuck there.
    6. Razengan ◴[09 Oct 25 20:00 UTC] No.45532346[source]▶
    > But then I think lots of this can be solved in software and having seen how LLMs have advanced in the last few years, I'd not be surprised to see these robots useful in 5 years.

    Would asking the robot for a seahorse emoji leave you in a puddle of blood?

    replies(2): >>45532981 #>>45538046 #
    7. dust42 ◴[09 Oct 25 20:55 UTC] No.45532981{3}[source]▶
    Thinking about it, I am sure it is only a matter of time until a self driving car or a robot will be used to kill a human. Or on a lower level for a DDoS attack - all cars/robots going to the white house.
    replies(1): >>45534081 #
    8. yorwba ◴[09 Oct 25 21:12 UTC] No.45533149[source]▶
    The actual sorting is typically automated with scanners reading the labels and shunting packages from one conveyor belt onto another, basically a physical sorting network.

    Tasks left for human "sorters" to do are:

    - put packages on conveyor belt so the scanner can read the label (as done by the robot in the video)

    - deal with damaged or unreadable packages that can't be processed automatically

    - when a package gets jammed and forces the conveyor belt to stop, remove the offending package before restarting

    - receive packages at the other end and load them into vehicles

    Generally the difficulty with all of these is dealing with variability and humans act as variability absorbers so the machines can operate smoothly.

    replies(1): >>45534136 #
    9. kevin_thibedeau ◴[09 Oct 25 23:26 UTC] No.45534081{4}[source]▶
    > self driving car or a robot will be used to kill a human

    They already have. We just don't hold the perpetrators accountable.

    replies(1): >>45534128 #
    10. rkomorn ◴[09 Oct 25 23:37 UTC] No.45534128{5}[source]▶
    I think "has been used to kill" is a more serious accusation than "accidentally killed" (even if due to recklessness).

    What case(s) are you thinking of?

    11. ACCount37 ◴[09 Oct 25 23:40 UTC] No.45534136{3}[source]▶
    Which is why robots that can also absorb variability in the same way humans do would be so valuable.
    12. fragmede ◴[10 Oct 25 08:29 UTC] No.45536539{3}[source]▶
    > this is the worst it’s ever going to be.

    People keep parroting this line, but it's not a given, especially for such an ill-defined metric as "better". If I ask an LLM how its day was, there's no one right answer. (Users anthropomorphizing the LLM is a given these days, no matter how you may feel about that.)

    replies(1): >>45538022 #
    13. IanCal ◴[10 Oct 25 10:44 UTC] No.45537320[source]▶
    I was confused by this because I assumed the robot fell over a few times - these are times that one of the piled up packages falls off or is a bit knocked off behind the robot (the second one seems to be knocked off by the elbow?).
    14. tim333 ◴[10 Oct 25 12:09 UTC] No.45538022{4}[source]▶
    Yeah but for things like packets dropped per hour there will probably be improvement.
    15. tim333 ◴[10 Oct 25 12:12 UTC] No.45538046{3}[source]▶
    Now there's an idea for Terminator 7.
    16. godelski ◴[10 Oct 25 19:34 UTC] No.45542843[source]▶
    I'm really confused by this video. What is it even supposed to be doing?

    Is it supposed to be taking packages and placing them label face down?

    I cannot understand how a robot doing this is cheaper than a second scanner so you can read the label face down or face up. I mean you could do that with a mirror.

    But I'm not convinced it is even doing that. Several packages are already "label side down" and it just moves them along. Do those packages even have labels? Clearly the behavior learned is "label not on top", not "label side down". No way is that the intended behavior.

    If the bar code is the issue, then why not switch to a QR code or some other format? There's not much information you need in shipping so the QR code can have lots of redundancy, making it readable from many different angles and even if significantly damaged.

    The video description also says "approaching human-level dexterity and speed". No way. I'd wager I could do this task at least 10x its speed, if not 20x. And that I'd do it better! I mean I watched a few minutes at 2x speed and man is it slow. Sure, this thing might be able to run 24/7 without breaks, but if I'm running 10-20x faster then what's that matter? I could just come in a few hours a day and blow through its quota. I'd really like to see an actual human worker for comparison.

    But if we did want something to do this very narrow task for 24/7, I'm pretty sure there are a hundred different cheaper ways to do it. If there aren't, then it is because there is some edge cases that are pretty important. And without knowing that then we can't actually properly evaluate this video. Besides, this video seems like a pretty simple ideal case. I'm not sure what an actual amazon sorting process looks like, but I suspect not like this.

    Regardless, the results look pretty cool and I'm pretty impressed with Figure even if it is an over-simplified case.

    17. godelski ◴[10 Oct 25 19:35 UTC] No.45542857{3}[source]▶
    I only watched for 5 minutes, at double speed, but I saw a lot more than 3 mistakes fwiw