Most active commenters

    ←back to thread

    176 points nxa | 11 comments | | HN request time: 0.63s | source | bottom

    I've been playing with embeddings and wanted to try out what results the embedding layer will produce based on just word-by-word input and addition / subtraction, beyond what many videos / papers mention (like the obvious king-man+woman=queen). So I built something that doesn't just give the first answer, but ranks the matches based on distance / cosine symmetry. I polished it a bit so that others can try it out, too.

    For now, I only have nouns (and some proper nouns) in the dataset, and pick the most common interpretation among the homographs. Also, it's case sensitive.

    1. __MatrixMan__ ◴[] No.43989961[source]
    Here's a challenge: find something to subtract from "hammer" which does not result in a word that has "gun" as a substring. I've been unsuccessful so far.
    replies(8): >>43990011 #>>43990015 #>>43990016 #>>43990019 #>>43990027 #>>43990335 #>>43990495 #>>43995910 #
    2. neom ◴[] No.43990011[source]
    if I'm allowed only 1 something, I can't find anything either, if I'm allowed a few somethings, "hammer - wine - beer - red - child" will get you there. Guessing given that a gun has a hammer and is also a tool, it's too heavily linked in the small dataset.
    3. tough ◴[] No.43990015[source]
    hammer + man = adult male body (75%)
    replies(1): >>43990410 #
    4. Retr0id ◴[] No.43990016[source]
    Well that's easy, subtract "gun" :P
    5. mrastro ◴[] No.43990019[source]
    The word "gun" itself seems to work. Package this as a game and you've got a pretty fun game on your hands :)
    replies(1): >>43991561 #
    6. downboots ◴[] No.43990027[source]
    Bullet
    7. aniviacat ◴[] No.43990335[source]
    Gun related stuff works: bullet, holster, barrel

    Other stuff that works: key, door, lock, smooth

    Some words that result in "flintlock": violence, anger, swing, hit, impact

    8. rdlw ◴[] No.43990410[source]
    Close, that's addition
    9. soxfox42 ◴[] No.43990495[source]
    hammer - red = lock
    10. __MatrixMan__ ◴[] No.43991561[source]
    Doh why didn't I think of that
    11. ttctciyf ◴[] No.43995910[source]
    hammer - keyboard = hammerhead

    Makes no sense, admittedly!

    - dulcimer and - zither are both in firmly in .*gun.* territory it seems..