• Drew
    link
    fedilink
    72 months ago

    I don’t think it’s training from AI data, but rather distillation: which tries to mimic another model

    So there’s a difference in what’s happening, one is taking the data as input and trying to form something new, while the other is trying to recreate the input

    • @seang96@spgrn.com
      link
      fedilink
      42 months ago

      Ah I saw it mentioned but paywall blocked the rest lol

      Distillation is basically reverse engineering for AI cool.