• Sheltac@lemmy.world
    link
    fedilink
    English
    arrow-up
    17
    ·
    1 year ago

    There’s an in between. Have the LLM map into predefined responses, thus leveraging the LLM’s insane parsing abilities with the linearity of tree-like structures.

    It can be done, and can be done intelligently.

    Which I somewhat doubt was the case here.

    • lordcommander@waveform.social
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      At that point it’s probably cheaper to purchase support staff in SEA or Eastern Europe… staffing a software product team with ML and prompt engineers for a bespoke support solution is costly.

      Granted they probably went with a vendor, but that model has its own costly drawbacks.