• peopleproblems@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    16 hours ago

    Tbf I think its the context limit that makes things hard.

    1m token context is so stupidly low for all of the input we consider and filter in real time.