☆ Yσɠƚԋσʂ ☆

  • 8.37K Posts
  • 7.28K Comments
Joined 7 years ago
cake
Cake day: January 18th, 2020

help-circle





















  • It turns out that there might be an elegant way around bloated context windows and slow inference speeds. Instead of stuffing thousands of text tokens into a prompt like standard retrieval setups do, Memorilla approach encodes an entire document collection into just 16 query dependent latent tokens. The system drops these soft memory tokens directly into the input embedding space of a frozen LLM. Doing so averages 394 times fewer document tokens than a full context baseline and 113 times fewer than a standard fifty document retrieval method. Aside from saving massive amounts of compute overhead, the system also beats full context inference on complex multi document reasoning tasks. It hit 84.33 percent accuracy on the FactKG dataset compared to 80.43 percent for full context while using 108 times fewer tokens to represent the source documents.

    This approach also has implications for continuous learning and agentic workflows. Having persistent memory prevents the agent from getting stuck in stupid navigation loops between previously explored items. Because the initial document encoding is a one time shared cost, the decoder only processes a small number of memory tokens. You get continuous adaptation to new environments without overwriting prior knowledge or blowing up your active context limit. It’s a really clever way to decouple persistent knowledge storage from the active context window.



  • Any project is a sum of its parts, and if you’re talking about maintainability, then the parts you could easily point to would be things like high coupling, overly large file sizes, functions that are too big and should be broken up.

    Meanwhile, your own link shows that it’s roughly within the ballpark of industry average. And if you look through issues for any large project on github you’ll see similar types of issues. Given how new the project is, none of this is really surprising or out of the ordinary.

    As a note, nowhere did I suggest they do manual code reviews of everything at this speed. What I do think they have is a regression test suite which they build out as issues come up and they fix them.



  • I keep hearing people talk about trust, and it’s really doesn’t make sense to me because we’ve never done software development based on trust. Humans make mistakes all the time, and I’ve seen plenty far worse human code than anything an LLM has crapped out over my career. The way we ensure quality is through having a process. It’s done by having good specifications, testing, code reviews, planning, and so on. All these things equally apply to code written by hand and that’s generated by an LLM, and trust has nothing to do with it.








  • The Trump administration did not rise, prima facie, like Venus on a half shell from the sea. Donald Trump is the result of a long process of political, cultural and social decay. He is a product of our failed democracy. The longer we perpetuate the fiction that we live in a functioning democracy, that Trump and the political mutations around him are somehow an aberrant deviation that can be vanquished in the next election, the more we will hurtle toward tyranny. The problem is not Trump. It is a political system, dominated by corporate power and the mandarins of the two major political parties, in which we don’t count.





  • I just can’t with people like you. If school is mandatory for 18 and under, and those stats exclude students, then the remaining demographic out of the 15 to 24 yr olds are… drum roll… youths from 19 to 24!

    Then it would just say 19-24 wouldn’t it genius? The stats obviously track 15-24 year olds across many countries because in many countries child labor is in fact prevalent.

    I don’t think you understand what “part-time” means. It literally means working a job for less than full time, and can even be a single hour per week.

    Nah, I understand what part-time means perfectly. And living in Canada I also know that it’s very much not a single hour a week in practice.

    The point of a part-time job for youths is to give them an idea of what actually working is like.

    Weird how I didn’t have to be subjected to this in USSR. I love how you’re just justifying child labor here pretending like exploiting children is good for them actually. What a clown.

    I worked part-time during highschool, and I had more free time than I knew what to do with.

    Oh you mean your shitty society didn’t provide you with any meaningful outlets, so you are thankful for having been exploited as a youth. You have Stockholm syndrome buddy.

    For the record, my parents grew up during the Iron Curtain under Soviet oppression.

    ah yes SoVieT OpPeRession of having guaranteed healthcare, jobs, education, and not having to worry whether you’d be able to retire in dignity. Not to mention kids actually getting to enjoy their childhood rather than being exploited like your dumb ass was.

    Go make a clown of yourself elsewhere.