• 0 Posts
  • 186 Comments
Joined 2 years ago
cake
Cake day: May 29th, 2024

help-circle
  • Hallucinations are an intrinsic part of how LLMs work. OpenAI, literally the people with the most to lose if LLMs aren’t useful, has admitted that hallucinations are a mathematical inevitability, not something that can be engineered around. On top of that, its been shown that for things like mathematical proof finding switching to more sophisticated models doesn’t make them more accurate, it just makes their arguments more convincing.

    Now, you might say “oh but you can have a human in the loop to check the AIs work”, but for programming tasks its already been found that using LLMs makes programmers less productive. If a human needs to go over everything an AI generates, and reason about it anyway, that’s not really saving time or effort. Now consider that as you make the LLM more complex, having it generate longer and more complicated blocks of text, its errors also become harder to detect. Is that not just shuffling around the necessary human brainpower for a task instead of reducing it?

    So, in what field is this sort of thing useful? At one point I was hopeful that LLMs could be used in text summarization, but if I have to read the original text anyway to make sure that I haven’t been fed some highly convincing falsehood then what is the point?

    Currently I’m of the opinion that we might be able to use specialized LLMs as a heuristic to narrow the search tree for things like SAT solvers and answer set generators, but I don’t have much optimism for other use cases.









  • Isn’t this an interesting property of market economies?

    Software and silicon chip manufacturing has literally nothing to do with food production and yet a ‘disaster’ (I.E. going back to the status quo as of a few years ago) in that industry will affect your ability to eat. Nothing has happened to the farmers or their fields, or to the logistics system that moves food from one place to another, and yet somehow things suddenly can’t find their way from where they are produced to where they are needed.

    Remember, this is supposed to be the most efficient way to allocate resources.



  • The Neverhood literally consists of photographs, it is as photorealistic as it is possible to be, and yet it has a very strong art direction. More modern titles like The Midnight Walk, Keeper, and Felt That Boxing are similar, though they are actually rendered rather than consisting of photographs and video. On the other side of the coin there are some visual effects that are quite abstracted from real life, but are also very GPU intensive, showing that just because an image doesn’t look like a photo doesn’t mean that its necessarily easy to render (note, that video is a human authored algorithm, not AI, though they do compare it to AI video generation).

    I used to have the same opinion that you express, but I think this was only ever really true in practice during the brown era, and not before or after. In fact some games like Thief 1&2, Half Life 1&2, and the Chronicles of Riddick were trying to be as photorealistic as possible at the time of their release, but are now pretty commonly praised for their “stylization” today. For example, the deep blacks and stark contrast of stencil shadows vs what you get with more modern lighting. I am reminded of a Brian Eno quote:

    Whatever you now find weird, ugly, uncomfortable and nasty about a new medium will surely become its signature. CD distortion, the jitteriness of digital video, the crap sound of 8-bit - all of these will be cherished and emulated as soon as they can be avoided.

    We are even seeing some nostalgia now for the pissfilter era, though that’s not an enthusiasm that I share. I suspect that we will eventually see TAA ghosting and ray tracing artifacts, that are currently much hated, be recreated in a controlled way as a stylistic choice. In particular I think that Control will eventually be praised for the way that it basically incorporated ray tracing artifacts into its art style, by using sparkly mineral walls and a dreamlike atmosphere.