Brutkey

Grant Me Strength
@GrantMeStrength@hachyderm.io

@vnikolov@ieji.de @screwlisp@gamerplus.org coding is moving around a lot of symbols adhering to templates and best practices. LLMs are good at that. They’re not so good at coming up with novel solutions - so they suck at almost everything else.


Vassil Nikolov | Васил Николов
@vnikolov@ieji.de

@GrantMeStrength@hachyderm.io wrote:

coding is moving around a lot of symbols adhering to templates
If coding here is computer programming, it is much, much more than that.
and best practices
Sometimes.

@screwlisp@gamerplus.org

screwlisp
@screwlisp@gamerplus.org

@GrantMeStrength@hachyderm.io
No they still have the deep learning thing.

You train your DL to feed your dogs. You run a test. Well, it forgets to feed the dogs in May but otherwise it was OK.
You add some training data indicating that dogs would in fact be fed. You run your test again. Lo, the dogs are fed in May this time. (Or you add more training examples of not starving the dogs in May again).

<- Like how a transformer can never, ever do cryptography.
@vnikolov@ieji.de

screwlisp
@screwlisp@gamerplus.org

@GrantMeStrength@hachyderm.io
In my dog example, the point is that piling on additional specific training doesn't mean that the system has stopped doing crazy things in the future. Just if you fill its training data with FEED DOGS THROUGHOUT MAY, when you ask it about feeding dogs throughout may you're likely to see more FEED DOGS THROUGHOUT MAY included.
@vnikolov@ieji.de

screwlisp
@screwlisp@gamerplus.org

@GrantMeStrength@hachyderm.io
In my dog example, the point is that piling on additional specific training doesn't mean that the system has stopped doing crazy things in the future. Just if you fill its training data with FEED DOGS THROUGHOUT MAY, when you ask it about feeding dogs throughout may you're likely to see more FEED DOGS THROUGHOUT MAY included.
@vnikolov@ieji.de

screwlisp
@screwlisp@gamerplus.org

@GrantMeStrength@hachyderm.io
what you said also sounds like they do symbol crunching, which is what classical (non-DL) ai did.
@vnikolov@ieji.de

screwlisp
@screwlisp@gamerplus.org

@GrantMeStrength@hachyderm.io
what you said also sounds like they do symbol crunching, which is what classical (non-DL) ai did.
@vnikolov@ieji.de

Vassil Nikolov | Васил Николов
@vnikolov@ieji.de

@screwlisp@gamerplus.org wrote:

... symbol crunching, which is what classical (non-DL) ai did
A meta-reply:
forgive this unsolicited suggestion, please, this might be a good subject for one of your Anonradio shows (in case your queue happens to be too short).

Vassil Nikolov | Васил Николов
@vnikolov@ieji.de

@screwlisp@gamerplus.org wrote:

... symbol crunching, which is what classical (non-DL) ai did
A meta-reply:
forgive this unsolicited suggestion, please, this might be a good subject for one of your Anonradio shows (in case your queue happens to be too short).

screwlisp
@screwlisp@gamerplus.org

@vnikolov@ieji.de We have something like a trajectory to it. The queue for Wednesday shows currently is

17 hours from now- jlamothe, emphasis on jlamothe's restaurant and extensive MOO (symbolic?) text-based VR

+ one week - Amin Bandali, whom I think was originally a mathematician many years software engineer, announcing emacsconf. Whom I will secretly plague with mathematical questions

+ one week - Ken Olum, a physicist who has a lisp model of quantum gravity - who learned lisp from McCarthy in '79

screwlisp
@screwlisp@gamerplus.org

@vnikolov@ieji.de We have something like a trajectory to it. The queue for Wednesday shows currently is

17 hours from now- jlamothe, emphasis on jlamothe's restaurant and extensive MOO (symbolic?) text-based VR

+ one week - Amin Bandali, whom I think was originally a mathematician many years software engineer, announcing emacsconf. Whom I will secretly plague with mathematical questions

+ one week - Ken Olum, a physicist who has a lisp model of quantum gravity - who learned lisp from McCarthy in '79

Vassil Nikolov | Васил Николов
@vnikolov@ieji.de

Excellent!

Let's see if I can re-activate my inner owl one of these Wednesday early mornings.

Aside: I still remember when I first heard the phrase "Good Old-Fashioned AI" = GOFAI (from a Dutch professor some three decades ago).

Not to be confused with Good Old-Fashioned Loverboy, which will turn fifty next year.

@screwlisp@gamerplus.org

Vassil Nikolov | Васил Николов
@vnikolov@ieji.de

Excellent!

Let's see if I can re-activate my inner owl one of these Wednesday early mornings.

Aside: I still remember when I first heard the phrase "Good Old-Fashioned AI" = GOFAI (from a Dutch professor some three decades ago).

Not to be confused with Good Old-Fashioned Loverboy, which will turn fifty next year.

@screwlisp@gamerplus.org