Brutkey

Jeremy Kahn
@trochee@dair-community.social

NLP (the nerdy kind). Wrong-half Jew. Privilege-traitor.
Linguist. Empiricist. Rager against machines. formerly
#indymedia
Also,
#comics, #SFF #scifi, languages, big data, algorithms, software design, and more.

#LLMSkeptic. farm-to-table organic free-range prose only. Don't send me generated text.

#WestSeattle #Duwamish unceded land

This profile is searchable by tootfinder.ch.


Notes
18240
Following
0
Followers
0
twitter (obsolete)
https://twitter.com/trochee
www
https://trochee.net/about
pronouns
he/him/his
signal
trochee.61
Jeremy Kahn
@trochee@dair-community.social

LLMs lower the immediate cost of "fucking around"

and push "finding out" beyond management's forecasting horizon

which is Yet Another reason that everyone with actual expertise should Avoid At All Costs

#NedLuddWasRight

Jeremy Kahn
@trochee@dair-community.social

Y'all, I ain't kidding about LLMs being "word shoggoths"

especially if you read "Elder Things" as "Slow AI" LLCs

Look what it says on Wikipedia:

Though able to "understand" the Elder Things' language, shoggoths had no real consciousness and were controlled through hypnotic suggestion.
…exterminating the shoggoths was not an option as the Elder Things were dependent on them for labor and had long lost their capacity to create new life.
https://en.wikipedia.org/wiki/Shoggoth

https://dair-community.social/@trochee/112477267079709781

Jeremy Kahn
@trochee@dair-community.social

I can't believe I didn't do this earlier

Jeremy Kahn
@trochee@dair-community.social

But what is the solarpunk approach to "Peak AI"?

Solarpunk offers a vision, in the face of gasoline, for planning community gardens, mutual aid societies, bike repair workshops, etc, even as the gasoline culture around us creaks and groans its way bloodily towards a reckoning

What is our (data science, machine learning, UX, design) equivalent of solarpunk for the concepts of automation?

5/

Jeremy Kahn
@trochee@dair-community.social

What is our (data science, machine learning, UX, design) equivalent of solarpunk?

Can we even imagine a world of automation
without the exploitation, fantasies of infinite growth, and the increasingly unsubtle justifications for "laundering toil away"?

What are compelling visions of the future of automation that _aren't_ burying the exploitation behind an app or within a billion-parameter model?

6/fin (I think)

Jeremy Kahn
@trochee@dair-community.social

The boom in LLMs is going to hollow out a number of knowledge-worker industries β€” for example, writing boilerplate code or technical documentation

Not because it does it well but because the flacks can sell upper management on the idea that it can do it at all, as
@pluralistic@mamot.fr recently pointed out

This sale is a pig-in-a-poke, and the winning move is to not be holding the bag when the actual code or documentation is found to be terrible

1/


Jeremy Kahn
@trochee@dair-community.social

@MisuseCase@twit.social

I'm far more sympathetic to the idea that the Fremen (or the Jedi, or the Eldar) are
also problematic

But to decide that therefore the Empire are the good guys, sheesh. I'm embarrassed that my generation of white guys is so shallow

Jeremy Kahn
@trochee@dair-community.social

Oh look the white house just deleted sections of Congress 's public copy of Article 1

Not only are we Ministry-of-Truth memory-holing habeas corpus, but we're crossing the separation of powers to do it

(Also, weak headline, MSN. Don't "ask a question", DO A JOURNALISM.)

https://www.alternet.org/white-house-constitutional-crisis/

Jeremy Kahn
@trochee@dair-community.social

LLMs lower the immediate cost of "fucking around"

and push "finding out" beyond management's forecasting horizon

which is Yet Another reason that everyone with actual expertise should Avoid At All Costs

#NedLuddWasRight

Jeremy Kahn
@trochee@dair-community.social

Y'all, I ain't kidding about LLMs being "word shoggoths"

especially if you read "Elder Things" as "Slow AI" LLCs

Look what it says on Wikipedia:

Though able to "understand" the Elder Things' language, shoggoths had no real consciousness and were controlled through hypnotic suggestion.
…exterminating the shoggoths was not an option as the Elder Things were dependent on them for labor and had long lost their capacity to create new life.
https://en.wikipedia.org/wiki/Shoggoth

https://dair-community.social/@trochee/112477267079709781

Jeremy Kahn
@trochee@dair-community.social

I can't believe I didn't do this earlier

Jeremy Kahn
@trochee@dair-community.social

But what is the solarpunk approach to "Peak AI"?

Solarpunk offers a vision, in the face of gasoline, for planning community gardens, mutual aid societies, bike repair workshops, etc, even as the gasoline culture around us creaks and groans its way bloodily towards a reckoning

What is our (data science, machine learning, UX, design) equivalent of solarpunk for the concepts of automation?

5/

Jeremy Kahn
@trochee@dair-community.social

What is our (data science, machine learning, UX, design) equivalent of solarpunk?

Can we even imagine a world of automation
without the exploitation, fantasies of infinite growth, and the increasingly unsubtle justifications for "laundering toil away"?

What are compelling visions of the future of automation that _aren't_ burying the exploitation behind an app or within a billion-parameter model?

6/fin (I think)

Jeremy Kahn
@trochee@dair-community.social

So, back to LLMs, or rather, back to prepping for "Peak AI"

(It's coming, let me tell you.)

Those of us currently under attack/usurpation by the push towards AI, we can respond to this by prepping toward either pole

The doom-prepper approach is to, I dunno, start planning a consultancy on "unbefunging your company's poorly-thought-out dependency on chatgpt", or building tools to poison (or detect poisoning) for the LLMs

4/

Jeremy Kahn
@trochee@dair-community.social

But what is the solarpunk approach to "Peak AI"?

Solarpunk offers a vision, in the face of gasoline, for planning community gardens, mutual aid societies, bike repair workshops, etc, even as the gasoline culture around us creaks and groans its way bloodily towards a reckoning

What is our (data science, machine learning, UX, design) equivalent of solarpunk for the concepts of automation?

5/

Jeremy Kahn
@trochee@dair-community.social

So I see two poles for how to respond to "Peak Gasoline" in SFF

[bear with me while I digress; coming back to LLMs in a sec]

and they're basically

doomer hoarding and xenophobia (everyone for himself, and f your feelings) β€” think MAD MAX

vs

Solarpunk invention of new ways of living that... just don't use gasoline (everyone's in this together, so we'd better have a community garden, build transit, and learn first aid) β€” think THE TERRAFORMERS (thanks
@annaleen@wandering.shop !)

3/

Jeremy Kahn
@trochee@dair-community.social

So, back to LLMs, or rather, back to prepping for "Peak AI"

(It's coming, let me tell you.)

Those of us currently under attack/usurpation by the push towards AI, we can respond to this by prepping toward either pole

The doom-prepper approach is to, I dunno, start planning a consultancy on "unbefunging your company's poorly-thought-out dependency on chatgpt", or building tools to poison (or detect poisoning) for the LLMs

4/

Jeremy Kahn
@trochee@dair-community.social

But there isn't really a winning move if you're one of the people getting hollowed out β€” for us, the game is survival until the grift collapses

So I'm thinking about what it looks like to prepare for the Collapse, and I've been making an analogy to depending on gasoline for your entire culture

(I mean, we
do, and β€” after "racism", "gasoline politics" is the second good answer for "why are Americans like that")

2/

Jeremy Kahn
@trochee@dair-community.social

So I see two poles for how to respond to "Peak Gasoline" in SFF

[bear with me while I digress; coming back to LLMs in a sec]

and they're basically

doomer hoarding and xenophobia (everyone for himself, and f your feelings) β€” think MAD MAX

vs

Solarpunk invention of new ways of living that... just don't use gasoline (everyone's in this together, so we'd better have a community garden, build transit, and learn first aid) β€” think THE TERRAFORMERS (thanks
@annaleen@wandering.shop !)

3/

Jeremy Kahn
@trochee@dair-community.social

The boom in LLMs is going to hollow out a number of knowledge-worker industries β€” for example, writing boilerplate code or technical documentation

Not because it does it well but because the flacks can sell upper management on the idea that it can do it at all, as
@pluralistic@mamot.fr recently pointed out

This sale is a pig-in-a-poke, and the winning move is to not be holding the bag when the actual code or documentation is found to be terrible

1/

Jeremy Kahn
@trochee@dair-community.social

But there isn't really a winning move if you're one of the people getting hollowed out β€” for us, the game is survival until the grift collapses

So I'm thinking about what it looks like to prepare for the Collapse, and I've been making an analogy to depending on gasoline for your entire culture

(I mean, we
do, and β€” after "racism", "gasoline politics" is the second good answer for "why are Americans like that")

2/