i'm here at Harvard in the office of Steven Pinker and he's written nine books and devoted his life to studying language and cognition and writing and so what we did in this interview is we started off with the really practical stuff we started off with his rules for writing and what makes him unique is that he's been thinking about AI since the 1980s so if you're interested in doing great non-fiction writing in the age of LLMs well this interview is for you [Music] i want to talk about the curse of knowledge and I want to talk about this this cartoon from your book which says good start needs more gibberish yes when I uh pose the question why is there so much bad writing why why is there so much academies and bureaucrates and corporates people's favorite answer is captured by that cartoon namely that bad writing is a deliberate choice that it's uh in various versions it's uh academics with nothing to say dress up banal ideas with gobbledygook to show how sophisticated they are or uh pastyfaced nerds get revenge on the girls who turned them down for dates in high school mhm uh people want to uh uh erect a kind of uh cult that no one else outsiders can't penetrate because they haven't learned the the uh the jargon i don't think that's the best explanation for bad writing uh partly it's personal i just know enough people who have plenty to say they're brilliant people they uh have no desire to offiscate they're just uh incompetent they just uh don't know how to express themselves clearly there's something called Hanland's razor never attribute to malice that which can uh adequately be explained by stupidity and uh that these are not stupid people I'm talking about but it's a kind of stupidity in not knowing um where your audience is coming from and I illustrate it with an anecdote uh of a conference in technology entertainment and design better known by its acronym TED where a brilliant molecular biologist had been invited to present his uh latest findings he launched into uh what was obvious to me is the exact kind of talk that he would give to his peers in molecular biology and that uh within about 4 seconds he had lost everyone because he just spoke in jargon without even introducing what problem he was solving why it was significant it was you know launched right into the the experiments there was a room of several hundred people from many walks of life from you know to entertainment from design and it was obvious to everyone in the room that no one was understanding a word obvious to everyone except the distinguished biologist who was just clueless now this is you know not a stupid man but he was very stupid when it came to communication namely not everyone knows what you know now the curse of knowledge term from economics is um the difficulty that we all have in knowing what it's like not to know something that we know that is to subtract something from your brain put yourself in the shoes of your your audience your whether it be public speaking or in writing figure out where are they coming from what do they know what don't they know i think that's the main cause of bad writing but you get um abbreviations and acronyms that no one has any way of knowing you have jargon that is known only to a tiny little clique you have um abstractions the level of the stimulus was uh proportional to the intensity of the reaction and what it really means is that uh you people kids look longer at a bunny than a a truck uh so that is it it's so familiar to you that you don't think it's worth explaining to people concretely what they're supposed to be seeing right so all of these are manifestations of the curse of knowledge goes by other names egoentrism absence of a theory of mind that is a theory of what's going on in other people's minds and I if I had to identify the the single biggest flaw in writing and communication it would be that that's it so when you're writing your books I know you go up to Cape K you write for like you know as long as you possibly can now I would assume that one way to get around the curse of knowledge is just to talk to the kinds of people who would be reading your book yeah you show it to people so what do you do what do you do cuz you you know you write really intensely so when you're writing how do you get around that well I do something that is I know is not good enough but I do it as as best I can which is I try to imagine what it's like for someone not to know what I know that is I I try to cultivate my sense of empathy but the problem with the curse of knowledge is you don't know when you're subject to the curse of knowledge because something that seems so obvious to you that you don't even question whether other people know it turns out not to be obvious so anyway I try uh but at the end of the day I show it to people uh when my mother was alive I would always show her a uh a draft of my book not for the reason that most academics site with namely referring to my mother as the epitome of a you know unsophisticated you know not very well read not very bright person my mother was uh extremely intelligent extremely well read very sophisticated but she wasn't a cognitive psychologist she wasn't a psycho linguist she didn't know what I knew and you know when I write I don't write for just a random sample of the population they don't they don't buy my books um I I I write for people who are intellectually curious who have some degree of education however not for peers in my field uh and so my mother being an example but also of course when you publish for a commercial publisher you have an editor and the editor is typically you know very smart but again not in your field and I show it to people in different fields who are academics but it's surprising how uh insular even academics are when it comes to other academics sometimes there'll be people here in this building in my own department sometimes my own subdivision within my own department like students and they'll give me their thesis proposal and I just don't know what they're talking about sometimes in my own field because they've been immersed in like five or six people in their lab their supervisor and the other grad students and a couple of posttos and a research assistant and they've all been consuming the same jargon that as soon as they step outside that tiny little circle they're unintelligible yeah so even showing it to if I'm showing it to a friend who's you know an economist or a historian or a political scientist or an evolutionary biologist not being a cognitive psychologist they'll say "I'm sorry but I don't just don't know what you're talking about." Yeah in terms of your writing you've done so much work looking at vision and how the brain works and it seems like a lot of your writing advice is informed by that like I guess if I were to try to summarize it it's like a lot of our brain and basically the ma way that we move through the world is indexed heavily on vision and so writing well means being concrete and helping people see what it is that you're trying to write is that a good way of describing it yes and that would be my the probably the second bit of second advice on the list the first one being find some way of getting into get into your reader's heads but don't just depend on your ability to get in their heads actually get a flesh and blood person to actually read it and see if it makes any sense to them so that'd be number one number two is you know I study language and you know as a writer I live in language but language is kind of overrated in the sense that what understanding consists of is not a bunch of words it's not blah blah blah blah blah blah blah but language is a means to an end of getting people to appreciate what you're the ideas you're trying to convey which are not just a string of verbiage and those ideas very often are visual you know and and motoric that is you know bodily emotional auditory but they're they're sensory um or they're even conceptual but they aren't just a bunch of vowels and consonants right and so constantly allowing your reader to be able to form a mental image uh based on what you're writing is the next key to to to to good writing that is don't talk about a uh a stimulus if you mean a uh a bunny rabbit right uh don't talk about a a level or a perspective or a framework or a paradigm or a concept all of which mean a lot to you in your day-to-day work but no one can form an image of a paradigm in their mind's eye so how do you do that like one thing you've said is use for example all the time uh what else can we do um so often you know visual metaphors uh are are helpful one of the reasons that often the the pros of other eras strikes us as so much more vivid is I was going to say lush lush yes partly because they had the advantage of of uh writing before there were you know several hundred years of academia and intellectuals inventing terms and abstractions and they had to appeal to uh images that were part of people's common knowledge so instead of saying something like aggression um or antisocial behavior they might say the spirit of the of the hawk needed into our flesh yes uh you know we wouldn't write like that because we can say you know aggression or antisocial behavior but uh and that's jargon that a lot of people are familiar with but they weren't always with us and before that there had to be some way of referring to it in terms of an image that everyone shared and I think that's why often the writing of previous centuries just strikes us as so much more more gripping so much more evocative and powerful that they had to appeal to visual metaphors yeah i've never thought about that before because a lot of the Bible's like that i think of like I don't know why the owl of Manurva came to mind like there's just all of this symbolism in in in animals it always is uh is striking and so what you're saying is like a lot of the concepts that academics and and and people brought in obviously they're kind of a more efficient way to communicate but they do lack that kind of visual quality that makes writing vivid that's right so they they do make it in fact they're essential for doing the work within the profession um you have to be able you know if you're a biologist you have to be able to you know talk about things like ecosystems and species and and systems and reagents and uh potentiation all these concepts that you don't want to have to go back to basics and talk about well there's a certain amount of chemicals and we call that a concentration and when it increases over time we call it you know you're beyond that after you're a freshman and so you have more and more abstract terms that you could refer to enormous bodies of knowledge just with like two syllables that's very good right the problem is that then now when it's time to convey them to someone who isn't at the pinnacle of of specialization in your field because of the curse of knowledge you're apt to forget that these abstractions which are kind of basic to you are just don't even need to be defined aren't basic to anyone else hm what do we need to know about writers about how hard writing is and I mean it in this way speaking comes so naturally to us but then writing is something that we sort of have to learn right you watch a kid and you talk to a parent who has a 20-month-old they're like yeah you know they're speaking now they're like oh you know you wouldn't believe it you know they're talking so much they're crawling around and it's always like yeah it's like that and then you talk to them who have a parents who have a 8-year-old kid it's like how's the writing going it's like well you know it's going little slow there's not that same excitement and so it's as if like why is it that writing is so unnatural in a way that speaking is so natural like what is going on there scientifically and then practically a number of things one of them is that in um in conversation um you don't never have two people that are kind of parachuted on a stage and immediately have to begin a conversation they have some common ground to begin with mhm they know why they're there they they're talking about something that is in the air that they're both familiar with it was the reason for them having the conversation in in the first place uh they can get away with using terms that in context are perfectly clear like this and that and the thing and what I was talking about and uh she uh whereas if you are not privy to that little social circle you may not know who they're referring to m um in writing you're wrenched from the context uh someone's picking a book up off the shelf and you know they've never met you and they may be living in a different country you might be dead uh they've got to pick up all of this detail from what's there on the page not what's in not the the common ground that the two people bring to the conversation right also you know the when you're speaking you know that you're speaking to someone you know their idiosyncrasies you're a little bit better at uh avoiding the curse of knowledge partly because you get feedback like the furrowed brow the quizzical expression the uh the what the the request for clarification I'm sorry I just don't know what you're talking about uh in real time and you know in the body language the engagement uh even in in a live audience uh any speaker knows when people are starting to fidget and and and and drift off as opposed to continuing to be riveted none of that is available in uh in writing absolutely how about this one i think generalizations without examples and examples without generalizations are both useless yes well and useless might be a bit strong but yeah generalizations without examples I find even in my field nine out of 10 times I just don't know what they're talking about it's like what do you like like give me an example uh just it's too because a generalization erases detail um it it uh sweeps over particulars you often just can't really know what it's referring to and and and the abstract words in a language just aren't precise enough they often have we have probably a hundred concepts for every word in the English language and so a particular word uh especially if it's abstract won't call to mind a particular reference the example pins it down to what's the what's the the general ballpark that you're talking about what is it what is theam the generalization generalization about now examples about generalizations it's well why did you just tell me that like you know and your point is uh and appropo of what one of my favorite ways to think about this is that there's always a trade-off between context and compression so if I could wax poetic for the next 5 hours about my train ride to Boston but that's way too long or I could tell you yeah it was an easy train ride but then you didn't actually get anything from that cuz there's no context there and that maybe we're always kind of balancing the examples kind of give us that context and then the generalizations are the compression and it's actually in like the swing in the dance of the two of those that good writing and good communication happens yeah so for example if I were to say that familiar words don't have to refer to the literal meaning of their their parts you can understand that and you kind of say well yeah yeah okay and then I say well for example um a bathroom isn't necessarily a room with a bath and going to the bathroom doesn't necessarily mean going to a room that has a bath breakfast isn't necessarily breaking a fast and Christmas isn't necessarily doesn't necessarily refer to Christ's mass um now having said that I think you now understand what I mean when I said say that the meaning of a familiar phrase doesn't necessarily correspond to the meanings of its parts hopefully that now makes some sense to you now that I've given you the examples without the examples you know you could nod and say "Oh that sounds plausible." But you really wouldn't have understood it let's roll with that if adults commit adultery do infants commit infantry if olive oil is made from olives what do they make baby oil from if a vegetarian eats vegetables what does a humanitarian consume a writer is someone who writes "And a stinger is something that stings but fingers don't fing grossers don't gross hammers don't ham humdingers don't humding ushers don't ush and habarddashers don't habdash what's going on there why'd you pull this out so this is a quote from Richard Letterer i deserve no credit for that that witism and and I love this i think it's so good letterer has written a number of delightful books like Crazy English and Anguished English um he's a a has a marvelous ear and a a fabulous collector of quirks and errors and oddities and blunders in in the English language uh so that that whimsical list is quite profound because it indicates a lot of truths about language such as that uh over time compositions of of words compounds or words with a prefix and suffix can sometimes drift away from the uh original meaning the case of adultery uh for example it is related to adulterate namely to commit adultery is to you know introduce a foreign substance namely you know semen into a uh the the a woman where it it doesn't belong uh but that whole connection has been completely lost also in many kinds of compounds there are uh a number of different semantic relationships that can hold so for example uh olive oil is oil made out of olives baby oil is oil for babies so there isn't a logical a single logical relationship between the different parts of the the compound language is so uh ancient english itself is um depending on on how you count maybe you know 1500 years old or or more but it came from Germanic which came from Indo-Uropean and who knows where that came from that a lot of words uh can uh completely uh obscure their uh origin you have to go to a dictionary to find them out but they're kind of like fossils of processes in the language that are long long dead you know where how the er got into finger i I would have to look up the etmology to to tell you but it's not the same as say singer which comes from the rule that er uh turns a verb into a noun for the kind of person that typically engages in that activity that's a rule that's still alive and well in the English language whereas we have the fossil record of lots of rules that died long ago when you're writing like if I were to basically map out almost like a gradient of our conversation I'd say like curse of knowledge I would almost I'm being very haphazard here i'd say like equal parts left brain right and then we sort of moved into kind of a leftrain side of the conversation and then I think of what you've said about language should be a source of pleasure like I think of that in beauty right you talk a lot about beauty also in your photography you're very interested in that that to me is more rightrain so like when you're writing when you're actually sitting down at the keyboard what are some of the more rightrained maybe less verbal concepts that drive your writing well certainly visual imagery that is can I form an image can my reader form an image um euphan that is sound you know that that is uh is there some poetry in the pros uh and I uh read aloud or at least mumble or at least mumble to myself my pros something that's again a highly recommended writing tip i didn't invent it often when you read a draft of your own pros and if you can't articulate it smoothly that you probably your reader won't be mentally sounding it out smoothly either right um the aesthetics sometimes come from even things like um uh paying attention to the uh metrical structure of language that is the rhythm oh tell me about that there is a a regular rhythm to to language and that uh it's not perfectly you know tick- tock tick- tock like a metronome but there are beats and if you disrupt it too much then it it does interfere with speech but it also interferes with reading even though it's just characters on a page uh even the aesthetics of uh sibilent sounds generally too many chosen uh make it make pros a little unpleasant and I will often um pick a synonym that avoids the sibilent uh at least too many siblance in in a row um I'll often go with um alliteration just because it again there's a little a little spark of pleasure sense of style sense of style yep even when it isn't you you don't want to make it too conspicuous otherwise it starts to feel forced but often a bit of alliteration can just make the sentence roll past more easily why do you think that you as much as anybody have been the person to kind of stomp your feet kick and scream about the how bad academic writing has been over the years like when I think of who has been like "Guys what are what are we doing?" You sort of been in one of the for the front runners what about it i mean besides the obvious what about it has just bothered you so so vividly yeah part of it is um just the sheer waste that is there's an awful lot of really brilliant work a lot of really smart people you know in in academia and you know why are they doing it just to u you know entertain each other and you know closed little circle I mean taxpayers pay for it uh it should be accessible they should give it away they should state it in a form that that it's accessible there's also when even within the profession uh there's just an enormous amount of wasted effort and potential for misunderstanding in bad pros it's like if I'm reading if I have to read something it's a student paper or it's a paper in my own field or I'm reviewing a grant proposal or peer-reviewing a manuscript or evaluating for someone for tenure if I have to read the same paragraph like five or six times in order to know what they're talking about for one thing I might get it wrong then what you know what's the point another is why should I have to read it five or six times i'd rather be doing something else and uh so there there's waste there's confusion uh there's also foregone opportunity for pleasure and and beauty it's enjoyable to to read um something that's wellcrafted and it's annoying to read something that's stilted and turgid and and bloated um there many reasons and it does it it does get under my skin when academics devote so much brain power into the scholarship and then just blow off the essential task of letting the world know what you've done yeah it's a true virus in the modern world yeah uh you know I take a particular interest in it not just because I do try very hard even in my academic writing to be clear but since I'm someone who actually not just studies stuff as an academic but studies language um I get particularly annoyed at people in the field of linguistics and psycho linguistics because so many of them are such bad writers it's like you study language if what you're studying is what makes a sentence difficult to understand why don't to pay attention to your own research and make your sentences less hard to understand yeah what is it that you love so much about children's explanations things like clouds are water vapor smoke is fire vapor oh yes uh you do see things uh Yes that was from from my u my grandson uh I mean it is it's it's poetry it's a a new juxosition there's such a freshness to children's explanations yeah yeah because they aren't writing in in cliches and partly because they haven't uh accumulated this mass of abstractions like the writers of a few centuries ago who had to grasp for some common image uh children without the uh decades of of of uh of acquired jargon from academia have to appeal to something that they can see and that other people can see yeah there's a there's a guy who I follow on Twitter who I've really come to like and in his bio it says listen to children they haven't forgotten how to see and um I know a YouTuber and one of the ways that she comes up with her ideas is she has conversations with her friend's kids who just ask these crazy questions like how deep is the ocean how how high would a tower need to be in order for us to get to heaven and then like I have another friend who when he was a kid he thought that clouds were produced by those little smoke things uh sort of like chimneys so he thought that those were like cloud creators and there's such a freshness to just how children see and how they talk about things and like you said they're they're they can't possibly think inside the box because they don't even know the box exists yes right and there were there there there are have been in history various features to remind people of the the the originality and the freshness of of kids there was a regular feature from my childhood called Kids Say the Darnest Things from a television host named Art Art Link Letter long I've heard of him oh you have okay yeah in fact what has survived him and the uh and the feature of the the program is the say the darnest things or even the verb the darnest nouns which you'll often see in uh adopted in headlines and in it's become itself a kind of a formula but he originated it johnny Carson the longtime host of the Tonight Show yeah uh would sometimes have features where they he he'd read um answers kids answers to questions to to to much hilarity how does humor factor into all this into writing yeah exactly like and even maybe even the science of humor like words that are funnier because you have that great talk from like 10 years ago where you I'm going to recommend it yeah well there's I guess like everything there's an art to it because you don't want to when it's strained you get groans instead of laughter so it has to be appropriate um it it can't just be something that has been repeated so often that people have heard heard it 37 times before right and humor specifically depends on freshness yeah it it does and it also depends humor does have um much in common with good writing there's the line from uh Hamlet which uh brevity is the soul of wit now uh it's a great saying for a number of reasons one of them is even the term soul as opposed to is essential for wit or is important for wit or even the essence of wit um those are ways that we would say it now but the soul of wit you have to think for a minute soul being the the deepest deepest essence but it's a mono syllable and it has so much of resonance that you know I guess that that that Shakespeare really was a good writer wasn't he yeah I've heard of that guy yeah um but it's also it is uh it is true and it's a good example of itself because it is so brief m uh it was reiterated centuries later in the famous style manual the elements of style by uh white where um professor uh in lectures at Cornell that EB White uh recalled and then turned into a book uh would say that the first rule of writing is omit needless words now again it's a beautiful example of itself because there are no needless words in it and he said that sometimes professor would be so adamant and um uh so insistent that this was the almost the only thing you needed to know about writing that he would just not know what to do except repeat it and you'd say omit needless words omit needless words omit needless words uh and you know as with you brevity is the soul of wit aside from being an example of itself it is so true that sometimes uh when I have to uh compress an article to fit into some fixed space especially if I'm writing for a newspaper or magazine and say you know unlike academia where you can u blather on uh with no one telling you to shut up when you have to write for a paper they'll say "Sorry 800 words." And if it's you know 800 83 words the editor will chop off three words and you don't get to say what they are and I can often mangle the meaning so you have to actually learn how to say something in 800 words or however many words it is but what I find is often just the exercise of squeezing it into that uh that maximum limit just improves the pros as if by magic it's like oh you know damn I have to like make this shorter and I thought I had said it perfectly then often when you do it you find you know it really has improved in quality having gotten rid of those needless words you know partly it's because of mental effort namely every every syllable every word is more cognitive processing by your reader if you can get the same message in uh quicker that's often le less work uh but it also makes it uh aesthetically more pleasing you have to work within the constraints of the English language the the uh the melody the the rhythm the music of the language it forces you into often into concrete language instead of woolly idioms and and and uh cliches brevity as a solo is good it kind of just hit me how good of a line that is i've heard that a thousand times but it never it never punched me in the chest like it just did i got to ask i mean sorry the reason I brought it up is Oh yeah in humor and it's a soul of wit i mean wit used to mean a lot more than just you know haha uh you know it meant uh you know trenchness and appropriateness u but wit in the sense of just raw humor that's something that comedians know you pair down the jokes you pair down the lines when you're using humor the shorter the pathier the funnier uh if you drag it out then you know it ain't funny you can step on your own punch line you can uh telegraph telegraph the uh the punchline so I went to uh Rockefeller Center the other day and there's this called like a big thing of stone and John D rockefeller is talking about his theory of society and the good life and it was just remarkably well written remarkably well written and then it's the same thing with the Declaration of Independence there's just some beautiful lines in there right we hold these truths to be self-evident that all men are created equal it's just beautiful writing and what do you make of how older writing it seems like when people think about it it's like harder to read thank God that writing's gotten so much clearer and easier to read but at the same time it does feel like a kind of beauty and poetry a kind of reverence that I have for language itself has been stripped away from the English language at times you do sometimes feel that even again Rockefeller is a good example because he did not go down in history as a pro stylist yeah no exactly thank you thank you that was a very important part of that point this was the CEO he was a oil magnet yeah right and likewise I have a quote from Thomas Edison in Enlightenment Now on how the electricity will liberate women right and it's just beautifully written beautifully written uh and and this is a guy who spent you know hours with you know filaments and life light bulbs uh and and and uh but and he could but he could write like an angel uh Herbert Spencer uh Oliver Wendel Holmes senior that's a great example u you Charles Darwin uh all these people who were not themselves uh um professional writers they had something else but they were very good at it so it's an interesting question i think one reason is they were trained themselves on the classics on on um great works of of literature probably because for many of them there wasn't um the telephone radio uh let alone texting social media um the way that you presented yourself was through your pros and so you cultivated it the same way you you know kind of arranged yourself in a mirror this is other people how other people viewed you but you had this stock because also that they were educated on the the classics they had many good examples to draw on but then the the third reason is one that came up earlier in our conversation namely since they didn't have the benefit of decades and decades of abstractions and cliches and they were kind of exploring virgin territory conveying new ideas and and they didn't couldn't easily reach for uh a canned cliche they had to put new ideas into forms that their readers or listeners could understand and that forced them to draw on visual images and metaphors and and um viv vivid expressions and locationions and that is that there's been a um a process that's been going on for longer than a century called informalization where uh you can see it in dress where you know men no longer wear hats and women don't wear gloves and Sometimes you look at a picture of someone on a hike from a century ago and you know the men are wearing ties and the women are wearing long dresses and you know they're going they're going hiking this would be inconceivable to us um the fact that people used to address each other with you know with you know Mr and and and and Mrs and we're all on a firstname basis um I got in trouble in the third grade for calling my teacher I went to detention for calling my teacher by her first name and that would not happen now that was I that that's certainly familiar to me from my childhood it would be unthinkable i wouldn't have got gotten that attention i actually it's been like 20 years and I still feel the shame that I felt in that moment it's crazy it just wouldn't have occurred to us it was just you couldn't have done that a million years the the fact that um taboo language uh profanities are commonly woven into speech which again would have been you know unthinkable a century ago but there is this a process of greater familiarity of less hierarchy partly as a byproduct of democratization the the erosion of traditional hierarchies of class and uh education um there's a kind of romantic um ethos where authenticity spontaneity are valued as opposed to putting on airs uh thinking carefully before you do anything uh all of these have led to fancy language being seen as more pompous stilted uh distancing whereas the cultural value has changed toward spontaneity intimacy naturalists authenticity so I think many of us in having if we had to put the effort into crafting pros the way they may have a century or two centuries ago we'd feel oh people are thinking I'm being too fancy and they might you might even perceive you as being too fancy right uh and and as a result the conversational vernacular has uh as opposed to the elevated the well the well-crafted uh has come to to characterize modern pros so I got to ask you were talking about being able to pull a cliche or an abstraction ai takes that completely to the next level and do you feel like AI then enhances our almost inability to think originally for lack of a better word like does it keep the trend that we're seeing or are LLMs like a new form and then maybe actually create some new way of communicating altogether yeah uh the the output of LLM is is peculiar in one sense it's well written in the sense that it tends not to be in academies in jargon in the sentence structure tends to be pretty um plain and sound uh the even the progression of ideas tends to be orderly there tends to be an introductory sentence and concluding sentence um so in that sense it's good writing it's bad in the sense that it is so generic and prosaic and you can almost recognize the output of a large language model it's so so benile mhm uh now perhaps it could be trained and perhaps if you prompted it you know don't don't be prosaic don't be uh plain uh uh it'll be interesting to see whether we come up with of uh with any kind of style or or freshness but it's not the way it's designed it's designed as a mashup as a pastiche of you know literally you know billions of of examples out there and it's an interesting question why it should be so uh at least why its pro style should be sound i mean I think that's the best you could say about it whereas the pro style of most you know academics you know most lawyers most bureaucrats is not sound why is it better one possibility is it's just been hammered into shape through the fine-tuning and the the feedback that is instead of just regurgitating uh an amalgam of right the reinforcement learning the reinforcement learning and the uh the stuff they don't really talk about much but that might be essential that is they're real human beings who force it to uh into a you know a five paragraph essay right the other is that uh and this is completely speculative but we know in visual beauty often a composite is more attractive than the uh elements that went into the composite so that if you take a bunch of faces and you morph them together the um non-existent human being that comes out of the morphing is more handsome or prettier than all of the men's faces and women's faces that went into it really take a high school yearbook and you mash together the several hundred faces and the the result is is is pretty attractive is that right wow now whether that can be true of pros style that is that if you were to eliminate all of the um god-awful convoluted constructions and just came up with a kind of the generic sentence structure it wouldn't be beautiful but it would be clear that's a hypothesis you've written nine books you're working on your 10th now with LLMs and the way they're going if you were to almost rewrite those books starting now how would you have written those books differently i mean knowing what we know about um Yeah knowing what we know about LLM and also your sense of where the world is going and how it's changing how the world of writing is changing would you have written the same books um probably not i think they I think I'd have to give greater um weight to the power of abstracting uh patterns from massive amounts of uh input which in the um uh the the the approach that I uh was kind of trained in and that I then developed of you know computational cognitive science Chsky linguistics uh classic AI was much more organized around um rules algorithms logic kind of logical programming it was hard to imagine how with enough just sheer input and training a neural an associative neural network could extract um uh sensible ideas and uh pros out of this huge unstructured mass of input mhm now I don't think that shows that the human mind is a large language model because it would be the equivalent of a child listening to language for you know 30,000 years before they could put put their first sentence clearly uh and also kids don't just need to have massive amounts of text pour into them they also are in a situated in a world where they can figure out what the people talking to them are trying to say uh and they're interacting with a world and that's a very different style of learning than just processing massive amounts of text but still I think I would I I certainly would have had to reconcile the intelligence of large language models with human intelligence with more attention to the power of pattern extraction from large input uh corpora than I than I did well thanks very much for doing this thank you it's been a pleasure