Gary Marcus on ChatGPT
Gary Marcus on ChatGPT
When in doubt, ask an expert
In my last mailbag, I was asked for my thoughts in ChatGPT. I am not an expert in that area so hearing my thoughts on it would be kind of like listening to some random person next to you at a bar pontificate. So I invited someone who is an actual expert to give his thoughts: Gary Marcus. I hang on every word he says about AI. Enjoy the answer below!
ChatGPT is the fastest growing consumer product in history, and it’s brought Google to its knees. Type anything you like, and you get a cogent, or at least cogent-sounding answer. Some people see it as tantamount to the holy grail of “AGI” (artificial general intelligence). I don’t. Instead, I see it as a triumph of big data, but a long way from intelligence that we can trust.
The thing about ChatGPT (and its siblings like GPT3) is that it lies, prolifically. Well, technically speaking it doesn’t lie, because it has no intentions, and lying implies an intention to mislead. But it does say an awful lot of things that are untrue, and mixes them together with things that are true, and out comes an authoritative-sounding mixture of the two that nobody should really trust.
If you look at ChatGPT’s mathematics, and you are a mathematician, you will be unimpressed. If you look at its history, and you are historian, you will be unimpressed. If you have it write your own biography, you will be unimpressed; some things will be true, some will be false, and most people who look won’t be able to tell the difference.
Still, there are definitely going to be some use cases; this is not like driverless cars, in which $100 billion dollars have been invested, and we are still very much at the prototype stage, with demos, but nothing like the promised product (point to point driving, without human intervention, wherever you want to go) even close to delivery. Large Language Models (the core tech in ChatGPT) are already being used to help computer programmers (who know how to debug errors when they see them), and to cheat on term papers. They are also already be used to make dubious blogs to promote websites, and to semi-automate dull tasks like writing letters of recommendation. The prose is banal, but when boilerplate is all you need, it can be adequate. People are going to try to use ChatGPT as a search engine. The accuracy issues loom large, and have not yet been solved. For now, the novelty factor is high. How it ends up is still open. You can find my best guess is here:
How much net positive impact they have on society overall remains to be seen; there are also causes for concern. Chatbots like ChatGPT are clearly disruptive to the educational system, they may be used to give medical advice (even though they don’t really understand medicine and are likely to make errors, sometimes serious ones), and they will be used by bad actors to create misinformation at a scale we have never seen before. Personally, I am worried. ( https://www.scientificamerican.com/article/ai-platforms-like-chatgpt-are-easy-to-use-but-also-potentially-dangerous/)
I would say right now that AI is a bit like a teenager, starting to feel its power, but not really entirely possessed of good judgement. Things are going to get wild, and nobody can really project exactly how. Real AGI, AI that we can trust, will be even more amazing, but already this is a kind of dress rehearsal for the future; a teachable moment as we try to come to grips with the many ways in which our world may start to change.
Gary Marcus (@garymarcus), scientist, bestselling author, and entrepreneur, is a skeptic about current AI but genuinely wants to see the best AI possible for the world—and still holds a tiny bit of optimism. Sign up to his Substack (free!), and listen to him on Ezra Klein. His most recent book, co-authored with Ernest Davis, Rebooting AI, is one of Forbes’s 7 Must Read Books in AI.
You can subscribe to his Substack at:
 | A guest post by
|
I think ChatGPT in itself is a weak tool for all the reasons Marcus provides. But, the ways that it and other MLLs have already been integrated into new use cases is staggering. Whether using them to code whole new websites, short-cut the tedious working of designing websites, or coding simple apps or coding run-of-the-mill functionality— that’s all stuff that has emerged in less than 3 months! The sheer velocity is staggering.
For myself, various MLL search and citation tools have made much of my work markedly more efficient. For example, using a tool like perplexity.ai (whose same function will also be accessible through the new Bing platform) makes research for my own writing more efficient. Since the platform provides citations for all of its claims, they are subject to scrutiny.
Another similar tool that can generate responses to scientific questions (consensus.app) can provide primary sources in response to questions that would yield little in a Google Scholar search. For example, asking “Can rapamycin slow dementia or Alzheimer’s progression”, the tool responds with a sort of summary of its interpretation of the research —but, again, it also provides all of its source material with links to originals.
My point is this. ChatGPT is indeed a nascent version of MLL interfaces. But the potential for these models and their myriad applications is massive. Although I have been working in and around “disruptive” technology for over 15 years, I haven’t been this excited about AI or technology in general for a very long time. Autonomous vehicles seem to me much farther off as real, usable tools (and much less exciting) than MLL ‘s opening of whole new areas of work, inquiry, creativity and innovation.
Very interesting and insightful post by Gary. While I agree that ChatGPT 3 is error-prone, carries misinformation, does not offer source, it is worth remembering Clayton Christenson's Disruptive Innovation Model- While the incumbents are busy serving high quality products to their more demanding and profitable customer base, they tend to ignore the needs of others. With ChatGPTs ability to provide a cogent response (error-prone) , the customer base might tend to prioritize convenience(effortless) over effortful selection within links offered by the incumbent. In any case, arrival of ChatGPT is a watershed moment..