"I Want to Shatter Your Unrealistic Fantasies About AI and Rebuild a Proper Understanding" | A Conversation with Leding Li, Baidu Principal Architect in the Trenches

"I Want to Shatter Your Unrealistic Fantasies About AI and Rebuild a Proper Understanding" | A Conversation with Leding Li, Baidu Principal Architect in the Trenches

July 14, 2024

This is the most substantive episode of "Crossing" ever!

In this episode, guest Leding Li gives a thorough yet accessible introduction to generative AI, breaks down AI entrepreneurship directions, discusses the AI strategies of Silicon Valley giants, and comprehensively covers hot industry topics including Professor Yann LeCun, world models, and AI search. This is the 20th episode of "Crossing," and in my view, the most valuable one yet — full of common sense, fresh insights, and abundant inspiration.

——

Today's guest, Leding Li, is a treasured friend I've known for over ten years. We've road-tripped to Inner Mongolia together, eaten our way through Beijing's Japanese restaurants, chatted about everything under the sun, and witnessed each other's growth.

Mr. Li joined Baidu in 2010 as a Principal Architect, consistently taking on the most challenging assignments.

Today, there's broad consensus in the tech industry that generative AI will become the most important and largest-scale technology infrastructure of the future. Before generative AI, the two most important and largest-scale technology infrastructure buildouts in tech history were search and cloud services. In Mr. Li's 12-year career at Baidu, he spent the first six years as a search architect and the latter six as a cloud services architect. Architects who have experienced both of these massive infrastructure buildouts are rare indeed, globally speaking.

To be qualified for large-scale infrastructure architecture requires not only deep technical understanding but also intimate knowledge of every role and component in the system, in order to formulate systemic strategies and complete architectural design.

In today's AI field, opinions abound and many voices are strident. Notably, however, those speaking out most actively are mostly industry observers — particularly media professionals and investors. This is precisely why "Crossing" invited Mr. Li to share his perspective on generative AI's past, present, and future:

Only those in the trenches can hear the sound of gunfire; and only commanders and architects who have experienced battles of comparable scale can understand the deeper meaning within that gunfire.

——

🎈 Special thanks to Beijing Keyone Studio for providing the recording space.

——

🎬 Timeline:

Part 1 Shatter Those Unrealistic Fantasies About AI!

On AI: too many fantasies, too little rationality. Fantasies that aren't shattered are bubbles; shattered fantasies may become opportunities.

02:19 The layers of fantasy

04:42 Why so many fantasies?

05:55 How to shatter fantasies? Start by understanding how AI actually works

09:44 What harm comes from indulging in unrealistic fantasies?

10:50 On the AI bubble: it's inevitable and worth embracing; but also recognize that it really is a bubble

12:05 What has and hasn't changed in the 18 months since ChatGPT 3.0's release?

Part 2 Disrupt! Google

Mr. Li served as Chief Architect of Baidu's Open Platform (Aladdin), making him one of the most authoritative voices on AI search.

15:07 Will AI search disrupt Google?

16:45 What is Perplexity's value?

18:42 What is Google's Achilles' heel? This is where Perplexity's opportunity lies

19:47 In building RAG, whoever first understands that AI is the least important of the key elements may win.

Part 3 Take the Leap! AI Entrepreneurs

Understanding generative AI's technical principles and洞察ing user needs and scenario characteristics — what entrepreneurial choices emerge?

Wrong directions for AI entrepreneurship:

25:18 Direction 1: Using AI to plan travel itineraries; people's goals are often clarified through the process of searching and browsing materials

27:50 Direction 2: Using AI to fully manage ride-hailing, flight booking, and hotels

Scenarios suitable for AI entrepreneurship:

29:58 Characteristics: high margins + high fault tolerance

31:28 Low-hanging fruit: digital advertising, selling GPU cloud compute

33:01 Generative AI has made Douyin's recommendation algorithm even more powerful

37:01 Two bright spots seen in Chinese AI entrepreneurship projects

39:20 AI PaaS projects lacking distinctiveness

On Scaling Law:

40:49 The current state of affairs is the ceiling of Scaling Law; just because a car is a vehicle doesn't mean it will fly

41:57 Rapid progress we can expect from: model knowledge coverage, response speed

What highly certain developments will occur in the next 6-12 months?

43:04 Multimodality + mechanical control, sensors

44:25 On-device small models

44:55 AI is actually already everywhere

46:56 Advances in AI compilers will break Nvidia's monopoly

47:52 AI's integration with frontier scientific fields

Part 4 Defend! Silicon Valley Giants

The giants hold the highest form of industry moat: ecosystem; therefore their AI strategies are all defensive.

49:24 Meta: the entire AI industry owes Meta thanks

54:55 Microsoft: its rise to $3 trillion today is well-deserved

56:29 OpenAI has been boxed by Microsoft into the position of a model researcher

58:41 Predicting GPT-5

59:13 Apple: always experience-first, worthy of appreciation

01:01:31 Amazon: has presented an excellent three-layer AI system

01:03:39 Advice for Dify and LangChain: exceptionally impressive products, but if it were me, I'd advise them to sell to a major tech company as soon as possible

01:05:03 Tesla: FSD is directionally correct, but the road is long; Robotaxi isn't worth pricing in

Part 5

01:10:46 The AI strategies of domestic Chinese tech giants are all quite good — and that's not just being polite

01:12:16 Recommended AI information channels

01:20:19 If you could travel to the future, what answer would you most want to sneak a peek at?

01:22:30 What are the most worth-following issues over the next 6-12 months?

Part 6 YYDS! Professor Yann LeCun

The person on this planet with the deepest and most correct understanding of AI.

01:13:45 In the AI industry, what separates those who do well from those who do at the top level?

01:14:40 Who on this planet has the deepest and most correct understanding of AI?

01:14:54 Why are Yann LeCun's widely controversial views actually correct?

01:17:59 A primer: what is a "world model"?

——

🚦 Welcome to subscribe to "Crossing," where we follow the industry transformations and new entrepreneurial opportunities brought by the new wave of AI technology. "Crossing" is Steve Jobs' metaphor for Apple — standing at the intersection of technology and liberal arts, where great products are born. AI is transforming every industry; we seek out, interview, and bring together "active actors" of the AI era, exploring and embracing new changes and new possibilities alongside them.

👦🏻 Host Koji: Co-founder of The Fair and Tangdao, and someone actively diving into AI himself. [Koji's Jike profile], [A self-introduction from Koji]

👧🏻 Host Ronghui: Works at a tech VC, former Silicon Valley correspondent for Yicai. [Ronghui's Jike profile]

——

Welcome to join the Crossing membership community:

☀️ Daily AI Fresh News Brief

👫🏻 Encouraging everyone to date/make friends/find future collaborators

🦀 Add our assistant on WeChat to join: Rwkfbcianvd

——

💡 Inspiration posters

💡

💡

💡

——

🎄 This podcast is supported by The Fair's Sound Forest Podcast Project.