第 404 期·中文精讀

李·克羅寧:關於生命與宇宙演化的爭議性《自然》論文

Lee Cronin: Controversial Nature Paper on Evolution of Life and Universe

化學家李·克羅寧講述引發爭議的《自然》論文,討論生命起源、組裝理論與宇宙中生命誕生的可能。

官方音訊00:00 / --:--
中文精讀由 AI 基於原始訪談改寫,非官方翻譯,可能存在偏差或錯誤;表述以原音訊與官方文稿為準。說明

2023 年 10 月 4 日,一篇標題相當不客氣的論文登上了《自然》:《裝配理論解釋並量化選擇與演化》(Assembly Theory Explains and Quantifies Selection and Evolution)。作者是格拉斯哥大學的化學家李·克羅寧(Lee Cronin)和他的合作者莎拉·沃克(Sara Walker)。

論文上線一個月,推特上 230 萬次互動,下載量幾十萬次。同時,進化生物學家生氣了,物理學家不高興了,前生命化學家覺得化學不夠多,最後連神創論者都跳出來說這不夠神創。克羅寧自己的評價是:這就像有人跑到派對上,同時冒犯了在場所有人,連本來互相看不順眼的派系都團結起來一起罵他。

但讓這段對話值得細讀的地方,不在爭議本身。而在 Lex Fridman 一層層追問下去時,這個思路究竟想解決什麼問題,它的邊界在哪,以及為什麼一個化學家會一路推到「時間是宇宙的基本資源」「宇宙大到裝不下自己的未來」這種命題上去。

我最擔心的,是生命到處都是,但因為我們在那個組合空間裡搭起來的腳手架太特殊,我們反而變得空前孤獨。(李·克羅寧)

先給一個能聽懂的版本

Lex 開場就試圖用兩句話概括裝配理論,克羅寧的回答是「完全正確」,連說了兩遍。

這個概括是:任何物體,都可以透過找出構造它所需的最少步驟數來量化複雜度。同時,透過觀察這個物體存在多少個一模一樣的副本,可以判斷它是不是由某種類似演化的過程製造出來的。

兩個核心量:裝配指數(assembly index)和複製數(copy number)。

裝配指數的定義,克羅寧用了樂高打比方。你面前有一堆樂高塊,它們是這個體系裡的「原子」。你的任務是拼出目標結構,規則是儘量偷懶:能複用的中間結構一定要複用,因為你有短期記憶,記得住已經拼過的形狀。把這些中間形狀存起來,下一次呼叫只需要付一步的代價。

那麼「拼出這個目標結構所需的最少步數」,就是裝配指數。

化學裡這件事能做,是因為化學家可以真的把分子拆開。取 13 份同樣的分子,把化學鍵全剪斷,得到一堆原子,然後重新往上搭,一路找對稱性和可複用的片段,把路徑壓到最短。克羅寧反覆講的一點是,這個指標能夠被測量這件事,本身就先於理論給出了驗證。

我一直覺得「最小值」是神聖不可侵犯的,但我當時不知道為什麼,就是想有一天會明白。後來被一群數學家逼著,才把背後的物理原因講清楚。(李·克羅寧)

計算複雜度上,這不是個輕鬆的問題。分子越大,找最短路徑越難,有些天然產物分子已經很難算。但壞訊息之外有捷徑:可以不計算,直接用物理手段測量。用紅外光譜看分子在指紋區吸收了多少個離散的譜帶,用核磁共振看分子裡有多少種不同的磁環境,再用質譜看碎片數量。三種方法獨立測下來,給出的裝配指數彼此吻合。

這一點很關鍵。它說明這個指標有物理實體:儀器能直接把它讀出來。

四個宇宙,以及「工廠」到底在哪

裝配理論裡有一套分層:裝配宇宙(assembly universe)、裝配可能(assembly possible)、裝配偶然(assembly contingent)、裝配觀測(assembly observed)。

橫軸是時間,縱軸是裝配步數。

裝配宇宙是純組合爆炸,什麼都允許,物理定律不存在,物體可以穿山、可以超光速。裝配可能是把物理定律加進來,化學鍵可以形成,但所有結構仍然可以零成本瞬時取用,所以理論上什麼都能造出來。

真正的轉折在第三層。裝配偶然說的是:你沒法瞬時就拿到未來那個高度裝配的物體,除非你在過去已經在這條因果鏈上把活幹完了。

這句話是整篇論文的支點。它把「複雜度」從一個靜態的資訊度量,變成了一個關於歷史和代價的陳述。

Lex 追問:那個負責「把活幹完」的系統是什麼?克羅寧的回答很實在:宇宙裡沒有什麼神秘的記憶,也沒有形態共振。物理現實中存在的是一個真實的、被約束的因果過程。一個細胞,一座特斯拉工廠,一個核糖體。他反覆強調這一點,是因為他知道一旦含糊,這套東西就會滑向玄學。

然後是 Lex 那個更狠的問題:那麼造出工廠的工廠又是什麼?

克羅寧承認這是四個他想回答的問題裡的第一個。他的猜想是:工廠湧現於環境和被建造物之間的相互作用。他用一個思想實驗展開。假設一個環境裡有大量原子,分子會按半衰期分解。能在這個環境裡活下來、並且能給自己做模板複製自己的分子,會佔據主導。現在假設 A 分子需要 10 步才能造出來,B 分子只需要 5 步,兩者都以同樣的速率被破壞,但 B 複製自己更快。結果很清楚:最短路徑會贏。

最短路徑告訴我們一件很有意思的事:把一個模體在時間和空間裡傳播下去,所需的最小資訊量是多少。它看起來像某種守恆律。(李·克羅寧)

當然這不絕對。兩個物體同時存在時,它們共享一個聯合裝配空間,最優解變成一種妥協:為了讓 A 和 B 都能被高效造出來,A 單獨看可能不是最短的。再加上並行組裝的存在,所以他的團隊最近引入了「裝配深度」(assembly depth)這個新量,它可能低於裝配指數,因為自然界在細胞裡造分子時確實在並行開工。

複製數:這一條才是真正扎人的地方

Lex 對複製數這一項特別感興趣,因為克羅寧以前沒怎麼強調它。

邏輯是這樣的:極致的隨機和極致的複雜,在只看一個樣本的時候無法區分。你手上有一個結構極其精巧的分子,它可以是被某個過程造出來的,也可以純粹是撞大運撞出來的。單看它一個,你沒有任何辦法分辨。

直到你發現第二個一模一樣的。

終極的隨機和終極的複雜無法區分,直到你能在隨機性裡看到結構,也就是看到副本。(李·克羅寧)

裝配方程裡那個複製數因此有了實際作用:它把「隨機撞出來的複雜」和「被製造出來的複雜」分開。一個物體的裝配指數越高,同時副本數越多,它就越不可能是偶然產物。

克羅寧把這個論證推到極端:如果一個分子有上百個不同的部件,而且你找到了上百萬個一模一樣的副本,那這件事在無窮多個宇宙裡都不會偶然發生一次。

「一樣」這件事本身也有解析度問題。化學家處理這個問題比較舒服,因為分子是可以拿在手裡的一袋完全相同的東西,阿伏伽德羅常數那麼多份,疊在一起看不出差別。但這個「看不出差別」是相對於你的探測手段而言的。如果兩個分子是手性對映體,在沒有手性探測器的時候,裝配理論會把它們算作同一個;一旦你有了能分辨左右手的儀器,它們就變成兩個。

克羅寧和 Lex 兩個人,在近距離看當然處處不同,但把鏡頭拉遠,形態上是同一個物種,再拉遠,都是地球生命。複製數和裝配指數因此是一組聯動的量:如果一批物體在你的探測手段下無法區分,但它們的裝配指數很低,那說明你需要換一個解析度繼續看。

生命探測儀:不用帶地球生物學的偏見

這是整段對話裡最具體、最工程化的部分。

假設你要去火星、土衛六或者土衛二找生命。傳統做法是找生物標誌物:氨基酸、特定的有機小分子,本質上是在找「地球上已知生命會留下的痕跡」。克羅寧認為這種做法帶有深刻的地球偏見。

他的方案是造一個「生命探測儀」(life meter),核心是質譜加紅外。

具體構造:一個真空腔,一個進樣口,進樣口裡有色譜填料。取一勺樣品放進去,加溶劑或者加熱讓揮發物出來,揮發物被吸入,先經過色譜分離,然後每一段餾分同時進質譜和紅外。質譜這邊稱分子重量、數碎片數量;紅外那邊數吸收譜帶數量。

讀數怎麼解釋?一條連續的刻度:死亡的、有點意思、越過閾值、這就是地球生命、簡直離譜這肯定是外星智慧造出來的東西。

質譜在這裡能扛大樑,有個隱含前提:只有某個分子的數量超過上萬份,你才能看到峰。也就是說,複製數在這個測量裡天然就內建好了。

他們真的做過驗證。取各種樣品統一處理:無機礦物、蘇格蘭威士忌、大腸桿菌裂解液、啤酒、紫杉醇,還有 NASA 給的五個盲樣,其中包括一塊一百萬年前的化石、一塊一萬年前的南極海底樣本、一塊默奇森隕石。

結果:生物來源的樣品給出了裝配指數大於 15 的分子,非生物樣品全部小於 15。他們把盲樣的判斷交回給 NASA,NASA 確認全對。

複雜度加上丰度,就是選擇的證據。這就是我們的通用生命探測儀的工作方式。(李·克羅寧)

順帶說一句威士忌。克羅寧說艾雷島的泥煤威士忌之所以顏色深、風味複雜,本質就是分子複雜度高。他拿格蘭哥尼(Glengoyne)這類低地酒和重泥煤酒做過對比,把酒直接打進質譜測裝配指數。有人在網上嘲笑說「啤酒比人還複雜」,其實他們處理的物件是酵母細胞:破碎、提取分子、看有沒有超過閾值的成分。啤酒本身並沒有被測。

不測序、不畫圖,重建生命之樹

這一部分是克羅寧在對話裡首次公開的未發表工作。

傳統上,生命之樹有三條路:達爾文那一代靠畫圖、靠形態分類;基因組革命之後靠測序;再加上一點分子考古學的推斷。

克羅寧的團隊做了第四種:取各種各樣的生物樣品,打進質譜,不做測序,不畫圖,只靠裝配空間的關係,把生命之樹重新長出來。

方法細節很有意思。他們看的不只是單個分子,還包括共存的分子集合,考察它們共享的聯合裝配空間。取一個樣品,挑出分子量最高的一批分子,逐一打碎,算出各自的裝配指數,得到一個指紋。再取另一個樣品,得到另一個指紋。然後比較兩個指紋之間共享多少裝配路徑,差異的數量可以估計它們共同祖先的距離。

只要數差異的數量,你就能估計它們的起源離得多遠。這事就這麼成了。當我們意識到可以不用任何基因測序就重建生命之樹的時候,我們的反應是:嗯?(李·克羅寧)

一個反直覺的發現:越複雜的生物並不必然製造越複雜的分子。真菌製造的分子極其複雜,因為它不能移動,所有東西都得就地合成。而一些動物很懶,直接去吃真菌就行了,自己不需要造多少東西。訊號藏在大量複雜分子同時超過閾值的共存狀態裡,跟單個分子有多複雜關係不大。

這個思路還可以往過去推。DNA 和 RNA 很不穩定,幾萬年就降解得差不多了,但一些更穩定的複雜分子可能還在。如果能對化石樣本做同樣的測量,或許能找到那些已經無法測序的生命留下的痕跡。甚至可以做「死亡年代測定」:生物死後會發生外消旋化,手性從純對映體逐漸變成混合物,偏離程度對應一個半衰期。此外還有動力學同位素效應,活得越久、代謝越久,體內碳-13 的富集程度越高,理論上可以用來估算年齡。

化學鍵不存在

對話進行到一半,克羅寧丟擲一個聽起來像挑釁的說法:化學反應不存在。

Lex 的反應是「天哪,這是什麼意思」。

克羅寧正在寫一篇論文,標題就叫《化學反應的起源》。核心論點是:真正存在的是由量子力學支配的反應性,以及一系列約束條件。化學家給反應起的名字,比如 Wittig 反應、Suzuki 反應,本質上是一張壓縮過的約束清單:地球、1 個 G、298 開爾文、1 巴、有氧環境、玻璃燒瓶、純試劑、控溫控壓。

化學家用反應這個名字,其實是一套非常漂亮的壓縮簡寫,代表的是約束的施加。但我不認為 Wittig 反應在金星上是可及的。(李·克羅寧)

這個區分之所以重要,是因為它直接回應了那類批評:裝配理論沒有考慮不同反應的機率不同。克羅寧的回答是,裝配理論研究的是在圖上的最短路徑,這個最短路徑給的是一個下界,它假定了所有鍵都能形成。真實的化學反應機率當然有差異,某些鍵太弱,分子在質譜裡還沒測就散掉了,這會導致裝配指數被算錯,但這個問題可以用紅外補上。

換句話說,裝配理論不談論化學,因為化學本身就是被約束出來的東西。在生命起源那個場景裡,沒有化學家在場,除非你相信天上坐著一位化學家。

和柯爾莫哥洛夫複雜度差在哪

這是最常被提出來的一類質疑,克羅寧回答得也最直接。

柯爾莫哥洛夫複雜度衡量的是「生成這個物件的最短程式的長度」。它需要一臺圖靈機,需要一臺計算機。

克羅寧的回應分兩層。

第一層:柯爾莫哥洛夫複雜度說到底是在告訴你關於你的資料集的事,是資料集的壓縮程度。「烏龜」在這個類比裡就是那臺計算機本身,它被預設了,沒被解釋。

第二層,也是他真正想說的:裝配理論缺少的那一環是因果鏈。在一臺計算機的記憶體裡,所有資料都是一樣的,訪問成本相同,你只要壓就行。但現實裡的物體不是這樣:拿到一個高裝配指數的物件,意味著在過去某處有一條真實的因果鏈把活幹完了。

我認為我們會證明,演算法資訊理論是裝配理論的一個非常重要的子集。因為選擇產生工廠,工廠最終產生計算機,然後演算法資訊理論才從那裡長出來。(李·克羅寧)

他說這話時特意加了個「給所有熱愛複雜度理論的朋友一個觸發警告」。

Lex 提了一個很好的反駁:裝配理論看的是物體本身,物體並沒有附帶一份維基百科頁面介紹自己的歷史,所以它只能推斷歷史,而且推斷的是最短的那條。

克羅寧接受了「推斷」這個詞,但給出了一個漂亮的解釋:最短路徑是從物件本身推出來的,它對應的是如果完全沒有機器來製造它,這個物件在時間上有多深。裝配理論沒打算壓過演算法資訊理論,也沒打算無視工廠的存在。它在問:這座工廠有多大,它在時間裡紮了多深。

時間必須是基本的

這是整段對話最哲學、也最容易被誤讀的部分。

克羅寧的立場可以拆成三條:

第一,宇宙大到裝不下自己的未來。

第二,往過去看,宇宙看起來是決定論的;往未來看,它是不確定的。

第三,如果你相信自由意志,你就必須承認時間是基本的。

他的論證路徑是這樣的。假設初始條件決定了一切,那麼為了精確預測兩個物體相撞會發生什麼,你需要無限精確的座標。但一個有限的物體存不下無限精度的數字。一個高爾夫球直徑幾釐米,你能把座標精確到原子位錯的尺度,再往下就不行了。這裡的問題跟我們的知識多寡無關。初始條件在原理上就無法被完整指定。

這個論證跟混沌理論那類說法不一樣。混沌理論講的是對初值敏感,他講的是初值根本沒法寫全。

我們無法精確預測未來,這不是我們無知的證據,這是宇宙正在生成新東西的證據。(李·克羅寧)

由此引出他對「排中律只適用於過去」的說法。下週紐約會不會下雪,你沒法說真或假。但如果你問上週紐約下雪了嗎,答案清清楚楚。排中律在未來失效這件事,本身就說明時間是基本的。

Lex 追問:如果資訊完備,理論上不能預測嗎?克羅寧的回答是「不可能」。他把這條線索追到了數學基礎:希爾伯特認為無限是允許的,布勞威爾認為不行,所有數都必須是有限的。他認為物理學被柏拉圖式的數學帶偏了,需要轉向直覺主義。

還有一句更驚人的話:地球上現在有宇宙中最大的東西。

這裡說的跟體積無關,指的是組合意義上的腳手架。從 LUCA 開始,自我複製的細胞、多細胞化、動物、抽象能力,一路搭到語言、文化、計算機。這些架構在組合空間裡延伸出的距離,比宇宙中任何已知結構都長。

卡爾·薩根做反了。他指著旅行者號說,看宇宙多大。我想反過來說:看看旅行者號,它來自地球,來自 LUCA。看看地球有多大。(李·克羅寧)

這個說法直接連到他對費米悖論的態度。他猜每顆恆星大概都有行星,生命大概也在上面出現。但每個星球對應的組合空間差別太大,因果錐很難相交。

我的因果錐和它們的因果錐永遠不會重疊,或者很難重疊。這就是外星生命讓我難過的地方,也是為什麼我們必須儘快在實驗室裡造出外星生命。(李·克羅寧)

他想要的是「行星模擬器」:在實驗室裡,按可理解的約束條件造出另一種生命,換一套遺傳字母表,換一套蛋白質字母表,但照樣有細胞、有演化。這樣就能把「生命」和「選擇」從地球化學的約束裡解放出來,變成一個更普遍的現象。然後才知道該把詹姆斯·韋布望遠鏡指向哪類行星,才知道該用什麼方式去解讀那些看起來像隨機、實際上帶有裝配結構的光譜訊號。

他對 AI 末日論的態度:零

談到 AI,克羅寧的用詞變得很不客氣。他管現在這些東西叫「自主資訊學」(autonomous informatics),專門為了讓某些人不高興。

他的核心論點是一個類比:

人們擔心 AGI,就像擔心 AG。AG 是什麼?反重力(anti-gravity)。「有一天反重力被發現了,大氣層會飄走,我們都會飄走,全完了。」反重力的機率是多少?我們不知道,因為沒有任何機制。AGI 的機率是多少?我們同樣不知道,因為同樣沒有機制。(李·克羅寧)

他認為 AI 末日論者的問題出在認識論上:他們不知道知識是什麼。小行星撞地球的機率可以算,因為這件事發生過,機制清楚,引力井在那裡。而通用人工智慧的機制根本沒有,所以給出一個 95% 的機率是沒有意義的。

他還指出兩個範疇錯誤。第一個是能動性:決策能力來自人,不來自模型。意圖來自提示詞作者,來自寫程式的人,來自那條外部的因果鏈。第二個是超級智慧必然出現:下棋的計算機下棋很強,這不代表它超級聰明。他順手把德雷克斯勒的奈米組裝機也歸到同一類錯誤裡:把工程學原理硬塞到分子尺度,原子級精確的自複製奈米機器人造不出來,因為沒有資源、沒有精度,唯一已知能工作的分子級技術是演化造出來的。

他真正擔心的東西很具體:假資料、假使用者。他想要可驗證的真人和可驗證的真資料,並且明確表示願意被監管,只要監管的是真實存在的風險,而非科幻。

他還給了一個有意思的觀察:AI 末日論和 AI 救世論是同一種東西的兩面,都是新宗教在形成。他懷疑,一部分從業者高談 AI 末日,部分原因是在為社交媒體已經造成的傷害打掩護。

Lex 在這裡做了一個漂亮的補充:社會里需要有人說「我們都要死了」,因為這種資訊會像病毒一樣擴散,最終在社會層面留下一個大致合理的平均關切度。95% 傳出去,公眾感受到的可能是 0.03%,而這 0.03% 恰好是合適的。

化學大腦與真正的新穎性

克羅寧的實驗室在做兩件事,都跟「智慧從哪來」有關。

第一件是 Chem Machina,名字是對《Ex Machina》的改寫。他坦白說,他不指望在自造的系統裡造出真正的智慧,因為沒有腦細胞、沒有膠質細胞、沒有神經元。但他想用凝膠工程做出一種可重程式設計的混合硬體,用極低的成本處理大量資訊,做跨領域的知識遷移。

第二件是 GPT for electron density。傳統上,用 AI 做化學喜歡把分子表示成圖,但分子並不是圖,也並不連續可微。克羅寧團隊的思路是:分子的本質是電子密度。於是他們先對幾百萬個分子做量子力學計算,得到各自的電子密度,訓練一個生成模型學會「電子密度長什麼樣」。

用法是反向的:給它一個蛋白質口袋,往裡面灌噪聲,讓它把噪聲轉成電子密度。約束是最大化靜電勢(讓分子黏住),同時最小化位阻(減少排斥),也就是讓它長成完美貼合的形狀。然後再用一個類似 ChatGPT 的模組,把電子密度翻譯成 SMILES 字串,最後交給實驗室的機器人去合成。

這套東西是端到端跑通的,雖然還有點漏、會出問題,但原理驗證已經成立。

有意思的一點是「幻覺」在這裡變成了優點。解薛定諤方程到多重重原子非常昂貴,他們只用最多九個重原子的資料訓練,結果模型能外推到十二個重原子,生成的分子看起來還挺像樣。

這種幻覺我就白收了,謝謝。(李·克羅寧)

但克羅寧很剋制地補了一句:這些分子在人類看來是新的,但它們受宿主口袋約束,談不上真正的新穎。

那什麼才算真正的新穎?

如果你有一個智慧系統,無論是人、是聊天機器人還是別的什麼,能產出某種我即便拿到完整的過往審計記錄也無法預測的、真正新的東西,那我就服了。(李·克羅寧)

他用一個例子說明當下的模型做不到什麼。你給模型 0 到 1000 之間的所有素數做訓練,它能學會挑素數,但它不知道什麼是素數。它永遠不會產出訓練集之外的東西,因為它挖的是過去。而人腦似乎在挖未來。

他把這個差別跟裝配理論接上了:真正的新穎性來自不同因果鏈的交匯。兩個帶有不同歷史的物件碰到一起,歷史差異越大,往前生成的新東西就越多。人腦幹的就是這件事,把各種刺激混起來,然後突現出某個誰也沒預測到的東西。

這也是他對「宇宙大到裝不下未來」的另一種表述。過去看起來和初始條件假說相容,但真相是:我們一直在生成新的東西,只不過生成之後它就被併入了資料集,回過頭看顯得理所當然。

那段關於「笨蛋班」的自述

對話中段,克羅寧罕見地講了自己的經歷。

小學時他寫字很差,據說是讀不了書,數學也很差。學校判定有問題。父母很困惑,因為他在家一直在拆東西,

從商店買電子廢件,試圖自己攢計算機。

後來他被分進了補習班。他記得那個班裡有三類人:有暴力傾向的、不會說英語的、真正有學習障礙的。而他其實能讀,也喜歡讀,只是拒絕讀別人指定他讀的東西。

有一天他被人撞見在教另一個同學認字,老師說,這事我們看不懂。

他從小想做科學家,但不知道那意味著什麼。等他知道要上大學,才發現需要考試成績。學校說他只能考 C、D、E,連 A、B、C 的門都進不去。他父親介入,說讓他去考,學校說肯定掛,浪費時間浪費錢。他父親說,那我們付錢行不行。學校說,其實不用付,只有掛了才要付。

他考過了,進了 A Level,但因為 GCSE 數學只拿到 C,學校不讓他選 A Level 數學。最後他選了化學,因為遇到了一位好老師。

八歲的時候他想造鐳射。他的方案是造二氧化碳鐳射器,需要部分鍍膜的鏡子、二氧化碳和高壓電。為了收集足夠的二氧化碳,他點了一把火,試圖過濾火焰。結果火沒過濾成,燒掉了半個車庫。

Lex 問他,那一刻支撐他不放棄的是什麼。他的回答是:他很喜歡「不理解」的感覺。

我喜歡和聰明人待在一起,也喜歡把聰明人搞糊塗。如果我能把一個聰明人搞糊塗,那是我可能真在做點有意思的事的唯一一點希望。(李·克羅寧)

他補充了判斷標準:只要這些聰明人沒說「你就是個徹底的蠢貨」,各自給出的是不同的理由,那就說明還有東西沒被說清楚。

裝配理論發表之後,很多人說這是錯的。他每次都問為什麼,沒有人能給出一個前後一致的理由。有人說這事早有人做過,有人說這不過是某種舊東西的翻版。他要的是可操作的批評:你的方程在這裡錯了,你的方法在那裡不成立。有了可操作的批評,他就能三角定位,回去修。

他說自己在招聘時有一個偏好:如果一個人足夠堅持,他憑什麼不給對方一個機會。因為當年有人給了他機會。

《自然》那三輪審稿

投稿過程也值得一提,因為它解釋了這個理論為什麼最後長成現在這個形狀。

第一版投出去,編輯的反饋相當直接:「我不覺得這有多大意思」「這個概念很難」。克羅寧和莎拉花了一年重寫。當時的稿子裡滿是方程,預印本版本足足 23 個。他跟第一作者說,所有方程都刪掉,只留我的裝配方程,對方說不行。最後他們刪到第 40 版,決定推倒重來,從零開始,一句一句問「我們到底想說什麼」。

再投出去,他們以為連審稿都過不了。結果進了外審。審稿意見非常深,也非常嚴厲,但不是輕蔑式的:真的嗎?解釋一下這一點、這一點、還有這一點。你確定這不是柯爾莫哥洛夫複雜度?你確定不是這個?三輪下來,編輯說,收了。

對比之下,之前那篇用質譜測複雜度的論文,投《自然》被拒,六輪審稿後還是被拒,其中一位化學審稿人的意見是「我不信,你們肯定在造假」。

Lex 問他,晚上十點收到第五封這樣的意見,是什麼支撐他繼續。他停了很久,說不要為論文動感情,然後說抱歉,讓我緩一下,你把五年的積怨壓縮在一起了。

我那時候覺得自己像個瘋子。就是《美麗心靈》裡那個人,天才那部分沒有,胡言亂語那部分全有。(李·克羅寧)

他當時沒有數學能力,反覆做代數展開,同一個模體一遍一遍出現,他懷疑那就是複製數,但推不下去。後來複製數真的從方程裡掉了出來,所有東西塌縮成一體。他說,哦,好像能行。

此外還有一段插曲:論文發表後他去向編輯道歉,說不該給期刊帶來這麼大爭議。編輯的回答是,你道什麼歉,這是篇好論文,當然會有反彈,你確實說了一些有爭議的話,但那很棒。

為什麼所有人都被冒犯了

回到爭議本身。克羅寧對各方反應的分析相當坦率。

進化生物學家最生氣。他完全沒預料到這個。有人的說法是「生命起源是個已解決的問題」,這句話讓他意識到自己確實戳到了什麼。他的反駁是:演化必須在生物學之前發生,這中間有一個空白,而生物學家不願意承認這個空白的存在。

物理學家相對客氣。他們說,初始條件那件事我們不太確定,但這是個值得認真辯的大問題。克羅寧的說法更硬:生命的湧現,過去沒有、原理上也不可能被編碼在宇宙的初始條件裡。

計算複雜度圈子的人不高興,因為他之前確實捅過這個馬蜂窩。他承認這可能是他自找的,但他想捅得有建設性。

前生命化學家覺得化學不夠多。

最後神創論者跳出來說這不夠神創。克羅寧說,那一刻他想,自己的活幹完了。

他對「這不過是給早就明顯的東西起了個時髦名字」這類批評的回應很直接:分子的裝配指數並不顯然,此前沒有人測過;用如此原始、可量化的方式去同時量化選擇、複雜度和複製數,此前也沒有人做過。

如果這真的那麼顯然,那你為什麼沒做?(李·克羅寧)

他也承認了那種「一箭雙鵰」的尷尬:同一篇論文同時戳中了兩根弦。一根是「生物學確實在做某種有意思的事,我們看得見但還沒量化」,另一根是「這不過是舊東西」。所以有人一邊罵它垃圾,一邊說這想法我二十年前就有了。他的回應是:那是哪一部分?垃圾那部分,還是革命性那部分?

但最讓他滿意的一點是:沒有人攻擊論文的物理內容本身。裝配指數可以被測量,選擇可以被測量,這兩件事要麼對,要麼不對。如果沒用,這篇論文會沉下去,沒人再引用。如果有用,別人會在上面搭腳手架,慢慢收斂成一個新正規化。

他還專門反擊了一種論調:論文不該這麼宏大。他的回答是,這裡沒有炒作,沒有人假裝在櫃子裡發現了外星人。他只是提出了一個精確、可檢驗、可修正的強主張,一個能被證偽、也能被繼續搭建的具體框架,而不是又一個關於「生物中的資訊」的含混論證。

我想做的,是提出一個可以被摧毀、也可以被繼續搭建的東西。論文不是金牌。(李·克羅寧)

他自己承認這套東西可能是錯的

有一段話值得單獨拎出來,因為它劃定了克羅寧自己給這套理論設的邊界。

他說,裝配理論目前真正紮實的地方是化學。往細胞走,能講通但還在做。往細胞表面、組織型別、疾病細胞型別走,是下一步。往語言、表情包、數學定理、細胞自動機走,已經有初步結果,但「遠遠超出我的能力範圍」。

他提到一個有意思的細節:把細胞自動機的規則本身當作分析物件,不同的人在不同年代發明了不同的規則,互相借鑑、做出微小改動,這些規則也有裝配指數和複製數。

Lex 追問:從分子一路推到人腦,中間那麼多步,怎麼處理?克羅寧的回答是:不能直接比,它們處在湧現的層級裡。人腦的裝配指數是什麼意思?也許可以看形態特徵,比如所有人腦共有的特徵數量,然後把鯨、海豚、黑猩猩、鳥的腦拿來做對比,複製數就是各物種的個體數量。但前提是你得先有解剖學的判斷,知道該看哪些特徵。他承認這裡可以用機器學習做特徵發現,但特徵和解析度之間的聯動關係還沒搞清楚。

Lex 還提了一個很實際的期望:如果這套框架能在一批事先不知道答案的文字、影象、文化產物上跑一遍,像 NASA 盲樣那樣證明它在別的尺度上也能用,那就非常有說服力。克羅寧的回應是:這會是第一步,但也認可現在的框架大機率需要改,需要擴。

我並不是說宇宙裡有某種神秘的記憶,什麼形態共振。我是說,物理現實中確實存在一個被引導、被約束的因果過程。(李·克羅寧)

這段話他說了兩遍,一次在解釋工廠,一次在解釋裝配偶然。兩次強調,說明他知道這裡最容易被誤解。

他對這套理論的最終評價,說得比大多數科學家在自己的釋出會上都要保守:它肯定是錯的,但希望它比別的想法錯得少一點。這句話不是謙虛的姿態。它跟整段對話的氣質一致:一個人把一個大到離譜的框架擺上桌,然後立刻承認桌腿可能是歪的,請大家一起上來推一推。

結尾:幾個可以帶走的東西

整段對話接近尾聲時,Lex 問他,宇宙裡最讓他覺得美的是什麼。

它看起來非常未定,非常開放。每次我以為自己快摸到一個問題的答案,就會出現更多的問題。追這個過程本身就夠了。(李·克羅寧)

Lex 又問他,會不會因為這一切終將結束而難受。他說不會。他反問:對牛頓來說,結束了嗎?牛頓在未來仍然有因果效力,我們每天都在談他。他自己想做的,是離開之後在未來儘可能多留一些彩蛋。

Lex 問,如果有人訓一個精細調校的李·克羅寧大模型,他會不舒服嗎。他說會挺無聊的。一個忠實還原他做過的事的模型是個有趣的文物,但人與人之間最有意思的地方在於,我們不知道對方下一步會做什麼。他挖未來的新穎性,這一部分不會被捕捉。

如果要給這段對話留下幾條能直接用的東西,大概是這樣:

  • 判斷一個複雜物件是不是「被造出來的」,不要只看它有多複雜,要看它有多少個一模一樣的副本。單個樣本的極致複雜和極致隨機無法區分,副本數是把兩者分開的關鍵。
  • 評估任何複雜度指標時,先問它有沒有因果鏈。柯爾莫哥洛夫複雜度、壓縮率、熵,都是在告訴你資料集的事。裝配指數問的是:在過去某處,有沒有一條真實的路徑把活幹完了。這個區別決定了它能不能用來識別生命。
  • 如果你在做跨領域的複雜度研究,先固定解析度再談結論。什麼算「同一個物件」,取決於你的探測手段。手性探測器沒有的時候,左右手算一個;有的時候,算兩個。這個選擇會直接改變裝配指數和複製數的數值。
  • 找外星生命時,優先找高裝配指數加大豐度的分子組合,別急著找地球生物標誌物。氨基酸這類標誌物帶有強烈的地球化學偏見。複雜度加丰度是無偏的,而且質譜本身就已經把複製數內建進去了。
  • 對 AI 能力做風險判斷時,先要求一個機制。如果提不出機制,給出的機率數字就沒有資訊量。這條標準對小行星撞擊成立,對反重力不成立,對 AGI 目前也不成立。真正值得擔心的是當下真實存在的風險:假資料、假使用者、身份不可驗證。
  • 想做真正新穎的東西,去和帶著完全不同歷史的人、領域、方法碰撞。克羅寧的判斷是,新穎性來自不同因果鏈的交匯,歷史差異越大,往前生成的越多。想在一個封閉的訓練集裡等新穎性自己長出來,等不到。
  • 收到批評時,把「這不對」逼成「這裡不對」。前者沒法用,後者能三角定位。克羅寧說,沒有人能對他給出一致的否定理由,這件事本身就讓他確信值得繼續往下走。
文稿來自 Lex Fridman 官網公開發布的官方 Transcript(含說話人與時間戳)。
Lee Cronin (00:00:00): Every star in the sky probably has planets and life is probably emerging on these planets. But I think the commentorial space associated with these planets is so different. Our causal cones are never going to overlap or not easily. And this is the thing that makes me sad about alien life, why we have to create alien life in the lab as quickly as possible because I don’t know if we are going to be able to build architectures that will intersect with alien intelligence architectures. Lex Fridman (00:00:35): Intersect, you don’t mean in time or space- Lee Cronin (00:00:38): Time and the ability to communicate. Lex Fridman (00:00:40): The ability to communicate. Lee Cronin (00:00:41): Yeah. My biggest fear in a way is that life is everywhere, but we’ve become infinitely more lonely because of our scaffolding in that commentorial space. Lex Fridman (00:00:52): The following is a conversation with Lee Cronin, his third time in this podcast. He’s a chemist from University of Glasgow who is one of the most fascinating, brilliant and fun to talk to scientists I’ve ever had the pleasure of getting to know. This is the Lex Fridman podcast. To support it, please check out our sponsors in the description. And now, dear friends, here’s Lee Cronin. Lex Fridman (00:01:16): So your big assembly theory paper was published in Nature. Congratulations. Lee Cronin (00:01:21): Thanks. Lex Fridman (00:01:21): It created, I think it’s fair to say, a lot of controversy, but also a lot of interesting discussion. So maybe I can try to summarize assembly theory and you tell me if I’m wrong. Lee Cronin (00:01:32): Go for it. Lex Fridman (00:01:33): So assembly theory says that if we look at any object in the universe, any object, that we can quantify how complex it is by trying to find the number of steps it took to create it. And also we can determine if it was built by a process akin to evolution by looking at how many copies of the object there are. Lee Cronin (00:01:55): Yep. That’s spot on. Yep. Lex Fridman (00:01:56): Spot on. Lee Cronin (00:01:57): Spot on. Lex Fridman (00:01:58): I was not expecting that. Okay, so let’s go through definitions. So there’s a central equation I’d love to talk about, but definition wise, what is an object? Lee Cronin (00:02:11): Yeah, an object. So if I’m going to try to be as meticulous as possible, objects need to be finite and they need to be decomposable into sub-units. All human made artifacts are objects. Is a planet an object? Probably yes, if you scale out. So an object is finite and accountable and decomposable, I suppose, mathematically. But yeah, I still wake up some days and go to think to myself, what is an object? Because it’s a non-trivial question. Lex Fridman (00:02:50): Persists over time, I’m quoting from the paper here. An object is finite, is distinguishable. I’m sure that’s a weird adjective, distinguishable. Lee Cronin (00:03:03): We’ve had so many people help offering to rewrite the paper after it came out. You wouldn’t believe it’s so funny. Lex Fridman (00:03:10): Persists over time. And is breakable such that the set of constraints to construct it from elementary building blocks is quantifiable, such that the set of constraints to construct it from elementary building blocks is quantifiable. Lee Cronin (00:03:25): The history is in the objects. It’s kind of cool, right? Lex Fridman (00:03:29): Okay. So what defines the object is its history or memory, whichever is the sexier word. Lee Cronin (00:03:36): I’m happy with both depending on the day. Lex Fridman (00:03:38): Okay, so the set of steps it took to create the object. So there’s a sense in which every object in the universe has a history. And that is part of the thing that is used to describe its complexity. How complicated it is. Okay, what is an assembly index? Lee Cronin (00:04:00): So the assembly index, if you’re to take the object apart and be super lazy about it or minimal say ’cause it’s like you’ve got a really short-term memory. So what you do is you lay all the parts on the path and you find the minimum number of steps you take on the path to add the parts together to reproduce the object. And that minimum number is the assembly index. It’s minimum bound. And it was always my intuition, the minimum bound and assembly theory was really important that I only worked out why a few weeks ago, which is kind of funny ’cause I was just like, “No, this is sacrosanct. I don’t know why, it’ll come to me one day.” Lee Cronin (00:04:37): And then when I was pushed by a bunch of mathematicians, we came up with the correct physical explanation, which I can get to, but it’s the minimum and it’s really important. It’s the minimum. And the reason I knew the minimum was right is because we could measure it. So almost before this paper came out, we’d published papers, explain how you can measure the assembly index of molecules. Lex Fridman (00:05:01): Okay, so that’s not so trivial to figure out. So when you look at an object, we could say a molecule, we could say object more generally. To figure out the minimum number of steps it takes to create that object, that doesn’t seem like a trivial thing to do. Lee Cronin (00:05:17): So with molecules, it is not trivial, but it is possible because what you can do and because I’m a chemist, so I’m kind of like I see the lens of the world for just chemistry. I break the molecule apart and break bonds. And if you take a molecule and you break it all apart, you have a bunch of atoms and then you say, “Okay, I’m going to then take the atoms and form bonds and go up the chain of events to make the molecule.” Lee Cronin (00:05:46): And that’s what made me realize, take a toy example, literally a toy example, take a Lego object, which is broken up of Lego blocks. So you could do exactly the same thing. In this case, the Lego blocks are naturally the smallest. They’re the atoms in the actual composite Lego architecture. But then if you maybe take a couple of blocks and put them together in a certain way, maybe they’re offset in some way, that offset is on the memory, you can use that offset again with only a penalty of one and you can then make a square, triangle and keep going. Lee Cronin (00:06:19): And you remember those motifs on the chain. So you can then leap from the start with all the Lego blocks or atoms just laid out in front of you and say, “Right, I’ll take you, you, you,” connect and do the least amount of work. So it’s really like the smallest steps you can take on the graph to make the object. And so for molecules, it came relatively intuitively. And then we started to apply it to language. We’ve even started to apply it to mathematical theorems. But I’m so well out of my depth. But it looks like you can take minimum set of axioms and then start to build up mathematical architectures in the same way. And then the shortest path to get there is something interesting that I don’t yet understand. Lex Fridman (00:07:02): So what’s the computational complexity of figuring out the shortest path with molecules, with language, with mathematical theorems? It seems like once you have the fully constructed Lego castle or whatever your favorite Lego world is, figuring out how to get there from the basic building blocks, is that an empty hard problem? It’s a hard problem. Lee Cronin (00:07:28): It’s a hard problem. But actually if you look at it, so the best way to look at it, let’s take a molecule. So if the molecule has 13 bonds, first of all, take 13 copies of the molecule and just cut all the bonds. So cut 12 bonds and then you just put them in order and then that’s how it works. And you keep looking for symmetry or copies so you can then shorten it as you go down. Lee Cronin (00:07:51): And that becomes [inaudible 00:07:53] quite hard. For some natural product molecules, it becomes very hard. It’s not impossible, but we’re looking at the bounds on that at the moment. But as the object gets bigger it becomes really hard. But that’s the bad news. But the good news is there are shortcuts. And we might even be able to physically measure the complexity without computationally calculating it, which is kind of insane. Lex Fridman (00:08:20): Wait, how would you do that? Lee Cronin (00:08:20): Well, in the case of molecule, so if you shine light on a molecule, let’s take an infrared. The molecule has each of the bonds absorbs the infrared differently in what we call the fingerprint region. And so it’s a bit like because it’s quantized as well, you have all these discreet kind of absorbances. And my intuition, after we realized we could cut molecules up in mass spec, that was the first go at this. We did it with using infrared. And the infrared gave us an even better correlation assembly index. And we used another technique as well in addition to infrared called NMR, nuclear magnetic resonance, which tells you about the number of different magnetic environments in a molecule. And that also worked out. So we have three techniques which each of them independently gives us the same or tending towards the same assembly index from molecule that we can calculate mathematically. Lex Fridman (00:09:12): So these are all methods of mass spectrometry, mass spec. You scan a molecule, it gives you data in the form of a mass spectrum. And you’re saying that the data correlates to the assembly index? Lee Cronin (00:09:25): Yeah. Lex Fridman (00:09:26): So how generalizable is that shortcut, first of all it’s chemistry. And second of all, beyond that, that seems like a nice hack and you’re extremely knowledgeable about various aspects of chemistry. So you can say, okay, it kind of correlates. But the whole idea behind assembly theory paper and perhaps why it’s so controversial is that it reaches bigger. It reaches for the bigger general theory of objects in the universe. Lee Cronin (00:09:58): Yeah, I’d say so. I’d agree. So I’ve started assembly theory of emoticons with my lab, believe it or not. So we take emojis, pixelate them and work out the assembly index of the emoji and then work out how many emojis you can make on the path of emoji. So there’s the uber emoji from which all other emojis emerge. So you can then take a photograph and by looking at the shortest path, by reproducing the pixels to make the image you want, you can measure that. So then you start to be able to take spatial data. Lee Cronin (00:10:32): Now there’s some problems there. What is then the definition of the object? How many pixels? How do you break it down? And so we’re just learning all this right now. Lex Fridman (00:10:42): So how do you compute, begin to compute the assembly index of a graphical, a set of pixels on a 2D plane that form a thing? Lee Cronin (00:10:54): So you would first of all determine the resolution. So then what is your XY and what the number on the X and Y plane and then look at the surface area. And then you take all your emojis and make sure they’re all looked at the same resolution. And then we would basically then do exactly the same thing we would do for cutting the bonds. You’d cut bits out of the emoji and look at, you’d have a bag of pixels and you would then add those pixels together to make the overall emoji. Lex Fridman (00:11:26): Wait, wait a minute. But first of all, not every pixels, I mean this is at the core, machine learning and computer vision, not every pixels that important. And there’s macro features, there’s micro features and all that kind of stuff. Lee Cronin (00:11:40): Exactly. Lex Fridman (00:11:42): The eyes appear in a lot of them, the smile appears in a lot of them. Lee Cronin (00:11:47): So in the same way in chemistry we assume the bond is fundamental. What we do in they’re and here is we assume the resolution at the scale at which we do it is fundamental and we’re just working that out. And you’re right, that will change because as you take your lens out a bit, it will change dramatically. Lee Cronin (00:12:02): But it’s just a new way of looking at, not just compression. What we do right now in computer science and data, one big kind of misunderstanding as assembly theory is telling you about how compressed the object is. That’s not right. It’s how much information is required on a chain of events. Because the nice thing is if, when you do compression and computer science, we’re wandering a bit here, but it’s kind of worth wandering I think, you assume you have instantaneous access to all the information in the memory. In assembly theory you say, “No, you don’t get access to that memory until you’ve done the work.” And then when you’ve done access to that memory, you can have access but not to the next one. Lee Cronin (00:12:45): And this is how in assembly theory, we talk about the four universes, the assembly universe, the assembly possible, and the assembly contingent, and then the assembly observed. And they’re all scales in this commentorial universe. Lex Fridman (00:12:58): Yeah. Can you explain each one of them? Lee Cronin (00:13:00): Yep. So the assembly universe is like anything goes, just combinatorial kind of explosion in everything. Lex Fridman (00:13:07): So that’s the biggest one? Lee Cronin (00:13:08): That’s the biggest one. It’s massive. Lex Fridman (00:13:09): Assembly universe, assembly possible, assembly contingent, assembly observed. And the Y axis is assembly steps in time and the X axis as the thing expands through time, more and more unique objects appear. Lee Cronin (00:13:29): Yeah, so assembly universe, everything goes. Assembly possible, laws of physics come in this case in chemistry, bonds assembly. So that means- Lex Fridman (00:13:39): Those are extra constraints, I guess? Lee Cronin (00:13:40): Yes. And they’re the only constraints. They’re the constraints at the base. So the way to look at it’s you’ve got all your atoms, they’re contized and you can just bond them together. So then you can become a kind of, so in the way in computer science speak, I suppose the assembly universe is just like no laws of physics. Things can fly through mountains, beyond the speed of light. In the assembly possible. You have to apply the laws of physics, but you can get access to all the motifs instantaneously with no effort. So that means you could make anything. Lee Cronin (00:14:10): Then the assembly contingent says “No, you can’t have access to the highly assembled object in the future until you’ve done the work in the past on the causal chain.” And that’s really, the really interesting shift where you go from assembly possible to assembly contingent. That is really the key thing in assembly theory that says you cannot just have instantaneous access to all those memories. You have to have done the work. Somehow the universe has to have somehow built a system that allows you to select that path rather than other paths. Lee Cronin (00:14:45): And then the final thing the assembly observed is basically us saying, “Oh, these are the things we actually see. We can go backwards now and understand that they have been created by this causal process.” Lex Fridman (00:14:59): Wait a minute. So when you say the universe has to construct the system that does the work, is that like the environment that allows for selection? Lee Cronin (00:15:08): Yeah. Lex Fridman (00:15:09): So that’s the thing that does the selection. Lee Cronin (00:15:10): You could think about in terms of a Von Neumann constructor versus a selection, a ribosome, a Tesla plant assembling Teslas. The difference between the assembly universe in Tesla land and the Tesla factory is everyone says, “No, Teslas are just easy. They just spring out, you know how to make them all. The Tesla factory, you have to put things in sequence and out comes a Tesla. Lex Fridman (00:15:32): So you’re talking about the factory? Lee Cronin (00:15:33): Yes. This is really nice, super important point is that when I talk about the universe having a memory or there’s some magic, it’s not that. It’s that tells you that there must be a process encoded somewhere in physical reality, be it a cell, a Tesla factory or something else that is making that object. I’m not saying there’s some kind of woo-woo memory in the universe, morphic resonance or something. I’m saying that there is an actual causal process that is being directed, constrained in some way. So it’s not kind of just making everything. Lex Fridman (00:16:10): Yeah, but Lee, what’s the factory that made the factory? First of all, you assume the laws of physics is just sprung to existence at the beginning. Those are constraints. But what makes the factory the environment that does the selection? Lee Cronin (00:16:29): This is the question of, well, it’s the first interesting question that I want to answer out of four. I think the factory emerges in the interplay between the environment and the objects that are being built. And let me, I’ll have a go at explain to you the shortest path. Lee Cronin (00:16:48): So why is the shortest path important? Imagine you’ve got, I’m going to have to go chemistry for a moment, then abstract it. So imagine you’ve got a given environment that you have a budget of atoms, you’re just flinging together. And the objective of those atoms that being flung together in say, molecule A, they decompose. So molecules decompose over time. So the molecules in this environment, in this magic environment have to not die, but they do die. They have a half-life. Lee Cronin (00:17:23): So the only way the molecules can get through that environment out the other side, let’s pretend the environment is a box and can go in and out without dying. And there’s just an infinite supply of atoms coming or, well, a large supply, the molecule gets built, but the molecule that is able to template itself being built and survives in the environment will basically reign supreme. Lee Cronin (00:17:49): Now let’s say that molecule takes 10 steps and it is using a finite set of atoms. Now, let’s say another molecule, smart ass molecule we’ll call it, comes in and can survive in that environment and can copy itself, but it only needs five steps. The molecule that only needs five steps continued, both molecules are being destroyed, but they’re creating themselves faster they can be destroyed. You can see that the shortest path reigns supreme. So the shortest path tells us something super interesting about the minimal amount of information required to propagate that motif in time and space. And it seems to be like some kind of conservation law. Lex Fridman (00:18:35): So one of the intuitions you have is the propagation of motifs in time will be done by the things that can construct themselves in the shortest path. Lee Cronin (00:18:47): Yeah. Lex Fridman (00:18:47): So you can assume that most of the objects in the universe are built in the shortest, in the most efficient way. Big leap I just took there. Lee Cronin (00:18:58): Yeah. Yes and no, because there are other things. So in the limit, yes, because you want to tell the difference between things that have required a factory to build them and just random processes. But you can find instances where the shortest path isn’t taken for an individual object, individual function. And people go, “Ah, that means the shortest path isn’t right.” And then I say, “Well, I don’t know. I think it’s right still because,” so of course, because there are other driving forces, it’s not just one molecule. Lee Cronin (00:19:33): Now you start to consider two objects, you have a joint assembly space. And it’s not now, it’s a compromise between not just making A and B in the shortest path. You want to be able to make A and B in the shortest path, which might mean that A is slightly longer, compromise. So when you see slightly more nesting in the construction, when you take a given object, that can look longer. But that’s because the overall function is the object is still trying to be efficient. And this is still very hand wavy and maybe having no leg to stand on, but we think we’re getting somewhere with that. Lex Fridman (00:20:09): And there’s probably some parallelization, right? Lee Cronin (00:20:12): Yeah. Lex Fridman (00:20:12): So this is not sequential. The building is, I guess. Lee Cronin (00:20:17): No, you’re right. Lex Fridman (00:20:18): When you’re talking about complex objects, you don’t have to work sequentially. You can work in parallel, you can get your friends together and they can… Lee Cronin (00:20:25): Yeah, and the thing we’re working on right now is how to understand these parallel processes. Now there’s a new thing we’ve introduced called assembly depth. And assembly depth can be lower than the assembly index for a molecule when they’re cooperating together because exactly this parallel processing is going on. And my team have been working this out in the last few weeks because we’re looking at what compromises does nature need to make when it’s making molecules in a cell? And I wonder if maybe like, well, I’m always leaping out of my competence, but in economics, I’m just wondering if you could apply this in economic processes. It seems like capitalism is very good at finding shortest path every time. And there are ludicrous things that happen because actually the cost function has been minimized. Lee Cronin (00:21:15): And so I keep seeing parallels everywhere where there are complex nested systems where if you give it enough time and you introduce a bit of heterogeneity, the system readjusts and finds a new shortest path. But the shortest path isn’t fixed on just one molecule now. It’s in the actual existence of the object over time. And that object could be a city, it could be a cell, it could be a factory, but I think we’re going way beyond molecules and my competence so probably should go back to molecules, but hey. Lex Fridman (00:21:44): All right, before we get too far, let’s talk about the assembly equation. Okay. How should we do this? Let me just even read that part of the paper. We define assembly as the total amount of selection necessary to produce an ensemble of observed objects quantified using equation one. The equation basically has A on one side, which is the assembly of the ensemble, and then a sum from one to N, where N is the total number of unique objects. Lex Fridman (00:22:20): And then there is a few variables in there that include the assembly index, the copy number which we’ll talk about. That’s an interesting, I don’t remember you talking about that. That’s an interesting addition and I think a powerful one. It has to do with what, that you can create pretty complex objects randomly, and in order to know that they’re not random, that there’s a factory involved, you need to see a bunch of them. That’s the intuition there. It’s an interesting intuition and then some normalization. What else is and- Lee Cronin (00:22:54): N minus one, just to make sure that more than one object, one object could be a one-off and random. And then you have more than one identical object. That’s interesting. Lex Fridman (00:23:03): When there’s two of a thing. Lee Cronin (00:23:05): Two of a thing is super important, especially if the index assembly index is high. Lex Fridman (00:23:10): So we could say several questions here. One, let’s talk about selection. What is this term selection? What is this term evolution that we’re referring to? Which aspect of Darwinian evolution are we referring to? That’s interesting here. Lee Cronin (00:23:26): Yeah, so this is probably what the paper, we should talk about the paper for a second. The paper, what it did is it kind of annoyed, we didn’t know it. It got intention and obviously the angry people were annoyed. Lex Fridman (00:23:39): There’s angry people in the world. That’s good. Lee Cronin (00:23:41): So what happened is the evolutionary biologists got angry. We were not expecting that. We thought evolutionary biologists would be cool. I knew that some, not many, computational complexity people will get angry because I’ve kind of been poking them and maybe I deserved it, but I was trying to poke them in a productive way. And then the physicists kind of got grumpy because the initial conditions tell everything. The prebiotic chemist got slightly grumpy because there’s not enough chemistry in there. Then finally, when the creationist said it wasn’t creationist enough, I was like, “I’ve done my job.” Lex Fridman (00:24:13): You’re saying the physics, they say, because you’re basically saying that physics is not enough to tell the story of how biology emerges? Lee Cronin (00:24:22): I think so. Lex Fridman (00:24:22): And then they said a few physics is the beginning and the end of the story. Lee Cronin (00:24:29): So what happened is the reason why people put the phone down on the call of the paper, if you view reading the paper like a phone call, they got to the abstract and in the abstract- Lex Fridman (00:24:39): First sentence is pretty strong. Lee Cronin (00:24:40): The first two sentences caused everybody- Lex Fridman (00:24:42): Scientists have grappled with reconciling biological evolution with the immutable laws of the universe defined by physics. Lee Cronin (00:24:51): True, right? There’s nothing wrong with that statement. Totally true. Lex Fridman (00:24:55): Yeah. These laws underpin life’s origin, evolution, and the development of human culture and technology, yet they do not predict the emergence of these phenomena. Wow. First of all, we should say the title of the paper, this paper was accepted and published in Nature. The title is Assembly Theory Explains and Quantifies Selection and Evolution, very humble title. And the entirety of the paper, I think, presents interesting ideas, but reaches high. Lee Cronin (00:25:26): I am not… I would do it all again. This paper was actually on the pre-print server for over a year. Lex Fridman (00:25:33): You regret nothing? Lee Cronin (00:25:34): Yeah. Lee Cronin (00:25:35): I think, yeah, I don’t regret anything. Lex Fridman (00:25:37): You and Frank Sinatra did it your way. Lee Cronin (00:25:39): What I love about being a scientist is sometimes because I’m a bit dim and I don’t understand what people are telling me, I want to get to the point. This paper says, “Hey, the laws of physics are really cool, the universe is great, but they don’t really, it’s not intuitive that you just run the standard model and get life out.” I think most physicists might go, “Yeah, it’s not just, we can’t just go back and say that’s what happened.” Because physics can’t explain the origin of life yet. That doesn’t mean it won’t or can’t. Okay. Just to be clear. Sorry intelligent designers, we are going to get there. Lee Cronin (00:26:16): Second point, we say that evolution works, but we don’t know how evolution got going. So biological evolution and biological selection. So for me, this seems like a simple continuum. So when I mentioned selection and evolution in the title, I think, and in the abstract, we should have maybe prefaced that and said non-biological selection and non-biological evolutions. And then that might have made it even more crystal clear. But I didn’t think that biology, evolutionary biology, should be so bold to claim ownership of selection and evolution. Lee Cronin (00:26:49): And secondly, a lot of evolutionary biologists seem to dismiss the origin of life question and just say it’s obvious. And that causes a real problem scientifically because two different, when the physicists are like, ” We own the universe. The universe is good, we explain all of it, look at us.” And even biologists say, “We can explain biology.” And the poor chemists in the middle going, “But hang on.” Lee Cronin (00:27:12): And this paper kind of says, “Hey, there is an interesting disconnect between physics and biology. And that’s at the point at which memories get made in chemistry through bonds. And hey, let’s look at this close and see if we can quantify it.” So yeah, I never expected the paper to get that much interest. And still, it’s only been published just over a month ago now. Lex Fridman (00:27:38): So just to link on the selection, what is the broader sense of what selection means? Lee Cronin (00:27:46): Yeah, that’s really good. For selection, so I think for selection, so this is where for me, the concept of an object is something that can persist in time and not die, but basically can be broken up. So if I was going to kind of bolster the definition of an object, so if something can form and persist for a long period of time under an existing environment that could destroy other, and I’m going to use anthropomorphic terms, I apologize, about weaker objects or less robust, then the environment could have selected that. Lee Cronin (00:28:30): So good chemistry examples, if you took some carbon and you made a chain of carbon atoms, whereas if you took some, I don’t know, some carbon, nitrogen and oxygen and made change from those, you’d start to get different reactions and rearrangements. So a chain of carbon atoms might be more resistant to falling apart under a acidic or basic conditions versus another set of molecules. So it survives in that environment. So the acid pond, the resistant molecule can get through. And then that molecule goes into another environment. So that environment now maybe being acid pond is a basic pond or maybe it’s an oxidizing pond. And so if you’ve got carbon and it goes an oxidizing pond, maybe the carbon starts to oxidize and break apart. So you go through all these kind of obstacle courses if you like, given by reality. So selection is the ability happens when object survives in an environment for some time. Lee Cronin (00:29:33): And this is the thing that’s super subtle. The object has to be continually being destroyed and made by process. So it’s not just about the object now, it’s about the process and time that makes it because a rock could just stand on the mountain side for 4 billion years and nothing happened to it. And that’s not necessarily really advanced selection. So for selection to get really interesting, you need to have a turnover in time. You need to be continually creating objects, producing them, what we call discovery time. So there’s a discovery time for an object. Lee Cronin (00:30:07): When that object is discovered, if it’s say a molecule that can then act on itself or the chain of events that caused itself to bolster its formation, then you go from discovery time to production time and suddenly you have more of it in the universe. So it could be a self-replicating molecule and the interaction of the molecule in the environment, in the warm little pond or in the sea or wherever in the bubble could then start to build a proto factory, the environment. Lee Cronin (00:30:34): So really to answer your question, what the factory is, the factory is the environment, but it’s not very autonomous, it’s not very redundant. There’s lots of things that could go wrong. So once you get high enough up the hierarchy of networks, of interactions, something needs to happen that needs to be compressed into a smaller volume and made resistant robust because in biology, selection and evolution is robust that you have error correction built in. You have really, there’s good ways of basically making sure propagation goes on. Lee Cronin (00:31:07): So really the difference between inorganic, antibiotic selection and evolution and evolution and stuff in biology is robustness the ability to propagate, the ability to survive in lots of different environments. Whereas our poor little inorganic sole molecule, whatever, just dies in lots of different environments. So there’s something super special that happens from the inorganic molecule in the environment that kills it to where you’ve got evolution and cells can survive everywhere. Lex Fridman (00:31:44): How special is that? How do you know those kinds of evolution factors aren’t everywhere in the universe? Lee Cronin (00:31:51): I don’t, and I’m excited because I think selection isn’t special at all. I think what is special is the history of the environments on earth that gave rise to the first cell that now has taken all those environments and is now more autonomous. And I would like to think that, you know this paper could be very wrong, but I don’t think it’s very wrong. I mean it’s certainly wrong, but it’s less wrong than some other ideas, I hope, right? And if this inspires us to go and look for selection in the universe because we now have an equation where we can say, we can look for selection going on and say, “Oh, that’s interesting. We seem to have a process. It’s giving us high copy number objects that also are highly complex, but that doesn’t look like life as we know it.” Lee Cronin (00:32:46): And we use that and say, “Oh, there’s a hydrothermal vent. Oh, there’s a process going on. There’s molecular networks,” because the assembly equation is not only meant to identify at the higher end advanced selection, what you get, I would call in biology super advanced selection. And even, you could use the assembly equation to look for technology and God forbid we could talk about consciousness and abstraction, but let’s keep it primitive, molecules and biology. So I think the real power of the assembly equation is to say how much selection is going on in this space. Lee Cronin (00:33:20): And there’s a really simple thought experiment I could do is you have a little Petri dish and on that Petri dish you put some simple food. So the assembly index of all the sugars and everything is quite low. So then, and you put a single cell of E. coli cell and then you say, “I’m going to measure the assembly in this, amount of assembly in the box.” So it’s quite low, but the rate of change of assembly, DADT will go [inaudible 00:33:47] sigmoidal as it eats all the food and the number of coli cells will replicate because they take all the food, they copy themselves, the assembly index of all the molecules goes up, up and up until the food is exhausted in the box. So now the E. coli’s stopped- Lee Cronin (00:34:00): … in the box. So now the E. coli’s stopped… I mean, die is probably a strong word. They stopped respiring because all the food is gone. But suddenly, the amount of assembly in the box has gone up gigantically because of that one E. coli factory has just eaten through, milled lots of other E. coli factories run out of food and stopped. And so that, looking at that… So in the initial box, although the amount of assembly was really small, it was able to replicate and use all the food and go up. And that’s what we’re trying to do in the lab, actually, is make those experiments and see if we can spot the emergence of molecular networks that are producing complexity, as we feed in raw materials and we feed a challenge, an environment. We try and kill the molecules. And really, that’s the main idea for the entire paper. Lex Fridman (00:34:52): Yeah, and see if you can measure the changes in the assembly index throughout the whole system. Lee Cronin (00:34:56): Yeah. Lex Fridman (00:34:57): Okay. What about, if I show up to a new planet, we’ll go to Mars or some other planet from a different solar system, how do we use assembly index there to discover alien life? Lee Cronin (00:35:11): Very simply, actually. Let’s say we’ll go to Mars with a mass spectrometer, with a sufficiently high resolution, so what you have to be able to do, so a good thing about mass spec is that you can select the molecule from the mass, and then if it’s high enough resolution, you can be more and more sure that you’re just seeing identical copies. You can count them. And then you fragment them and you count the number of fragments, and look at the molecular weight. And the higher the molecular weight and the higher the number of the fragments, the higher the assembly index. Lee Cronin (00:35:43): So if you go to Mars and you take a mass spec, with high enough resolution, and you can find molecules, a guide on earth, if you could find molecules, say, greater than 350 molecular weight, with more than 15 fragments, you have found artifacts that can only be produced, at least on earth, by life. And now you would say, “Oh, well, maybe the geological process.” I would argue very virulently that that is not the case. Lee Cronin (00:36:10): But we can say, “Look, if you don’t like the cutoff on earth, go up higher, 30, 100, because there’s going to be a point where you can find a molecule with so many different parts, the chances of you getting a molecule that has a hundred different parts and finding a million identical copies, that’s just impossible. That could never happen in an infinite set of universes. Lex Fridman (00:36:37): Can you just linger on this copy number thing? A million different copies, what do you mean by copies and why is the number of copies important? Lee Cronin (00:36:49): Yeah, that was so interesting. I always understood the copy number is really important, but I never explained it properly, for ages. And I kept having this, it goes back to this, if I give you a, I don’t know, a really complicated molecule, and I say it’s complicated, you could say, “Hey, that’s really complicated.” But is it just really random? Lex Fridman (00:37:12): Mm-hmm. Lee Cronin (00:37:14): So I realized that ultimate randomness and ultimate complexity are indistinguishable until you can see a structure in the randomness, so you can see copies. Lex Fridman (00:37:26): So copies implies structure. Lee Cronin (00:37:31): Yeah. The factory- Lex Fridman (00:37:34): I mean, there’s a deep profound thing in there. Because if you just have a random process, you’re going to get a lot of complex, beautiful, sophisticated things. Lee Cronin (00:37:46): Mm-hmm. Lex Fridman (00:37:47): What makes them complex in the way we think life is complex or, yeah, something like a factory that’s operating under a selection processes, there should be copies. Is there some looseness about copies? What does it mean for two objects to be equal? Lee Cronin (00:38:06): It’s all to do with the telescope or the microscope you’re using. And so, at the maximum resolution… The nice thing about chemists is they have this concept of the molecule and they’re all familiar with the molecule. And molecules, you can hold on your hand, lots of them, identical copies. A molecule is actually a super important thing in chemistry, to say, look, you can have a mole of a molecules, an Avogadro’s number of molecules, and they’re identical. What does that mean? That means that the molecular composition, the bonding and so on, the configuration is indistinguishable. You can hold them together. You can overlay them. Lee Cronin (00:38:43): So the way I do it is if I say, “Here’s a bag of 10 identical molecules, let’s prove they’re identical.” You pick one out of the bag and you basically observe it, using some technique, and then you take it away and then you take another one out. If you observe it using technique, you see no differences. They’re identical. It’s really interesting to get right. Because if you take, say, two molecules, molecules can be in different vibrational rotational states. They’re moving all the time. Lee Cronin (00:39:09): So in this respect, identical molecules have identical bonding. In this case, we don’t even talk about chirality, because we don’t have a chirality detector. So two identical molecules in one conception, assembly theory, basically considers both hands as being the same. But, of course, they’re not, they’re different. As soon as you have a chiral distinguisher to detect the left and the right hand, they become different. And so, it’s to do with the detection system that you have and the resolution. Lex Fridman (00:39:39): So I wonder if there’s an art and science to the, which detection system is used when you show up to a new planet. Lee Cronin (00:39:49): Yeah. Yeah, yeah. Lex Fridman (00:39:49): So you’re talking about chemistry a lot today. We have standardized detection systems of how to compare molecules. So when you start to talk about emojis and language and mathematical theorems and, I don’t know, more sophisticated things at different scale, at a smaller scale than molecules, at a larger scale than molecules, what detection… If we look at the difference between you and me, Lex and Lee, are we the same? Are we different? Lee Cronin (00:40:24): Sure. I mean, of course we’re different close up, but if you zoom out a little bit, we will morphologically look the same. High in characteristics, hair length, stuff like that. Lex Fridman (00:40:35): Well, also, the species and- Lee Cronin (00:40:37): Yeah, yeah, yeah. Lex Fridman (00:40:38): … and also there’s a sense why we’re both from earth. Lee Cronin (00:40:42): Yeah, I agree. I mean, this is the power of assembly theory in that regard. So if everything… So the way to look at it, if you have a box of objects, if they’re all indistinguishable, then using your technique, what you then do is you then look at the assembly index. Now, if the assembly index of them is really low and they’re all indistinguishable, then they’re telling you that you have to go to another resolution. So that would be, it is a sliding scale. It’s nice. Lex Fridman (00:41:15): Got it. So those two are attentional with each other. Lee Cronin (00:41:18): Yeah. Lex Fridman (00:41:18): The number of copies and the assembly index. Lee Cronin (00:41:20): Yeah. Lex Fridman (00:41:22): That’s really, really interesting. So, okay. So you show up to a new planet, you’ll be doing what? Lee Cronin (00:41:28): I would do mass spec. I would bring- Lex Fridman (00:41:30): On a sample of what? First of all, how big of a scoop do you take? Do you just take a scoop? What… So we’re looking for primitive life. Lee Cronin (00:41:42): I would look… Yeah, so if you’re just going to Mars or Titan or Enceladus, or somewhere, so a number of ways of doing it. So you could take a large scoop or you go through the atmosphere and detect stuff. You could make a life meter, right? One of Sarah’s colleagues at ASU, Paul Davies, keeps calling it a life meter, which is quite a nice idea. Because you think about it, if you’ve got a living system that’s producing these highly complex molecules and they drift away, and they’re in a highly demanding environment, they could be burnt, right? So they could just be falling apart. So you want to sniff a little bit of complexity and say warmer, warmer, warmer. Oh, we’ve found life, we found the alien. We’ve found the alien Elon Musk, smoking a joint in the bottom of the cave on Mars, or Elon himself, whatever, right? Lex Fridman (00:41:42): Yeah. Mm-hmm. Lee Cronin (00:42:34): You say, “Okay, found it.” So what you can do is a mass spectrometer, you could just look for things in the gas phase or you go on the surface, drill down, because you want to find molecules that are… Well, you’ve either got to find the source, living system, because the problem with just looking for complexity is it gets burnt away. So in a harsh environment on, say, on the surface of Mars, there’s a very low probability that you’re going to find really complex molecules because of all the radiation and so on. Lee Cronin (00:43:05): If you drill down a little bit, you could drill down a bit into soil that’s billions of years old. Then I would put in some solvent, water, alcohol, or something, or take a scoop, make it volatile, put it into the mass spectrometer and just try and detect high complexity, high abundant molecules. And if you get them, hey, presto, you can have evidence of life. Wouldn’t that then be great if you could say, “Okay, we’ve found evidence of life, now we want to keep the life meter, keep searching for more and more complexity,” until you actually find living cells. And you can get those new living cells and then you could bring them back to earth or you could try and sequence them. You could see that they have different DNA and proteins. Lex Fridman (00:43:48): Go along the gradient of the life meter. Lee Cronin (00:43:50): Exactly. Lex Fridman (00:43:50): How would you build a life meter? Let’s say we’re together, starting new- Lee Cronin (00:43:50): Just a mass spectrometer. Lex Fridman (00:43:56): … new company, launching a life- Lee Cronin (00:43:56): Mass spectrometer would be the first way of doing it. Just take- Lex Fridman (00:43:59): No, no, no, but that’s one of the major components of it. But I’m talking about- Lee Cronin (00:44:03): I would- Lex Fridman (00:44:04): … if it’s a device and branding, logo we got to talk about- Lee Cronin (00:44:04): All right. Lex Fridman (00:44:08): … that’s later. But what’s the input and what’s the… How do you get to the metered output? Lee Cronin (00:44:15): So I would take a… So my life meter, our life meter. There you go. Lex Fridman (00:44:21): Oh, thank you. Lee Cronin (00:44:21): Yeah, you’re welcome, would have both infrared and mass spec. It would have two ports so it could shine a light. And so, what it would do is you would have a vacuum chamber and you would have an electrostatic analyzer, and you’d have a monochromator to producing infrared. You’d add the sum. So you’d take a scoop of the sample, put it in the life meter, it would then add a solvent or heat up the sample so some volatiles come off. The volatiles would then be put into the mass… into electrostatic trap, and you’d weigh the molecules and fragment them. Alternatively, you’d shine infrared light on them and you count number of bands. But you’d have to, in that case, do some separation, because you want to separate… And so, in mass spec, it’s really nice and convenient, because you can separate electrostatically, but you need to have that. Lex Fridman (00:45:12): Can you do it in real time? Lee Cronin (00:45:13): Yeah, pretty much. Pretty much, yeah. So let’s go all the way back. Okay, we’re really going to get this- Lex Fridman (00:45:13): Let’s go. Lee Cronin (00:45:18): … Lex’s life… Lex and Lee’s life meter. Lex Fridman (00:45:20): No, I like Lex and Lee. It’s a good ring to it. Lee Cronin (00:45:25): All right. So you have a vacuum chamber, you have a little nose. The nose would have some, a packing material. So you would take your sample, add it onto the nose, add a solvent or a gas. It would then be sucked up the nose and that would be separated, using what we call chromatography. And then as each band comes off the nose, we’ll then do mass spec and infrared. And in the case of the infrared, count the number of bands, in the case of mass spec, count the number of fragments and weigh it. Lee Cronin (00:45:56): And then the further up in molecular weight range for the mass spec, and the number of bands, you go up and up and up from the dead, interesting, interesting, over the threshold, oh my gosh, earth life, and then right up to the batshit crazy, this is definitely alien intelligence that’s made this life, right? You could almost go all the way there. Same in the infrared. And pretty simple. Lee Cronin (00:46:18): The thing that is really problematical is that for many years, decades, what people have done, and I can’t blame them, is they’ve rather, they’ve been obsessing about small biomarkers that we find on earth, amino acids, like single amino acids or evidence of small molecules and these things, and looking for those while I’m looking for complexity. The beautiful thing about this is you can look for complexity without earth chemistry bias or earth biology bias. So assembly theory is just a way of saying, hey, complexity in abundance is evidence of selection. That’s how our universal life meter will work. Lex Fridman (00:46:59): Complexity in abundance is evidence of selection. Okay. So let’s apply our life meter to earth. If we were just to apply assembly index measurements to earth, what kind of stuff are going to get? What’s impressive about- Lee Cronin (00:46:59): So- Lex Fridman (00:47:26): … some of the complexity on earth? Lee Cronin (00:47:28): … So we did this a few years ago when I was trying to convince NASA and colleagues that this technique could work. And honestly, it’s so funny, because everyone’s like, “No, it ain’t going to work.” And it was just like, because the chemists were saying, “Of course there are complicated molecules out there you can detect that just form randomly.” And I was like, “Really?” That was like, it’s a bit like, I don’t know, someone saying, “Of course, Darwin’s textbook was just written randomly by some monkeys and a typewriter.” Just for me, it was like, “Really?” And I’ve pushed a lot on the chemists now. And I think most of them are on board, but not totally. I really had some big arguments, but the copy number caught there. Because I think I confused the chemists by saying one-off. And then when I made clear about the copy number, I think that made it a little bit easier. Lex Fridman (00:48:16): Just to clarify, a chemist might say that, of course out there, outside of earth there’s complex molecules? Lee Cronin (00:48:24): Yes. Lex Fridman (00:48:24): Okay. And then you’re saying, “Wait a minute, that’s like saying, ‘Of course there’s aliens out there.'” Like you- Lee Cronin (00:48:31): Yeah, exactly that. Lex Fridman (00:48:32): Okay. Lee Cronin (00:48:32): Exactly. Lex Fridman (00:48:34): You clarify that, that’s actually a very interesting question and we should be looking for complex molecules of which the copy number is two or greater. Lee Cronin (00:48:45): Yeah, exactly. So on earth, so coming back to earth, what we did is we took a whole bunch of samples and we were running prebiotic chemistry experiments in the lab. We took various inorganic minerals and extracted them, look at the volatile. Because there’s a special way of treating minerals and polymers in assembly theory. In this, in our life machine, we’re looking at molecules. We don’t care about polymers, because they don’t, they’re not volatile. You can’t hold them. How can you make… If you can’t discern that they’re identical, then it’s very difficult for you to work out if this, undergone selection or they’re just a random mess. Lee Cronin (00:49:26): Same with some minerals, but we can come back to that. So basically what you do, we’ve got a whole loads of samples, inorganic ones, we got a load of, we got Scotch whiskey and also got- Lex Fridman (00:49:36): Nice. Lee Cronin (00:49:36): … took a odd bag, which is one of my favorite whiskeys, which is very peaty. And another- Lex Fridman (00:49:41): What’s peaty mean? Lee Cronin (00:49:42): It is like… So the way that in Scotland, in Isla, which is a little island, the scotch, the whiskey is let to mature in barrels. It’s said that the peat, the complex molecules in the peat find their way through into the whiskey, and that’s what gives it this intense brown color and really complex flavor. It’s literally molecular complexity that does that. And so, vodka’s the complete opposite. It’s just pure, right?- Lex Fridman (00:50:16): So the better the whiskey, the higher the assembly index, the higher the assembly index, the better the whiskey. Lee Cronin (00:50:20): I mean, I really love deep, peaty Scottish whiskeys. Near my house, there is one of the lowland distilleries, called Glengoyne. It’s still beautiful whiskey but not as complex. So for fun, I took some Glengoyne whiskey in our bag and put them into the mass spec and measured the assembly index. I also got E. coli. So the way we do it, take the E. coli, break the cell apart, take it all apart. And also got some beer. And people were ridiculing us saying, “Oh, beer is evidence of complexity.” Lee Cronin (00:50:53): And one of the computational complexity people, it was just throwing, yeah… He’s very vigorous in his disagreement of assembly theory, was just saying, “You don’t know what you’re doing. Even beer is more complicated than human.” What he didn’t realize is that it’s not beer, per se, it’s taking the yeast extract, taking the extract, breaking the cells, extracting the molecules, and just looking at the profile of the molecules, see if there’s anything over the threshold. And we also put in a really complex molecule, Taxol. Lee Cronin (00:51:24): So we took all of these, but also NASA gave us, I think, five samples, and they wouldn’t tell us what they are. They said, “No, we don’t believe you’re going to get this to work.” And they really gave us some super complex samples. And they gave us two fossils, one that was a million years old and one was at 10,000 years old, something from Antarctica, seabed. They gave us some Murchison and meteorite, and a few others. Put them through the system. So we took all the samples, treat them all identically, put them into mass spec, fragmented them, counted. Lee Cronin (00:51:56): And in this case, implicit in the measurement was we, in mass spec, you only detect peaks when you’ve got more than, say, let’s say 10,000 identical molecules. So the copy number’s already baked in, but wasn’t quantified, which is super important there. This was in the first paper. Because I was like, it’s abundant, of course. Lee Cronin (00:52:17): And when you then took it all out, we found that the biological samples gave you molecules that had an assembly index greater than 15. And all the abiotic samples were less than 15. And then we took the NASA samples and we looked at the ones that were more than 15, less than 15, and we gave them back to NASA, and they’re like, “Oh, gosh. Yep, dead, living, dead, living. You got it.” And that’s what we found on earth. Lex Fridman (00:52:44): That’s a success. Lee Cronin (00:52:45): Yeah. Oh yeah, resounding success. Lex Fridman (00:52:48): Can you just go back to the beer and the E. coli? So what’s the assembly index on those? Lee Cronin (00:52:54): So what you were able to do is, the assembly index of… We found high assembly index molecules originating from the beer sample and the E. coli sample. Lex Fridman (00:53:08): Yeast in the beer. Lee Cronin (00:53:10): I didn’t know which one was higher. We didn’t really do any detail there. Because now we are doing that. Because one of the things we’ve done, it’s a secret, but I can tell you. I think it’s- Lex Fridman (00:53:23): Nobody’s listening. Lee Cronin (00:53:25): … well, is that we’ve just mapped the tree of life using assembly theory, because everyone said, ” Oh, you can’t do anything from biology.” And what we’re able to do is, so I think there’s three, well, two ways of doing tree of life… Well, three ways actually. Lex Fridman (00:53:38): What’s the tree of life? Lee Cronin (00:53:39): So the tree of life is basically tracing back the history of life on earth, all the different species, going back who evolved from what. And it all goes all the way back to the first life forms, and they branch off. And you have plant kingdom, the animal kingdom, the fungi kingdom, and different branches all the way up. And the way this was classically done, and I’m no evolutionary biologist. The evolutionary biologists tell me every day, at least 10 times… I want to be one though. I like biology, it’s cool. Lex Fridman (00:54:12): Yeah, it’s very cool. Lee Cronin (00:54:13): But basically- Lex Fridman (00:54:14): Evolutionary. Lee Cronin (00:54:16): … What Darwin and Mendeleev, and all these people do is just, they draw pictures and they [inaudible 00:54:20] taxa. They were able to draw pictures and say, “Oh, these look like common classes.” Lex Fridman (00:54:26): Yeah. Lee Cronin (00:54:26): Then… Lex Fridman (00:54:29): They’re artists really. They’re just… Lee Cronin (00:54:32): They were able to find out a lot, right? And looking at vertebrates and vertebrates, Cambrian explosion and all this stuff. And then came the genomic revolution and suddenly, everyone used gene sequencing. And Craig Venter’s a good example. I think he’s gone around the world in his yacht, just picking up samples, looking for new species. Where he’s just found new species of life just from sequencing. It’s amazing. So you have taxonomy, you have sequencing, and then you can also do a little bit of molecular archeology, like measure the samples and form some inference. Lee Cronin (00:55:08): What we did is we were able to fingerprint… So we took a load of random samples from all of biology and we used mass spectrometry. And what we did now is not just look for individual molecules, but we looked for coexisting molecules where they had to look at their joint assembly space. And we were able to cut them apart and undergo recursion in the mass spec and infer some relationships. And we’re able to recapitulate the tree of life using mass spectroscopy, no sequencing and no drawing. Lex Fridman (00:55:41): All right. Can you try to say that again, with a little more detail? So recreating, what does it take to recreate the tree of life? What does the reverse engineering process look like here? Lee Cronin (00:55:52): So what you do is you take an unknown sample, you bung it into the mass spec, you get… Because this comes from what you’re asking, what do you see in E. coli? Lex Fridman (00:56:00): Mm-hmm. Lee Cronin (00:56:00): And so, in E. coli, you don’t just see, it’s not the most sophisticated cells on earth make the most sophisticated molecules. It is the coexistence of lots of complex molecules above a threshold. And so, what we realized is you could fingerprint different life forms. So fungi make really complicated molecules. Why? Because they can’t move. They have to make everything onsite. Lee Cronin (00:56:24): Whereas, some animals are lazy, they can just go eat the fungi, and they don’t need to make very much. And so, what you do is you look at the, so you take, I don’t know, the fingerprint, maybe the top number of high molecular weight molecules you find in the sample, you fragment them to get their assembly indices, and then what you can do is you can infer common origins of molecules. You can do a molecular… When the reverse engineering of the assembly space, you can infer common roots and look at what’s called the joint assembly space. Lee Cronin (00:57:02): But let’s translate that into the experiment. Take a sample, bung it in the mass spec, take the top, say, 10 molecules, fragment them, and that gives you one fingerprint. Then you do it for another sample, you get another fingerprint. Now the question is you say, “Hey, are these samples the same or different?” And that’s what we’ve been able to do and by basically looking at the assembly space that these molecules create. Without any knowledge of assembly theory, you are unable to do it. With a knowledge of assembly theory, you can reconstruct the tree. Lex Fridman (00:57:35): How does knowing if they’re the same or different give you the tree? Lee Cronin (00:57:38): Let’s go to two leaves on different branches on the tree, right? What you can do, by counting the number of differences, you can estimate how far away their origin was. Lex Fridman (00:57:48): Got it. Lee Cronin (00:57:49): And that’s what we do, and it just works. But when we realized you could even use assembly theory to recapitulate the tree of life with no gene sequencing, we were like, “Huh.” Lex Fridman (00:57:58): So this is looking at samples that exist today in the world. Lee Cronin (00:58:01): Yeah. Lex Fridman (00:58:01): What about things that are no longer exist? I mean, the tree contains information about the past- Lee Cronin (00:58:08): I would- Lex Fridman (00:58:09): … some of it is gone. Lee Cronin (00:58:11): Yeah, absolutely. I would love to get old fossil samples and apply assembly theory, mass spec, and see if we can find new forms of life that have, that are no longer amenable to gene sequencing, because the DNA is all gone. Because DNA and RNA’s quite unstable, but some of the more complex molecules might be there. They might give you a hint something new, or wouldn’t it be great if you- Lex Fridman (00:58:11): I understand. Lee Cronin (00:58:33): … if you find a sample that’s worth really persevering and doing the proper extraction to PCR and so on and then sequence it, and then put it together- Lex Fridman (00:58:46): So when a thing dies, you can still get some information about its complexity. Lee Cronin (00:58:50): Yeah. And it appears that you can do some dating. Now there are really good techniques. There’s radiocarbon dating, there is longer dating, going looking at radioactive minerals and so on. And you can also, in bone, you can look at… What happens after something dies, is you get what’s called racemization, where the chirality in the polymers basically changes and you get decomposition, and the deviation from the pure enantiomer to the mixture, you can have, it gives you a timescale on it, half-life, so you can date when it died. I want to use assembly theory to see if I can use it and date death and things, and trace the tree of life and also decomposition of molecules. Lex Fridman (00:59:45): Do you think it’s possible? Lee Cronin (00:59:46): Oh yeah, without a doubt. It may not be better than what… I was just at conference where there’s some brilliant people, looking isotope enrichment and looking at how life enriches isotopes, and they’re really sophisticated stuff that they’re doing. But I think there’s some fun to be had there, because it gives you another dimension of dating. How old is this molecule in terms of, or more importantly, how long ago was this molecule produced by life? More complex the molecule, the more prospect for decomposition, oxidation, reorganization, loss of chirality, and all that jazz. Lee Cronin (01:00:21): But what life also does is it enriches. As you get older, the amount of carbon-13 in you goes up, because of the way the bonding is in carbon-13. So it has a slightly different strength, bond strength, than you. It’s called a kinetic isotope effect. So you can literally date how old you are or when you stop metabolizing. So you could date someone’s… how old they are, I think. I’m making this up, this might be right, but I think it’s roughly right. The amount of carbon-13 you have in you, you can estimate how old you are. Lex Fridman (01:00:56): How old living humans are, or living organism? Lee Cronin (01:01:00): Yeah, yeah. You could say, “Oh, this person is 10 years old and this person is 30 years old, because they’ve been metabolizing more carbon and they’ve accumulated it.” That’s the basic idea. It’s probably completely wrong timescale- Lex Fridman (01:01:10): Signatures of chemistry are fascinating. So you’ve been saying a lot of chemistry examples for assembly theory. What if we zoom out and look at a bigger scale of an object, like really complex objects, like humans or living organisms that are made up of millions or billions of other organisms, how do you try to apply assembly theory to that? Lee Cronin (01:01:38): At the moment, we should be able to do this to morphology in cells. So we’re looking at cell surfaces, and really, I’m to trying to extend further. It’s just that we work so hard to get this paper out and people to start discussing the ideas, but it’s kind of funny, because I think the penny is falling on this. So yeah- Lex Fridman (01:02:03): What does that even… What’s it mean for a penny to be- Lee Cronin (01:02:06): I mean, no, the penny’s dropped, right? A lot of people were like, “It’s rubbish, it’s rubbish. You’ve insulted me. It’s wrong.” I mean, the paper got published on the 4th of October. It had 2.3 million engagements on Twitter and it’s been downloaded over a few hundred thousand times. And someone actually said to me, wrote to me and said, “This is an example of really bad writing and what not to do.” And I was like, if all of my papers got read this much, because that’s the objective, if I have a publishing a paper, I want people to read it. I want to write that badly again. Lex Fridman (01:02:37): Yeah. I don’t know, what’s the deep insight here about the negativity in the space. I think it’s probably the immune system of the scientific community, making sure that there’s no bullshit that gets published and that it can overfy, it can do a lot of damage. It can shut down conversations in a way that’s not productive. Lee Cronin (01:02:54): And I go back, I mean, I’ll answer your question about the hierarchy in assembly, but let’s go back to the perception people saying the paper was badly written. I mean, of course we could improve it. We could always improve the clarity. Lex Fridman (01:03:04): Let’s go there before we go to the hierarchy. Lee Cronin (01:03:08): Yeah. Lex Fridman (01:03:08): It has been criticized quite a bit, the paper. What has been some criticism that you’ve found most powerful, that you can understand and can you explain it? Lee Cronin (01:03:23): Yes. The most exciting criticism came from the evolutionary biologist telling me that he thought that origin of life was a solved problem. And I was like, “Whoa, we’re really onto something, because it’s clearly not.” And when you poked them on that they just said, “No. You you don’t understand evolution.” And I said, “No, no, I don’t think you understand that evolution had to occur before biology and there’s a gap.” That was really for me, that misunderstanding, and that did cause an immune response, which was really interesting. Lee Cronin (01:03:56): The second thing was the fact that physicists, the physicists were actually really polite, really nice about it. But they just said, “Huh, we’re not really sure about the initial conditions thing. But this is a really big debate that we should certainly get into, because the emergence of life was not encoded in the initial conditions of the universe.” And I think assembly theory shows why it can’t be. I’ll say that- Lex Fridman (01:04:23): Okay. Sure. If you could say that again. Lee Cronin (01:04:27): The origin of, the emergence of life was not and cannot, in principle, be encoded in the initial conditions of the universe. Lex Fridman (01:04:35): Just to clarify what you mean by life is what, high assembly index objects? Lee Cronin (01:04:39): Yeah. And this goes back to your favorite subject. Lex Fridman (01:04:43): What’s that? Lee Cronin (01:04:43): Time. Lex Fridman (01:04:47): Right. So why? What does time have to do with it? Lee Cronin (01:04:50): I mean, probably we can come back to it later, but I think it might be, if we have time. Lex Fridman (01:04:56): Yeah. Lee Cronin (01:04:56): But I think that, I think I now understand how to explain how… Lots of people got angry with the assembly paper, but also, the ramifications of this is how time is fundamental in the universe and this notion of commentorial spaces. And there are so many layers on this, but you have to become an… I think you have to become an intuitionist mathematician and you have to abandon Platonic mathematics. And also, Platonic mathematics is left physics astray, but there’s a lot to unpack there. So we can go to the- Lex Fridman (01:05:34): Platonic mathematic, okay. It’s okay, the evolutionary biologists criticized, because the origin of life is understood and not, it doesn’t require an explanation that involves physics. Lee Cronin (01:05:51): Yeah. It- Lex Fridman (01:05:51): That’s their statement. Lee Cronin (01:05:54): Well, I mean, they said lots of confusing statements. Basically, I realized the evolutionary biology community that were vocal, and some of them were really rude, really spiteful, and needlessly so, right? Because look, I didn’t, people misunderstand publication as well. Some of the peoples have said, “How dare this be published in Nature. What a terrible journal.” And it really, and I watched, said to people, “Look, this is a brand new idea that’s not only potentially going to change the way we look at biology, it’s going to change the way we look at the universe.” Lee Cronin (01:06:36): And everyone’s saying, “How dare, how dare you be so grandiose?” I’m like, “No, no, no. This is not hype. We’re not saying we’ve invented some, I don’t know, we’ve discovered a alien in a closet somewhere, just for hype. We genuinely mean this to genuinely have the impact or asked the question. And the way people jumped on that was a really bad precedent for young people who want to actually do something new. Lee Cronin (01:07:02): Because this makes a bold claim, and the chances are that it’s not correct. But what I wanted to do is a couple of things. Is I wanted to make a bold claim that was precise and testable and correctable. Not another wooly information-in-biology argument, information-churring machine, blah, blah, blah, blah, blah. A concrete series of statements that can be falsified and explored, and either the theory could be destroyed or built upon. Lex Fridman (01:07:32): Well, what about the criticism of you’re just putting a bunch of sexy names on something that’s already obvious? Lee Cronin (01:07:42): Yeah, that’s really good. So the assembly index of a molecule is not obvious. No one had measure it before. And no one has thought to quantify selection, complexity, and copy number before, in such a primitive, quantifiable way. I think the nice thing about this paper- Lee Cronin (01:08:00): … quantifiable way. I think the nice thing about this paper, this paper is a tribute to all the people that understand that biology does something very interesting. Some people call it negentropy. Some people call it, think about organizational principles that lots of people were not shocked by the paper because they’d done it before. A lot of the arguments we got, some people said, “Oh, it’s rubbish. Oh, by the way, I had this idea 20 years before.” I was like, ” Which one?” Is it the rubbish part or the really revolutionary part. Lee Cronin (01:08:35): So this kind of plucked two strings at once. It plucked the there is something interesting that biology are, we can see around this, but we haven’t quantified yet. And what this is, is the first stab at quantifying that, so the fact that people said “This is obvious.” But if it’s obvious, why have you not done it? Lex Fridman (01:08:58): Sure. But there’s a few things to say there. One is, this is in part of philosophical framework because it’s not like you can apply this generally to any object in the universe. It’s very chemistry focused. Lee Cronin (01:09:15): Yeah, well, I think you will be able to, we just haven’t got there robustly. So if we can say how can we… Let’s go up a level. So if we go up from level, let’s go up from molecules to cells because you would jump to people and I jump to emoticons and both are good and they will be assembly… Lex Fridman (01:09:30): Lets stick with cells, yeah. Good point. Lee Cronin (01:09:34): If we go from molecules to assemblies and let’s take acellular assembly. A nice thing about a cell is you can tell the difference between a eukaryote and a prokaryote, right? The organalles are specialized differently when then look at the cell surface and the cell surface has different glycosylation patterns and these cells will stick together. Now let’s go up a level in multicellular creatures you have cellular differentiation. Lee Cronin (01:09:57): Now if you think about how embryos develop, you go all the way back, those cells undergo differentiation on a causal way that’s biomechanically a feedback between the genetics and biomechanics. I think we can use assembly theory to apply to tissue types. We can even apply it to different cell disease types. So that’s what we’re doing next. But we are trying to walk… The thing is, I’m trying to, I want a leap ahead to go, whoa, we apply it to culture. Clearly you can apply it to memes and culture. And we’ve also applied to assembly theory to CA’s and not as you think… Lex Fridman (01:09:57): Cellular automaton, by the way. Lee Cronin (01:10:34): Yeah, yeah. Cellular automaton, not just as you think. Different CA rules were invented by different people at different times. And one of my coworkers, very talented chap basically was like, “Oh, I can realize that different people had different ideas with different rules and they copied each other and made slightly different cellular automaton rules and looked at them online.” And so he was able to refer an assembly index and copy number of rule, whatever, doing this thing. But I digress. Lee Cronin (01:11:04): But it does show you can apply it at a higher scale. So what do we need to do to apply assembly theory to things? We need to agree, there’s a common set of building blocks. So in a cell, well, in a multicellular creature, you need to look back in time. So there is the initial cell, which the creature is fertilized and then starts to grow and then there is cell differentiation. And you have to then make that causal chain both on those. So that requires development of the organism in time. Or if you look at the cell surfaces and the cell types, they’ve got different features on the cell walls and inside the cell. So we’re building up, but obviously I want a leap to things like emoticons, language, mathematical theorems. Lex Fridman (01:11:54): But that’s a very large number of steps to get from a molecule to the human brain. Lee Cronin (01:12:01): Yeah, and I think they are related, but in hierarchies of emergence. So you shouldn’t compare them. I mean the assembly index of a human brain, what does that even mean? Well, maybe we can look at the morphology of the human brain, say all human brains have these number of features in common. If they have those number… And then let’s look at a brain in a whale or a dolphin or a chimpanzee or a bird and say, “Okay, let’s look at the assembly indices and number of features in these.” And now the copy number is just the number of how many birds are there, how many chimpanzees are there, how many humans are there? Lex Fridman (01:12:35): But then you have to discover for that the features that you would be looking for. Lee Cronin (01:12:39): Yeah, and that means you need to have some idea of the anatomy. Lex Fridman (01:12:43): But is there an automated way to discover features? Lee Cronin (01:12:46): I guess so. And I think this is a good way to apply machine learning and image recognition just to basically characterize things. Lex Fridman (01:12:55): To apply compression to it, to see what emerges, and then use the features used as part of the compression, as the measurement of… As the thing that is searched for when you’re measuring assembly index and copy number. Lee Cronin (01:13:09): And the compression has to be, remember the assembly universe, which is you have to go from assembly possible to assembly contingent and that jump from… Because assembly possible all possible brains, all possible features all the time. But we know that on the tree of life and also on the lineage of life, going back to Luca, the human brain just didn’t spring into existence yesterday, it’s a long lineage of brains going all the way back. And so if we could do assembly theory to understand the development, not just in evolutionary history, but in biological development, as you grow, we are going to learn something more. Lex Fridman (01:13:45): What would be amazing is if you can use assembly theory, this framework to show the increase in the assembly index associated with, I don’t know, cultures or pieces of text like language or images and so on and illustrate without knowing the data ahead of time, just kind like you did with NASA that you were able to demonstrate that it applies in those other contexts. I mean, and that probably wouldn’t at first, and you have to evolve the theory somehow. You have to change it, you have to expand it. Lee Cronin (01:14:21): I think so. Lex Fridman (01:14:24): I guess this is as a paper, a first step in saying, okay, “Can we create a general framework for measuring complexity of objects. For measuring life, the complexity of living organisms.” Lee Cronin (01:14:39): Yeah. Lex Fridman (01:14:39): That’s what this is reaching for. Lee Cronin (01:14:41): That is the first step. And also to say, look, we have a way of quantifying selection and evolution in a fairly, not mundane, but a fairly mechanical way because before now… The ground truth for it was very subjective. Whereas here we’re talking about clean observables and there’s going to be layers on that. I mean, with collaborators right now, we already think we can do assembly theory on language. And not only that, wouldn’t it be great if we can figure out how under pressure language is going to involve and be more efficient? Because you’re going to want to transmit things. Lee Cronin (01:15:20): And again, it’s not just about compression, it is about understanding how you can make the most of the architecture you’ve already built. And I think this is something beautiful that evolution does. We are reusing those architectures. We can’t just abandon our evolutionary history. And if you don’t want to abandon your evolutionary history and you know that evolution has been happening, then assembly theory works. Lee Cronin (01:15:44): And I think that’s a key comment I want to make is that assembly theory is great for understanding when evolution has been used. The next jump is when we go to technology, because of course, if you take the M3 processor… I want to buy, I haven’t bought one yet. I can’t justify it, but I want it at some point. The M3 processor arguably is there’s quite a lot of features, a quite large number. The M2 came before it, then the M1 all the way back, you can apply assembly theory to microprocessor architecture. It doesn’t take a huge leap to see that. Lex Fridman (01:16:15): I’m a Linux guy, by the way. So your examples go way over my head. Lee Cronin (01:16:18): Yeah, well, whatever… Lex Fridman (01:16:19): Is that a fruit company of some sort? I don’t even know. Yeah, there’s a lot of interesting stuff to ask about language. Like you could look at… How would that work? You could look at GPT-1, GPT-2, GPT-3, 3, 5, 4, and try to analyze the kind of language it produces. I mean, that’s almost trying to look at assembly index of intelligence systems. Lee Cronin (01:16:45): Yeah, I mean I think the thing about large language models, and this is a whole hobbyhorse I have at the moment, is that obviously they’re all about… The evidence of evolution in the large language model comes from all the people that produced all the language. And that’s really interesting. And all the corrections in the Mechanical Turk, right? Lex Fridman (01:17:15): Sure. But that’s part of the history, part of the memory of the system. Lee Cronin (01:17:20): Exactly. So it would be really interesting to basically use an assembly based approach to making language in a hierarchy. My guess is that we might be able to build a new type of large language model that uses assembly theory, that it has more understanding of the past and how things were created. Basically the thing with LLMs is like, everything everywhere, all at once, splat and make the user happy. So there’s not much intelligence in the model. The model is how the human interacts with the model. But wouldn’t it be great if we could understand how to embed more intelligence in the system? Lex Fridman (01:18:03): What do you mean by intelligence there? You seem to associate intelligence with history or memory? Lee Cronin (01:18:11): Yeah. I think selection produces intelligence. Lex Fridman (01:18:16): You’re almost implying that selection is intelligence. No. Lee Cronin (01:18:21): Kind of, I would go out in limb and say that, but I think it’s a little bit more, human beings have the ability to abstract and they can break beyond selection. And this is… Darwinian selection, because a human being doesn’t have to basically do trial and error, but they can think about it and say, “Oh, that’s a bad idea, won’t do that.” And then technologies and so on. Lex Fridman (01:18:39): So we escaped Darwinian evolution and now we’re onto some other kind of evolution, I guess? Higher level. Lee Cronin (01:18:46): And assembly theory will measure that as well, right? Because it’s all a lineage. Lex Fridman (01:18:50): Okay. Another piece of criticism or by way of question is how is assembly theory or maybe assembly index different from Kolmogorov complexity? So for people who don’t know, a Kolmogorov complexity of an object is the length of a shortest computer program that produces the object as output. Lee Cronin (01:19:10): Yeah, there seems to be a disconnect between the computational approach. So Kolmogorov measure requires a Turing machine, requires a computer, and that’s one thing. And the other thing is assembly theory is supposed to trace the process by which life evolution emerged, right? There’s a main thing there. There are lots of other layers. Lee Cronin (01:19:42): So Kolmogorov complexity, you can approximate Kolmogorov complexity, but it’s not really telling you very much about the actual… It’s really telling you about your dataset, compression of your dataset. Lex Fridman (01:20:00): Sure. Lee Cronin (01:20:00): And so that doesn’t really help you identify… The turtle in this case is the computer. And so what assembly theory does is, I’m going to say, it’s a trigger warning for anyone listening who loves complexity theory. I think that we’re going to show that AIT is a very important subset of assembly theory because here’s what happens. I think that assembly theory allows us to go understand when were selections occurring. Selection produces factories and things, factories in the end produce computers, and then algorithmic information theory comes out of that. The frustration I’ve had with looking at life through this kind of information theory is it doesn’t take into account causation. So the main difference between assembly theory and all these complexity measures is there’s no causal chain. And I think that’s the main… Lex Fridman (01:21:00): That’s the causal chain is at the core of assembly theory. Lee Cronin (01:21:06): Exactly. And if you’ve got all your data in a computer memory, all the data’s the same. You can access it in the same way. You don’t care. You just compress it. And you either look at the program runtime or the shortest program. And that for me is absolutely not capturing what it is. What selection does. Lex Fridman (01:21:28): But assembly theory looks at objects. It doesn’t have information about the object history. It’s going to try to infer that history by looking for the shortest history, right? The object doesn’t have a Wikipedia page that goes with it about its history. Lee Cronin (01:21:49): I would say it does in a way, and it is fascinating to look at. So you’ve just got the object and you have no other information about the object. What assembly theory allows you to do with just with the object is to, and the word infer is correct, I agree with infer. You say, well, that’s not the history. But something really interesting comes from this. Lee Cronin (01:22:10): The shortest path is inferred from the object. That is the worst case scenario if you have no machine to make it. So that tells you about the depth of that object in time. And so what assembly theory allows you to do is without considering any other circumstances, to say from this object, how deep is this object in time if we just treat the object as itself without any other constraints? And that’s super powerful because the shortest path then allows you to say, “Oh, this object wasn’t just created randomly. There was a process.” And so assembly theory is not meant to one up AIT or to ignore the factory. It’s just to say, “Hey, there was a factory and how big was that factory? And how deep in time is it?” Lex Fridman (01:23:01): But it’s still computationally very difficult to compute that history, right? For complex objects? Lee Cronin (01:23:11): It is. It becomes harder. But one of the thing that’s super nice is that it constrains your initial conditions, right? Lex Fridman (01:23:18): Sure. Lee Cronin (01:23:18): It constrains where you’re going to be. So if you take, say, imagine… So one of the things we’re doing right now is applying assembly theory to drug discovery. Now, what everyone’s doing right now is taking all the proteins and looking at the proteins and looking at molecules, doppler proteins, why not instead, look at the molecules that are involved in interacting with the receptors over time, rather than thinking about and use the molecules, evolve over time as a proxy for how the proteins evolved over time. And then use that to constrain your drug discovery process. Lee Cronin (01:23:51): You flip the problem 180 and focus on the molecule evolution rather than the protein. And so you can guess in the future what might happen. So you rather than having to consider all possible molecules, you know where to focus. And that’s the same thing if you’re looking at in assembly spaces for an object where you don’t know the entire history, but you know that in the history of this object, it’s not going to have some other motif there that it doesn’t apply. It doesn’t appear in the past. Lex Fridman (01:24:22): But just even for the drug discovery point you made, don’t you have to simulate all of chemistry to figure out how to come up with constraints? Lee Cronin (01:24:32): No. Lex Fridman (01:24:32): And the molecules and the… Lee Cronin (01:24:34): No. Lex Fridman (01:24:35): I don’t know enough about protein. Lee Cronin (01:24:36): Well, this is another thing that I think causes… Because this paper goes across so many boundaries. So chemists have looked at this and said, “This is not correct reaction.” It’s like, no, it’s a graph. Lex Fridman (01:24:52): Sure, there’s assembly index and shortest path examples here on chemistry. Lee Cronin (01:24:58): Yeah, and what you do is you look at the minimal constraints on that graph. Of course it has some mapping to the synthesis, but actually you don’t have to know all of chemistry. You can build up the constraints space rather nicely. But this is just at the beginning, right? There are so many directions this could go in and as I said, it could all be wrong, but hopefully it’s less wrong. Lex Fridman (01:25:22): What about the little criticism I saw of… By way of question, do you consider the different probabilities of each reaction in the chain so that there could be different… When you look at a chain of events that led up to the creation of an object, doesn’t it matter that some parts in the chain are less likely than others? Lee Cronin (01:25:46): No. Lex Fridman (01:25:48): It doesn’t matter? Lee Cronin (01:25:48): No, no. Well, let’s go back. So no, not less likely, but react… So, no. So let’s go back to what we’re looking at here. So the assembly index is the minimal path that could have created that object probabilistically. So imagine you have all your atoms in a plasma, you’ve got enough energy, there’s collisions. What is the quickest way you could zip out that molecule with no reaction constraints? Lex Fridman (01:26:12): How do you define quickest there then? Lee Cronin (01:26:14): It’s just basically walk on a random graph. So we make an assumption that basically the timescale for forming the bonds. So no, I don’t want to say that because then it’s going to have people getting obsessing about this point. And your criticism is a really good one. What we’re trying to say is this puts a lower bound on something. Of course, some reactions are less possible than others, but actually I don’t think chemical reactions exist. Lex Fridman (01:26:39): Oh, boy. What does that mean? Why don’t chemical reactions exist? Lee Cronin (01:26:44): I’m writing a paper right now that I keep being told I have to finish, and it’s called ‘The Origin of Chemical Reactions.’ And it merely says that reactivity exists as controlled by the laws of quantum mechanics. And reactions, chemists put names on reactions. So you can have, I don’t know, the Wittig reaction, which is by Wittig. You could have the Suzuki reaction, which is by Suzuki. Lee Cronin (01:27:09): Now what are these reactions? So these reactions are constrained by the following. They’re constrained by the fact they’re on planet Earth, 1G, 298 Kelvin, 1 Bar. So these are constraints. They’re also constrained by the chemical composition of earth, oxygen availability, all this stuff. And that then allows us to focus in our chemistry. So when a chemist does a reaction, that’s a really nice compressed shorthand for constraint application, glass flask, pure reagent, temperature, pressure, boom, boom, boom, control, control control, control control. Lee Cronin (01:27:44): So of course we have bond energies. So the bond energies are kind of intrinsic in a vacuum. So the bond energy, you have to have a bond. And so for assembly theory to work, you have to have a bond, which means that bond has to give the molecule a half life. So you’re probably going to find later on that some bonds are weaker and that you are going to miss in mass spectrum, when you look at the assembly of some molecules, you’re going to miscount the assembly of the molecule. It falls apart too quickly because the bonds just form. But you can solve that with looking at infrared. Lee Cronin (01:28:21): So when people think about the probability, they’re kind of misunderstanding. Assembly theory says nothing about the chemistry because chemistry is chemistry and their constraints are put in by biology. There was no chemist on the origin of life unless you believe in the chemist in the sky… And it’s like Santa Claus, they had a lot of work to do, but chemical reactions do not exist and the constraints that allow chemical transformations to occur do exist. Lex Fridman (01:28:52): Okay, okay. So it’s constraint. So there’s no chemical reactions. It’s all constraint application, which enables the emergence of… What’s a different word for chemical reaction? Lee Cronin (01:29:10): Transformation? Lex Fridman (01:29:11): Transformation. Lee Cronin (01:29:11): Yeah, like a function. It’s a function, but no, but I love chemical reactions as a shorthand. And so the chemists don’t all go mad. I mean, of course chemical reactions exist on earth. Lex Fridman (01:29:20): It’s a shorthand. Lee Cronin (01:29:21): It’s a shorthand for these constraints. Lex Fridman (01:29:24): So assuming all these constraints that we’ve been using for so long that we just assume that that’s what was the case in natural language conversation. Lee Cronin (01:29:30): Exactly. The grammar of chemistry of course emerges in reactions and we can use them reliably, but I do not think the Wittig reaction is accessible on Venus. Lex Fridman (01:29:41): Right, and this is useful to remember to frame it as constraint application is useful for when you zoom out to the bigger picture of the universe and looking at the chemistry of the universe and then starting to apply assembly theory. That’s interesting. That’s really interesting. But we’ve also pissed off the chemists now. Lee Cronin (01:30:01): Oh, they’re pretty happy, but well, most of them. Lex Fridman (01:30:04): No. Everybody deep down is happy, I think. They’re just sometimes feisty, that’s how they have fun. Lee Cronin (01:30:13): Everyone is grumpy on some days when you challenge… The problem with this paper is… It’s almost like I went to a park, it’s like I used to do this occasionally when I was young. Go to a meeting and just find a way to offend everyone at the meeting simultaneously. Even the factions that don’t like each other, they’re all unified in the hatred of you just offending them. This paper, it feels like the person that went to the party and offended everyone simultaneously. So stop fighting with themselves and just focused on this paper. Lex Fridman (01:30:41): Maybe just a little insider interesting information. What were the editors of Nature, what the reviews and so on, how difficult was that process because this is a pretty big paper. Lee Cronin (01:30:55): So when we originally sent the paper, we sent the paper and the editor said that… This is quite a long process. We sent the paper and the editor gave us some feedback and said, “I don’t think it’s that interesting.” Or “It’s hard. It’s hard concept.” And the editor gave us some feedback and Sarah and I took a year to rewrite the paper. Lex Fridman (01:31:26): Was the Nature of the feedback very specific on this part? This part? Or was it like, “What are you guys smoking? What kind of crack are you taking?” Lee Cronin (01:31:34): Yeah, it was kind of the latter. What are you smoking. Lex Fridman (01:31:35): Okay. But polite and there’s promise. Lee Cronin (01:31:41): Yeah. Well the thing is the editor was really critical, but in a really professional way. And I mean for me, this was the way science should happen. So when it came back, we had too many equations in the paper. If you look at the pre-print, there’s just equations everywhere, like 23 equations. And when I said to Abhishek, who was the first author, we’ve got to remove all the equations, but my assembly equations staying in Abhishek was like, “No, we can’t.” Lee Cronin (01:32:05): I said, “Well look, if we want to explain this to people, there’s a real challenge.” And so Sarah and I went through the, I think it was actually 160 versions of the paper, but basically we got to version 40 or something. We said, “Right, zero it start again.” So we wrote the whole paper again. We knew the entire… Lex Fridman (01:32:21): Amazing. Lee Cronin (01:32:22): And we just went bit by bit by bit and said, “What is it we want to say?” And then we sent the paper in and we expected it to be rejected and not even go to review. And then we got notification back, it had gone to review and we were like, “Oh my God, it’s so going to get rejected. How’s it going to get rejected?” Because the first assembly paper on the mass spec we sent to Nature went through six rounds of review and rejected. And by a chemist that just said, “I don’t believe you. You must be committing fraud.” Lee Cronin (01:32:54): And long story, probably a boring story, but in this case it went out to review, the comments came back and the comments were incredibly, they were very deep comments from all the reviewers. But the nice thing was the reviewers were kind of very critical, but not dismissive. They were like, “Oh, really? Explain this, explain this, explain this, explain this.” Lex Fridman (01:32:54): That’s great. Lee Cronin (01:33:26): Are you sure it’s not Kolmogorov? Are you sure it’s not this? And we went through I think three rounds of review pretty quick and the editor went, yeah, it’s in. Lex Fridman (01:33:39): But maybe you could just comment on the whole process. You’ve published some pretty huge papers on all kinds of topics within chemistry and beyond. Some of them have some little spice in them, a little spice of crazy like Tom Waits, says, “I like my Tom with a little drop of poison.” It’s not a mundane paper. So what’s it like psychologically to go through all this process to keep getting rejected, to get reviews from people that don’t get the paper or all that kind of stuff? Just from a question of a scientist, what is that like? Lee Cronin (01:34:19): I mean this paper for me kind of, because this wasn’t the first time we tried to publish assembly theory at the highest level. The Nature communications paper on the mass spec, the idea went to Nature and got rejected, went through six rounds of review and got rejected. And I just was so confused when the chemist said, this can’t be possible. I do not believe you can measure complexity using mass spec. And also by the way, complex molecules can randomly form. And we’re like, “But look at the data. The data says…” And they said, “No, no. We don’t believe you.” And we went and I just wouldn’t give up. And the editor in the end was just like… Different editors actually. Right? Lex Fridman (01:35:10): What’s behind that never giving up? When you’re sitting there 10 o’clock in the evening, there’s a melancholy feeling that comes over you and you’re like, “Okay, this is rejection number five.” Or it’s not rejection, but maybe it feels like a rejection because the comments are that you totally don’t get it. What gives you strength to keep going there? Lee Cronin (01:35:31): I don’t know. I don’t normally get emotional about papers, but it is not about giving up because we want to get it published because we want the glory or anything. It’s just like, why don’t you understand? And so what I would just… Is try to be as rational as possible and say, yeah, you didn’t like it. Tell me why. And then… Lee Cronin (01:36:26): Sorry, give me a second. Silly, never get emotional about papers normally, but I think what we do, you just compressed five years of angst from this. Lex Fridman (01:36:38): So it’s been rough? Lee Cronin (01:36:40): It’s not just rough. It’s like, it happened… I came up with the assembly equation remote from Sarah in Arizona and the people at SFI. I felt like I was a mad person. The guy depicted in A Beautiful Mind who was just like… Not the actual genius part, but just the gibberish, gibberish, gibberish. Lex Fridman (01:36:59): Just the crazy part. Lee Cronin (01:37:02): Because I kept writing expanded and I have no mathematical ability at all. And I was making these mathematical expansions where I kept seeing the same motif again. I was like, I think this is a copy number. The same string is coming again and again and again, I couldn’t do the math. And then I realized the copy number fell out of the equation and everything collapsed down. I was like, oh, that works kind of. Lee Cronin (01:37:23): So we submitted the paper and then when it was almost accepted, the mass spec one and it was astrobiologists said, great, a mass spectroscopist said great. And the chemist went nonsense, biggest pile of nonsense ever. Fraud. And I was like, “But why fraud?” And they just said, “Just because.” I was like well… I could not convince the editor in this case. The editor was just so pissed off. They see it as a, you’re wasting my time. And I would not give up. I wrote, I went and dissected all the parts. And I think, although, I mean I got upset about, it was kind of embarrassing actually, but I guess… Lex Fridman (01:38:05): I bet it was beautiful. Lee Cronin (01:38:08): But it was just trying to understand why they didn’t like it. So part of me was really devastated and a part of me was super excited because I’m like, “Huh, they can’t tell me why I’m wrong.” And this kind of goes back to when I was at school, I was in a kind of learning difficulties class, and I kept going to the teacher and saying, “What do I do today to prove I’m smart?” And they were like, “Nothing, you can’t.” I was like, “Give me a job, give me something to do, give me a job to do. Something to do.” And I kind of felt like that a bit when I was arguing with the, and not arguing. There was no ad hominem. I wasn’t telling the editor they were idiots or anything like this or the reviewers. I kept it strictly factual. Lee Cronin (01:38:51): And all I did is I just kept knocking it down bit by bit, by bit, by bit by bit. It was ultimately rejected and it got published elsewhere. And then the actual experimental data, so in this paper, the experimental justification was already published. So when we did this one and we went through the versions and then we sent it in and in the end it just got accepted. We were like, well, that’s kind of cool, right? This is kind of like some days… Lee Cronin (01:39:21): Sorry, the first author was like, “I can’t believe it got accepted.” I was like, “Nor am I, but it’s great. It’s good.” And then when the paper was published, I was not expecting the backlash. I was expecting computational. Well, no, actually I was just expecting one person who’d been trolling me for a while about it just to carry on trolling, but I didn’t expect the backlash. And then I wrote to the editor and apologized and the editor was like, “What are you apologizing for? It was a great paper. Of course it’s going to get backlash. You said some controversial stuff, but it’s awesome.” Lex Fridman (01:39:56): Well, I think it’s a beautiful story of perseverance and the backlash is just a negative word for discourse, which I think is beautiful. That’s the science. Lee Cronin (01:40:08): I think, as I said when it got accepted and people were saying, we’re kind of hacking on it. And I was like, papers are not gold medals. The reason I wanted to publish that paper in Nature is because it says, “Hey, there’s something before biological evolution.” You have to have that, if you’re not a creationist, by the way, this is an approach. First time someone has put a concrete mechanism, or sorry, a concrete quantification and what comes next you are pushing on is a mechanism. And that’s what we need to get to is an auto catalytic sets, self-replicating molecules, some other features that come in. Lee Cronin (01:40:48): And the fact that this paper has been so discussed, for me is a dream come true, it doesn’t get better than that. If you can’t accept a few people hating it… And the nice thing is, the thing that really makes me happy is that no one has attacked the actual physical content. Lee Cronin (01:41:10): You can measure the assembly index, you can measure selection now. So either that’s right or it’s… Well, either that’s helpful or unhelpful. If it’s unhelpful, this paper will sink down and no one will use it again. If it’s helpful, it’ll help people scaffold on it and we’ll start to converge for a new paradigm. So I think that that’s the thing that I wanted to see my colleagues, authors, collaborators and people were like, you’ve just published this paper. You’re a chemist. Why have you done this? Who are you to be doing evolutionary theory? Well, I don’t know. I mean, sorry, did I need to… Lex Fridman (01:41:48): Who is anyone to do anything? Well, I’m glad you did. Let me just before coming back to Origin of Life and these kinds of questions, you mentioned learning difficulties. I didn’t know about this. So what was it like? Lee Cronin (01:42:00): I wasn’t very good at school, right. Lee Cronin (01:42:00): I wasn’t very good at school, right? Lex Fridman (01:42:04): This is when you were very young? Lee Cronin (01:42:06): Yeah. But in primary school, my handwriting was really poor and apparently I couldn’t read and my mathematics was very poor. So they just said, “This is a problem.” They identified it. My parents at the time, were confused because I was busy taking things apart, buying electronic junk from the shop, trying to build computers and things. And then once I got out of… when I think, about the major transition in my stupidity, everyone thought I wasn’t that stupid when I was… Basically, everyone thought I was faking. I liked stuff and I was faking wanting to be it. So I always want to be a scientist. So five, six, seven years old, I’d be a scientist, take things apart, and everyone’s like, “Yeah, this guy wants to be a scientist, but he’s an idiot.” So everyone was really confused, I think, at first, that I wasn’t smarter than I was claiming to be. Lee Cronin (01:42:58): And then I just basically didn’t do well in any of the tests, and I went down and down and down and down and then I was like, “Huh, this is really embarrassing. I really like maths and everyone says I can’t do it. I really like physics and chemistry and science and people say you can’t read and write.” And so I found myself in a learning difficulties class at the end of primary school and the beginning of secondary school. In the UK, secondary school is 11, 12 years old. And I remember being put in the remedial class. And the remedial class was basically full of three types of people. There were people quite violent and there were people who couldn’t speak English and there were people that really had learning difficulties. So the one thing I can objectively remember was… I could read. I liked reading. I read a lot. But something in me, I’m a bit of a rebel. I refused to read what I was told to read and I found it difficult to read individual words in the way they were told. Lee Cronin (01:44:24): But anyway, I got caught one day teaching someone else to read and they said, “Okay, we don’t understand this.” I’d always known I wanted to be a scientist, but I didn’t really know what that meant and I realized you had to go to university and I thought, “I can just go to university. They take curious people.” “No, no, no need to have these. You have to be able to enter these exams to get this grade point average, and the fact is, the exams you’ve been entered into, you are just going to get C, D or E.” You can’t even get A, B or C. These are the UK GCSEs. I was like, ” Oh, shit,” and I said, “Can you just put me into the higher exams?” They said, “No, no, you’re going to fail. There’s no chance.” So my father intervened and said, “Just let him go in the exams,” and they said, “He’s definitely going to fail. It’s a waste of time, waste of money,” and he said, “What if we paid?” So they said, “Okay,” so you didn’t actually have to pay. You only had to pay if I failed. Lee Cronin (01:45:23): So I took the exams and passed them, fortunately. I didn’t get the top grades, but I got into A Levels. But then that also limited what I could do at A Levels. I wasn’t allowed to do A Level maths. Lex Fridman (01:45:35): What do you mean you weren’t allowed to? Lee Cronin (01:45:36): Because I had such a bad math grade from my GCSE, I only had a C. But they wouldn’t let me go into the ABC for maths because of some coursework requirement back then so the top grade I could have got was a C. So C, D or E. So I got a C and they let me do AS Level maths, which is this half intermediate and get to go to university. But I liked chemistry. I had a good chemistry teacher so in the end I got to university to do chemistry. Lex Fridman (01:46:01): So through that process, I think for kids in that situation, it’s easy to start believing that you’re not… How do I put it… That you’re stupid, and basically give up, that you’re just not good at math, you’re not good at school. So this is, by way of advice for people, for interesting people, for interesting young kids right now, experiencing the same thing. Where was the place? What was the source of you not giving up there? Lee Cronin (01:46:33): I have no idea. Other than… I really liked not understanding stuff. For me, when I not understand something… I feel like I don’t understand anything. But now, but back then, I remember when I was like… I don’t know, I tried to build a laser when I was eight and I thought, “How hard could it be?” And basically, I was going to build a CO2 laser and I was like, “Right, I think I need some partially coated mirrors. I need some carbon dioxide and I need a high voltage.” And I was so stupid. I was so embarrassed. T make enough CO2, I actually set a fire and tried to filter the flame. Lex Fridman (01:47:30): Oh, nice. That’s an idea. Lee Cronin (01:47:30): Just to collect enough CO2 and it completely failed. And I burnt half the garage down. So my parents were not very happy about that. So that was one thing. I really liked first principle thinking. So I remember being super curious and being determined to find answers. And so when people do give advice about this, why ask for advice about this? I don’t really have that much advice other than don’t give up. And one of the things I try to do as a chemistry professor in my group is I hire people that I think, if they’re persistent enough, who am I to deny them the chance? Because people gave me a chance and I was able to do stuff. Lex Fridman (01:48:18): Do you believe in yourself essentially? Lee Cronin (01:48:22): So I love being around smart people and I love confusing smart people. And when I’m confusing smart people, not by stealing their wallets and hiding it somewhere, but if I can confuse smart people, that is the one piece of hope that I might be doing something interesting. Lex Fridman (01:48:37): Wow, that’s quite brilliant. As a gradient to optimize. Hang out with smart people and confuse them. And the more confusing it is, the more there’s something there. Lee Cronin (01:48:47): And as long as they’re not telling you just a complete idiot and they give you different reasons. And everyone, because with assembly theory and people said, “Oh, it’s wrong.” And I was like, “Why?” And no one could give me a consistent reason. They said, “Oh, because it’s been done before or it’s just [inaudible 01:49:04] or it’s just there, that and the other. So I think the thing that I like to do is, and in academia it’s hard because people are critical. But the criticism, although I got upset about it earlier, which is silly, but not silly because obviously it’s hard work being on your own or with a team spatially separated during lockdown and try to keep everyone on board and have some faith. I always wanted to have a new idea. And so I like a new idea and I want to nurture it as long as possible. And if someone can give me actionable criticism, that’s why I think I was trying to say earlier when I was stuck for words, give me actionable criticism. Lee Cronin (01:49:51): “It’s wrong.” “Okay, why is it wrong?” Say, “Oh, your equation’s incorrect for this or your method is wrong.” So what I try and do is get enough criticism from people to then triangulate and go back. And I’ve been very fortunate in my life that I’ve got great colleagues, great collaborators, funders, mentors, and people that will take the time to say, “You are wrong because.” And then what I have to do is integrate the wrongness and go, “Oh, cool, maybe I can fix that.” And I think criticism is really good. People have a go at me because I’m really critical. But I’m not criticizing you as a person. I’m just criticizing the idea and trying to make it better and say, “What about this?” Lee Cronin (01:50:34): And sometimes my filters are truncated in some ways. I’m just like, “That’s wrong, that’s wrong, that’s wrong. Why’d you do this?” And people are like, “Oh my God, you just told me, you destroyed my life’s work.” I’m like, “Relax. No.” I’m just like, “Let’s make it better.” And I think that we don’t do that enough because we are either personally critical, which isn’t helpful or we don’t give any criticism at all because we’re too scared. Lex Fridman (01:51:03): Yeah, I’ve seen you be pretty aggressively critical but every time I’ve seen, it’s the idea, not the person. Lee Cronin (01:51:15): I’m sure I make mistakes on that.I argue lots with Sara and she’s shocked. I’ve argued with Joscha, Joscha Bach, in the past and he is like, “You’re just making that up.” And I’m like, “No, not quite. But kind of.” But I had a big argument with Sara about time and she’s like, “No, time doesn’t exist.” I’m like, “No, no, time does exist.” And as she realized that her conception of assembly theory and my conception of assembly theory was the same thing, necessitated us to abandon the fact that time is eternal, to actually really fundamentally question how the universe produces combinatorial novelty. Lex Fridman (01:51:59): So time is fundamental for assembly theory? I’m just trying to figure out where you and Sara converged. Lee Cronin (01:52:06): I think assembly theory is fine in this time right now but I think it helps us understand that something interesting is going on. I’ve been really inspired by a guy called Nick Gisin. I’m going to butcher his argument but I love his argument a lot. So I hope he forgives me if he hears about it. But basically if you want free will, time has to be fundamental. And if you want time to be fundamental, you have to give up on platonic mathematics and you have to use intuition. By the way, and again I’m going to butcher this, but basically Hilbert said that infinite numbers are allowed. And I think it was Brouwer who said, “No, you can’t. All numbers are finite.” So let’s go back a step because it was like people going to say, assembly theory seems to explain that large combinatorial space allows you to produce things like life and technology. And that large combinatorial space is so big it’s not even accessible to a Sean Carroll, David Deutsch multiverse that physicists saying that all of the universe already exists in time is probably, provably, that’s a strong word, not correct. Lee Cronin (01:53:43): That we are going to know that the universe as it stands, the present, the way the present builds the future is so big, the universe can’t ever contain the future. And this is a really interesting thing. I think Max Tegmark has this mathematical universe. He says the universe is like a block universe, and I apologize to Max if I’m getting it wrong, but people think you can just move. You have the stat, you have the initial conditions, and you can run the universe right to the end and go backwards and forwards in that universe. That is not correct. Lex Fridman (01:54:17): Let me load that in. The universe is not big enough to contain the future. Lee Cronin (01:54:21): Yeah. That’s why. That’s it. Lex Fridman (01:54:24): That’s a beautiful way of saying that time is fundamental. Lee Cronin (01:54:26): Yes. And this is why the law of the excluded middle, something is true or false, only works in the past. Is it going to snow in New York next week or in Austin? You might, in Austin, say probably not. In New York, you might say, yeah. If you go forward to next week and say, “Did it snow in New York last week? True or false?” You can answer that question. The fact that the law of the excluded middle cannot apply to the future explains why time is fundamental. Lex Fridman (01:55:01): That’s a good example, intuitive example, but it’s possible that we might be able to predict whether it’s going to snow if we had the perfect information. Lee Cronin (01:55:10): I think… Lex Fridman (01:55:11): You’re saying it not. Lee Cronin (01:55:13): Impossible. Impossible. So here’s why. I’ll make a really quick argument and this argument isn’t mine. It’s Nick’s and a few other people. Lex Fridman (01:55:23): Can you explain his view on time being fundamental? Lee Cronin (01:55:28): Yeah. So I’ll give my view, which resonates with his, but basically it’s very simple actually. It would say your ability to design and do an experiment is exercising free will. So he used that thought process. I never really thought about it that way, and that you actively make decisions. I used to think that free will was a consequence of just selection but I’m understanding that human free will is something really interesting. And he very much inspired me. But I think that what Sara Walker said that inspired me as well, these will converge, is that I think that the universe, and the universe is very big, huge, but actually the place that is largest in the universe right now, the largest place in the universe, is earth. Lex Fridman (01:56:20): Yeah, I’ve seen you say that. And boy, does that… That’s an interesting one to process. What do you mean by that earth is the biggest place in the universe? Lee Cronin (01:56:31): Because we have this combinatorial scaffolding going all the way back from LUCA. So you’ve got cells that can self-replicate and then you go all the way to terraforming the earth. You’ve got all these architectures, the amount of selection that’s going on, biological selection, just to be clear, biological evolution, and then have multicellularity then animals and abstraction. And with abstraction, there was another kick because you can then build architectures and computers and cultures and language and these things are the biggest things that exist in the universe because we can just build architectures that could naturally arise anywhere and the further that distance goes in time, and it’s gigantic. Lex Fridman (01:57:15): From a complexity perspective. Lee Cronin (01:57:17): Yeah. Lex Fridman (01:57:17): Okay, wait a minute. But I know you’re being poetic, but how do you know there’s not other earth-like… How do you know? You’re basically saying earth is really special. It’s awesome stuff as far as we look out, there’s nothing like it going on. But how do you know there’s not nearly infinite number of places where cool stuff like this is going on? Lee Cronin (01:57:40): I agree and I would say, I’ll say again, that earth is the most gigantic thing we know in the universe combinatorially we know. Lex Fridman (01:57:49): We know. Yeah. Lee Cronin (01:57:50): Now, I guess this is just purely a guess. I have no data other than hope. Maybe not hope, maybe… No, I have some data. That every star in the sky probably has planets and life is probably emerging on these planets. But the amount of contingency that is associated with life, is I think the combinatorial space associated with these planets is so different. Our causal cones are never going to overlap or not easily. And this is the thing that makes me sad about alien life. It’s why we have to create alien life in the lab as quickly as possible because I don’t know if we are going to be able to be able to build architectures that will intersect with alien intelligence architectures. Lex Fridman (01:58:42): Intersect, you don’t mean in time or space? Lee Cronin (01:58:46): Time and the ability to communicate. Lex Fridman (01:58:48): The ability to communicate. Lee Cronin (01:58:49): Yeah. My biggest fear in a way is that life is everywhere but we become infinitely more lonely because of our scaffolding in that combinatorial space. Because it’s so big. Lex Fridman (01:59:00): So you’re saying the constraints created by the environment that led to the factory of Darwinian evolution are just this little tiny cone in a nearly infinite combinatorial space. Lee Cronin (01:59:14): Exactly. Lex Fridman (01:59:14): So there’s other cones like it. Why can’t we communicate with other… Just because we can’t create it doesn’t mean we can’t appreciate the creation, right? Sorry, detect the creation. Lee Cronin (01:59:30): I truly don’t know but it’s an excuse for me to ask for people to give me money to make a planet simulator. Lex Fridman (01:59:36): Yeah, right. Lee Cronin (01:59:36): If I can make… Lex Fridman (01:59:38): With a different [crosstalk 01:59:40] Lee Cronin (01:59:39): It’s like another shameless say, it’s like, “Give me money. I need money.” Lex Fridman (01:59:42): This was all long plug for a planet simulator. Hey, I won’t be the first in line to do that. Lee Cronin (01:59:50): My rick garage has run out of room. Lex Fridman (01:59:53): Yeah. Lee Cronin (01:59:54): No. Lex Fridman (01:59:54): And this planet simulator, you mean a different planet or different sets of environments and pressures? Lee Cronin (02:00:01): Exactly. If we could basically recreate the selection before biology as we know it, that gives rise to a different biology, we should be able to put the constraints on where to look in the universe. So here’s the thing. Here’s my dream. My dream is that by creating life in the lab based upon constraints we understand, let’s go for Venus type life or earth type life or something again, do an Earth 2.0. Screw it, let’s do an Earth 2.0. An Earth 2.0 has a different genetic alphabet. Fine, that’s fine. Different protein alphabet, fine. Have cells and evolution, all that stuff. We will then be able to say, “Okay, life is a more general phenomena. Selection is more general than what we think is the chemical constraints on life.” And we can point at James Webb and other telescopes at other planets that we are in that zone we are most likely to combinatorially overlap with because, so there’s chemistry… Lex Fridman (02:01:01): You’re looking for some overlap. Lee Cronin (02:01:02): And then we can then basically shine light on them literally and look at light coming back and apply advanced assembly theory to general theory of language that we’ll get and say, “Huh, in that signal, it looks random but there’s a copy number. Oh, this random set of things that shouldn’t be that looks like a true random number generator has structure as not [inaudible 02:01:32], an IT type structure, but evolutionary structure given by assembly theory,” and we start to… But I would say that because I’m a shameless assembly theorist. Lex Fridman (02:01:42): Yeah, it just feels like the cone, I might be misusing the word cone here but the width of the cone is growing faster, is growing really fast to where eventually all the cones overlap even in a very, very, very large combinatorial space. But then again, if you’re saying the universe is also growing very quickly in terms of possibilities… Lee Cronin (02:02:14): I hope that as we build abstractions, one idea is that as we go to intelligence, intelligence allows us to look at the regularities around us in the universe. And that gives us some common grounding to discuss with aliens. And you might be right that we will overlap there. Even though we have completely different chemistry, literally completely different chemistry, that we will be able to pass information from one another. But it’s not a given. And I have to try and divorce hope and emotion away from what I can logically justify. Lex Fridman (02:03:02): But it’s just hard to intuit a world, a universe where there’s nearly infinite complexity objects and they somehow can’t detect each other. Lee Cronin (02:03:13): The universe is expanding. But the nice thing is I would say, I would look, you see, I think Carl Sagan did the wrong thing. Not the wrong thing. He flicked the Voyager program and the Pale Blue Dot and said, “Look how big the universe is.” I would’ve done it the other way around and said, “Look at the Voyager probe that came from the planet earth that came from LUCA. Look at how big earth is.” Lex Fridman (02:03:31): Then it produced that. Lee Cronin (02:03:32): It produced that. Lex Fridman (02:03:34): Yeah. Lee Cronin (02:03:35): And that I think is completely amazing. And then that should allow people on earth to think about, “Probably we should try and get causal chains off Earth onto Mars, onto the moon, wherever. Whether it’s human life or martian life that we create, it doesn’t matter. But I think this combinatorial space tells us something very important about the universe and that I realized in assembly theory that the universe is too big to contain itself. Now coming back, I want to change your mind about time because I’m guessing that your time is just a coordinate. So I’m going to change… Lex Fridman (02:03:35): I’m guessing you’re one of those. Lee Cronin (02:04:20): One of those. I’m change my mind in real time or at least attempt. Lex Fridman (02:04:22): Oh, in real time. There you go. I already got the tattoo. So this is going to be embarrassing if you change my mind. Lee Cronin (02:04:27): But you can just add an arrow of time onto it, right? Lex Fridman (02:04:27): Yeah, true. Just modify it. Lee Cronin (02:04:32): Or raise it a bit. And the argument that I think that is really most interesting is people say the initial conditions specify the future of the universe. Okay, fine. Let’s say that’s the case for a moment. Now let’s go back to Newtonian mechanics. Now, the uncertainty principle in Newtonian mechanics is this. If I give you the coordinates of an object moving in space and the coordinates of another object and they collide in space. And those initial conditions, you should know exactly what’s going to happen. However, you cannot specify these coordinates to infinite precision. Now everyone says, “Oh, this is like the chaos theory argument.” No, no, it’s deeper than that. Here’s a problem with numbers. This is where Hilbert and Brouwer fell out. To have the coordinates of this object, a given object that’s colliding, you have to have them to infinite precision. That’s what Hilbert says. There’s no problem. Infinite precision is fine. Let’s just take that for granted. Lee Cronin (02:05:38): But when the object is finite and it can’t store its own coordinates, what do you do? So in principle, if a finite object cannot be specified to infinite precision, in principle, the initial conditions don’t apply. Lex Fridman (02:05:58): How do you know it can’t store its… Lee Cronin (02:06:01): How do you store an in long number in a finite size? Lex Fridman (02:06:09): We’re using infinity very loosely here. Lee Cronin (02:06:11): No, no. We’re using… Lex Fridman (02:06:12): Infinite precision. Not loosely, but… Lee Cronin (02:06:14): Very precisely. Lex Fridman (02:06:15): So you think infinite precision is required? Lee Cronin (02:06:18): Let’s take the object. Let’s say the object is a golf ball. A golf ball is a few centimeters in diameter. We can work out how many atoms are in the golf ball. And let’s say we can store numbers down to atomic dislocations. So we can work out how many atoms there are in the golf ball and we can store the coordinates in that golf ball down to that number. But beyond that, we can’t. Let’s make the golf ball smaller. And this is where I think that we think that we get randomness in quantum mechanics and some people say you can’t get randomness, quantum mechanic’s deterministic, but aha, this is where we realize that classical mechanics and quantum mechanics suffer from the same uncertainty principle. And that is the inability to specify the initial conditions to a precise enough degree to give you determinism. Lee Cronin (02:07:09): The universe is intrinsically too big and that’s why time exists. It’s non-deterministic. Looking back into the past, you can use logical arguments because you can say, “Was it true or false?” You already know. But this is the fact we are unable to predict the future with the precision is not evidence of lack of knowledge. It’s evidence the universe is generating new things. Lex Fridman (02:07:38): Okay, first of all, quantum mechanics, you could just say statistically what’s going to happen when two golf balls hit each other. Lee Cronin (02:07:44): Statistically. But sure, I can say statistically what’s going to happen. But then when they do happen and then you keep nesting it together, it goes almost back to, look, let’s think about entropy in the universe. So how do we understand entropy change or process? We can use the ergodic hypothesis. We can also have have the counterfactuals where we have all the different states and we can even put that in the multiverse. But both those, they’re nonphysical. The multiverse collapses back to the same problem about the precision. So if you accept, you don’t have to have true and false going forward into the future. The real numbers are real. They’re observables. Lex Fridman (02:08:47): We’re trying to see exactly where time being fundamental sneaks in. And this difference between the golf ball can’t contain its own position perfectly precisely. How that leads to time needing to be fundamental. Lee Cronin (02:09:07): Do you believe or do you accept you have free will? Lex Fridman (02:09:12): Yeah, I think at this moment in time, I believe that I have free will. Lee Cronin (02:09:17): So then you have to believe that time is fundamental. Lex Fridman (02:09:23): I understand that’s a statement you’ve made. Lee Cronin (02:09:25): No, that we can logically follow because if you don’t have free will, so if you’re in a universe that has no time, universe is deterministic. If it’s deterministic, then you have no free will. Lex Fridman (02:09:37): I think the space of how much we don’t know is so vast that saying the universe is deterministic and from that jumping into there’s no free will is just too difficult of a leap. Lee Cronin (02:09:48): No, I logically follow. No, no, I don’t disagree. It’s deep and it’s important. All I’m saying, and it’s actually different to what I’ve said before, is that if you don’t require platonistic mathematics and accepts that non-determinism is how the universe looks and that gives us our creativity and the way the universe is getting novelty, it’s really deeply important in assembly theory because assembly theory starts to actually give you a mechanism where you go from boring time, which is basically initial conditions specify everything, to a mismatch in creative time. And I hope we’ll do experiments. I would love to do an experiment that prove that time is fundamental and the universe is generating novelty. I don’t know all the features of that experiment yet, but by having these conversations openly and getting people to think about the problems in a new way, better people, more intelligent people with good mathematical backgrounds can say, “Oh, hey, I’ve got an idea. I would love to do an experiment that shows that the universe is too big for itself going forward in time.” Lee Cronin (02:11:04): And this is why I really hate the idea of the Boltzmann brain. The Boltzmann brain makes me super, like everyone’s having a free lunch. It’s like saying, “Let’s break all the laws of physics.” So a Boltzmann brain is this idea that in a long enough universe, a brain will just emerge in the universe as conscious. And that neglects the causal chain of evolution that required to produce that brain. And this is where the computational argument really falls down because a computationalist could say,” I can calculate probability of a Boltzmann brain.” And they’ll give you a probability. But I can calculate probability of a Boltzmann brain. Zero. Lex Fridman (02:11:40): Just because the space of possibilities is so large? Lee Cronin (02:11:43): Yeah. When we start falling ourselves with numbers that we can’t actually measure and we can’t ever conceive of, I think it doesn’t give us a good explanation. And I want to explain why life is in the universe. I think life is actually novelty minor. Life basically mines novelty almost from the future and actualizes in the present. Lex Fridman (02:12:11): Okay. Life is a novelty minor from the future that is actualized in the present. Lee Cronin (02:12:20): Yep. I think so. Lex Fridman (02:12:24): Novelty minor. First of all, novelty. What’s the origin of novelty when you go from boring time to creative time? Where is that? Is it as simple as randomness like you’re referring to? Lee Cronin (02:12:39): I am really struggling with randomness because I had a really good argument with Joscha Bach about randomness, and he just said, “Randomness doesn’t give you free will. That’s insane because you’d just be random.” And I think he’s right at that level but I don’t think he is right on another level. And it’s not about randomness, it’s about constrained, I’m making this up as I go along, so making this up, constrained opportunity. So the novelty. What is novelty? This is what I think is a funny thing if you ever want to discuss AI. Why I think everyone’s gone AI mad is that they’re misunderstanding novelty. But let’s think about novelty. Yes. What is novelty? So I think novelty is a genuinely new configuration that is not predicted by the past and that you discover in the present. And that is truly different. Now, everyone says that. Some people say that novelty doesn’t exist. It’s always with precedent. I want to do experiments that show that that is not the case. And it goes back to a question you asked me a few moments ago, which is where is the factory? Lee Cronin (02:13:58): Because I think the same mechanism that gives us a factory gives us novelty. And I think that is why I’m so deeply hung up on time. Of course I’m wrong, but how wrong? And I think that life opens up that combinatorial space in a way that our current laws of physics, although as contrived in a deterministic initial condition universe even with the get out of the multiverse, David Deutsch style, which I love by the way, but I don’t think is correct, but it’s really beautiful. Lex Fridman (02:14:37): Multiverse. Lee Cronin (02:14:38): David Deutsche’s conception of the multiverse is given. But I think that the problem with wave particle duality in quantum mechanics is not about the multiverse. It’s about understanding how determined the past is. I don’t just think that actually, this is a discussion I was having with Sara about that, where she was like, “Oh, I think we’ve been debating this for a long time now, about how do we reconcile novelty determinism in determinism.” Lex Fridman (02:15:13): Okay. Just to clarify, both you and Sara think the universe is not deterministic? Lee Cronin (02:15:19): I won’t speak for Sara but roughly. I think the universe is deterministic looking back in the past but undetermined going forward in the future. So I’m having my cake and eating it here. This is because I fundamentally don’t understand randomness, as Joscha told me or other people told me. But if I adopt a new view now which the new view is the universe is just non-deterministic, but I’d like to refine that and say the universe appears deterministic going back in the past but it’s undetermined going forward in the future. So how can we have a universe that has deterministically looking rules that’s non-determined Lee Cronin (02:16:00): … universe that has deterministically-looking rules that is non-determined going into the future. It’s this breakdown in precision in the initial conditions, and we have to just stop using initial conditions and start looking at trajectories, and how the combinatorial space behaves in an expanding universe in time and space. And assembly theory helps us quantify the transition to biology, and biology appears to be novelty-mining, because it’s making crazy stuff that are unique to Earth. Right? There are objects on Earth that are unique to Earth that will not be found anywhere else, because you can do the combinatorial math. Lex Fridman (02:16:41): What was that statement you made about “life is novelty-mining from the future”? What’s the little element of time that you’re introducing there? Lee Cronin (02:16:51): What I’m kind of meaning is because the future is bigger than the present, in a deterministic universe, how do the states go from one to another? There’s a mismatch, right? Lex Fridman (02:17:02): Yeah. Lee Cronin (02:17:03): So, that must mean that you have a little bit of indeterminism. Whether that’s randomness or something else, I don’t understand. I want to do experiments to formulate a theory to refine that as we go forward that might help us explain that. And I think that’s why I’m so determined to try and crack the “non-life to life” transition looking at networks and molecules, and that might help us think about the mechanism. But certainly the future is bigger than the past in my conception of the universe and some conception of the universe. And- Lex Fridman (02:17:35): By the way, that’s not obvious, right? The future being bigger than the past, well, that’s one statement, and the statement that the universe is not big enough to contain the future is another statement. That one is a big one. That one’s a really big one. Lee Cronin (02:17:53): I think so, but I think it’s entirely … Because look, we have the second law, and right now we don’t need the second law if the future’s bigger than the past. It follows naturally. So, why are we retrofitting all these sticking plasters onto our reality to hold onto a timeless universe? Lex Fridman (02:18:13): Yeah, but that’s because it’s kind of difficult to imagine the universe that can’t contain the future. Lee Cronin (02:18:21): But isn’t that really exciting? Lex Fridman (02:18:23): It’s very exciting, but it’s hard. We are humans on Earth, and we have a very kind of four-dimensional conception of the world, of 3D plus time. It’s just hard to intuit a world where, what does that even mean, a universe that can’t contain the future? Lee Cronin (02:18:47): Yeah. It’s kind of crazy but obvious. Lex Fridman (02:18:50): It’s weird, it’s weird. I suppose it sounds obvious, yeah, if it’s true. Lee Cronin (02:18:56): So, the reason why assembly theory turned me onto that was that, let’s just start in the present, and look at all the complex molecules, and go backwards in time, and understand how evolutionary processes gave rise to them. It’s not at all obvious that taxol, which is one of the most complex natural products produced by biology, was going to be invented by biology. It’s an accident. Lee Cronin (02:19:24): Taxol is unique to Earth. There’s no taxol elsewhere in the universe, and taxol was not decided by the initial conditions. It was decided by this interplay between the … So, the past simply is embedded in the present. It gives some features. But why the past doesn’t map to the future one-to-one is because the universe is too big to contain itself. That gives space for creativity, and novelty, and some things which are unpredictable. Lex Fridman (02:19:57): Well, okay. So, given that you’re disrespecting the power of the initial conditions, let me ask you about, how do you explain that cellular automata are able to produce such incredible complexity given just basic rules and basic initial conditions? Lee Cronin (02:20:12): I think that this falls into the Brouwer-Hilbert trap. So, how do you get cellular automata to produce complexity? You have a computer, you generate a display, and you map the change of that in time. There are some CAs that repeat like functions. Lee Cronin (02:20:32): It’s fascinating to me that for pi, there is a formula where you can go to the millionth decimal place of pi and read out the number without having to go there. But there are some numbers where you can’t do that, and you have to just crank through. Whether it’s Wolframian computational irreducibility or some other thing, well, it doesn’t matter. But these CAs, that complexity, is that just complexity, or a number that is basically you’re mining that number in time? Is that just a display screen for that number, that function? Lex Fridman (02:21:10): Well, can’t you say the same thing about the complexity on Earth then? Lee Cronin (02:21:12): No. Because the complexity on Earth has a copy number and an assembly index associated with it. That CA is just a number running. Lex Fridman (02:21:20): You don’t think it has a copy number? Wait a minute … Lee Cronin (02:21:23): Well, it does where we’re looking at humans producing different rules, but then it’s nested on selection. So, those CAs are produced by selection. The CA is such a fascinating pseudo-complexity generator. What I would love to do is understand, quantify the degree of surprise in a CA and run it long enough. But what I guess that means is we have to instantiate, we have to have a number of experiments where we’re generating different rules and running them time steps, but … Oh, I got it. Lee Cronin (02:21:53): CAs are mining novelty in the future by iteration, right? And you’re like, ” Oh, that’s great. That’s great.” You didn’t predict it. Some rules you can predict what’s going to happen, and other rules you can’t. So for me, if anything, CAs are evidence that the universe is too big to contain itself, because otherwise you’d know what the rules are going to do forevermore. Lex Fridman (02:22:14): Right. I guess you were saying that the physicist saying that all you need is the initial conditions and the rules of physics is somehow missing the bigger picture. Lee Cronin (02:22:26): Yeah. Lex Fridman (02:22:27): And if you look at CAs, all you need is the initial condition and the rules, and then run the thing. Lee Cronin (02:22:33): You need three things; You need the initial conditions, you need the rules, and you need time iteration to mine it out. Without the coordinate, you can’t get it out. Lex Fridman (02:22:45): Sure, and that to you is fundamental? Lee Cronin (02:22:47): And you can’t predict it from the initial conditions. If you could, then it could be fine. Lex Fridman (02:22:51): And that time is- Lee Cronin (02:22:53): A resource. Lex Fridman (02:22:54): … like the foundation of the history, the memory of each of the things it created. It has to have that memory of all the things that led up to it. Lee Cronin (02:23:05): Yeah, you have to have the resource. Because time is a fundamental resource. Yeah, I think I had a major epiphany about randomness, but I keep doing that every two days and then it goes away again. It’s random. Lex Fridman (02:23:24): You’re a time fundamentalist. Lee Cronin (02:23:26): And you should be as well. If you believe in free will, then the only conclusion is that time is fundamental. Otherwise you cannot have free will. It logically follows. Lex Fridman (02:23:37): Well, the foundation of my belief in free will is observation-driven. Lee Cronin (02:23:48): But that’s- Lex Fridman (02:23:48): I think if you use logic, logically it seems like the universe is deterministic. Lee Cronin (02:23:55): Looking backwards in time then that’s correct, the universe is. Lex Fridman (02:23:59): And then everything else is a kind of leap. It requires a leap. Lee Cronin (02:24:11): This is why I think machine learning is going to provide a chunk of that, right? To help us explain this. So, the way I’d say it, if you take … Lex Fridman (02:24:19): That’s interesting. Why? Lee Cronin (02:24:21): Well, my favorite one is … Because AI doomers are driving me mad, and in fact we don’t have any intelligence yet. I call AI “autonomous informatics” just to make people grumpy. Lex Fridman (02:24:34): Yeah. You’re saying we’re quite far away from AGI. Lee Cronin (02:24:39): I think that we have no conception of intelligence, and I think that we don’t understand how the human brain does what it does. I think that neuroscience is making great advances, but I think that we have no idea about AGI. So, I am a technological, I guess optimist. I believe we should do everything. The whole regulation of AI is nonsensical. Why would you regulate Excel, other than the fact that Clippy should come back and I love Excel ’97 because we can do the flight simulator. Lex Fridman (02:25:11): Sorry, in Excel? Lee Cronin (02:25:12): Yeah, have you not played the flight simulator in- Lex Fridman (02:25:14): In Excel ’97? Lee Cronin (02:25:16): Yeah. Lex Fridman (02:25:18): What does that look like? Lee Cronin (02:25:19): It’s like wireframe, very basic. But basically I think it’s X zero, Y zero, shift, and it opens up and you can play the flight simulator. Lex Fridman (02:25:29): Oh, wow. Wait, wait, is it using Excel? Lee Cronin (02:25:32): Excel ’97. Lex Fridman (02:25:33): Okay. Lee Cronin (02:25:34): I resurrected it the other day and saw Clippy again for the first time in a long time. Lex Fridman (02:25:37): Well, Clippy is definitely coming back. But you’re saying we don’t have a great understanding of what is intelligence, what is the intelligence underpinning the human mind. Lee Cronin (02:25:50): I’m very frustrated by the way that we’re AI dooming right now, and people are bestowing some kind of magic. Now, let’s go back a bit. So, you said about AGI, are we far away from AGI? Yes. I do not think we’re going to get to AGI anytime soon. I’ve seen no evidence of it, and the AI doom scenario is nonsensical in the extreme. Lee Cronin (02:26:12): The reason why I think it’s nonsensical … And I don’t think there isn’t things we should do and be very worried about. There are things we need to worry about right now, what AI are doing. Whether it’s fake data, fake users. I want authentic people, authentic data. I don’t want everything to be faked, and I think it’s a really big problem, and I absolutely want to go on the record to say I really worry about that. What I’m not worried about is that some fictitious entity is going to turn us all to paperclips or detonate nuclear bombs, or maybe, I don’t know, anything you can think of. Lee Cronin (02:26:49): Why is this? I’ll take a very simple series of logical arguments, and the AI doomers do not have the correct epistemology. They do not understand what knowledge is. And until we understand what knowledge is, they’re not going to get anywhere because they’re applying things falsely. So, let me give you a very simple argument. Lee Cronin (02:27:18): People talk about the probability, “P(doom)”, of AI. We can work out the probability of an asteroid hitting the planet. Why? Because it’s happened before. We know the mechanism. We know that there’s a gravity well, or that spacetime is bent and stuff falls in. We don’t know the probability of AGI because we have no mechanism. So, let me give you another one, which is like, “I’m really worried about AG.” What’s AG? AG is anti-gravity. “One day we could wake up and anti-gravity is discovered, we’re all going to die, the atmosphere is going to float away, we’re going to float away, we’re all doomed.” Lee Cronin (02:27:52): What is the probability of AG? We don’t know because there’s no mechanism for AG. Do we worry about it? No, and I don’t understand the current reason for certain people in certain areas to be generating this nonsense. I think they’re not doing it maliciously. I think we’re observing the emergence of new religions, how religions come, because religions are about some controls. Lee Cronin (02:28:20): You’ve got the optimist saying, “AI is going to cure us all,” and, “AI is going to kill us all.” What’s the reality? Well, we don’t have AI. We have really powerful machine learning tools and they will allow us to do interesting things, and we need to be careful about how we use those tools in terms of manipulating human beings and faking stuff. Right? Lex Fridman (02:28:38): Right. Well, let me try to steel man the AI doomers’ argument. And actually, I don’t know, are AI doomers in the Yudkowsky camp saying it’s definitely going to kill us? Because there’s a spectrum. Lee Cronin (02:28:38): 95% I think is the limit. Lex Fridman (02:28:54): Plus? 95%-plus, that’s the- Lee Cronin (02:28:55): No, not plus. I don’t know. I was seeing on Twitter today various things. But I think Yudkowsky is at 95%. Lex Fridman (02:29:02): But to belong to the AI doomer club, is there a threshold? I don’t know what the membership … Lee Cronin (02:29:06): Maybe. Lex Fridman (02:29:07): And what are the fees? Lee Cronin (02:29:09): Well, I think Scott Aronson, I was quite surprised, had put two … I saw this online, so I could be wrong. So, sorry if it’s wrong. He says 2%. But the thing is, if someone said there’s a 2% chance that you’re going to die going into the lift, would you go into the lift? Lex Fridman (02:29:24): In the elevator, for the American English-speaking audience. Well, no, not for the elevator. Lee Cronin (02:29:30): So, I would say anyone higher than 2% … I think there’s a 0% chance of AGI doom. Zero. Lex Fridman (02:29:37): Just to push back on the argument where N of zero on the AGI … We could see on Earth that there’s increasing levels of intelligence of organisms. We can see what humans with extra intelligence were able to do to the other species. So, that is a lot of samples of data, what a delta in intelligence gives you. When you have an increase in intelligence, how you’re able to dominate a species on Earth. Lex Fridman (02:30:08): So, the idea there is that if you have a being that’s 10x smarter than humans, we’re not going to be able to predict what that being is going to be able to do, especially if it has the power to hurt humans. Which, you can imagine a lot of trajectories in which the more benefit AI systems give, the more control we give to those AI systems over our power grid, over our nuclear weapons, or weapons of any sort. And then it’s hard to know what an ultra-intelligence system would be able to do in that case. You don’t find that convincing? Lee Cronin (02:30:50): I think I would fail that argument 100%. Here’s a number of reasons to fail it on. First of all, we don’t know where the intention comes from. The problem is that people keep … I’ve been watching all the hucksters online with the prompt engineering and all this stuff. When I talk to a typical AI computer scientist, they keep talking about the AIs having some kind of decision-making ability. That is a category error. Lee Cronin (02:31:17): The decision-making ability comes from human beings. We have no understanding of how humans make decisions. We’ve just been discussing free will for the last half an hour, right? We don’t even know what that is. So, the intention, I totally agree with you, people who intend to do bad things can do bad things and we should not let that risk go. That’s totally here and now. I do not want that to happen, and I’m happy to be regulated to make sure that systems I generate, whether they’re computer systems, or … I’m working on a new project called “Chem Machina”. Lex Fridman (02:31:53): Nice. Well done. Lee Cronin (02:31:54): Yeah, yeah. Which is basically a … Lex Fridman (02:31:59): For people who don’t understand the pun, the Ex Machina is a great film about I guess AGI embodied, and “chem” is the chemistry version of that. Lee Cronin (02:32:07): And I only know one way to embody intelligence, and that’s in chemistry and human brains. So, category error number one is that they have agency. Category error number two is assuming that anything we make is going to be more intelligent. Now, you didn’t say super-intelligent. I’ll put the words into our mouths here, super-intelligent. I think that there is no reason to expect that we are going to make systems that are more intelligent. More capable … Lee Cronin (02:32:38): When people play chess computers, they don’t expect to win now, right? The chess computer is very good at chess. That doesn’t mean it’s super-intelligent. So, I think that super-intelligence, and I think even Nick Bostrom is pulling back on this now, because he invented this … So, I see this a lot. When did I see it first happen? Eric Drexler, nanotechnology. Atomically precise machines. He came up with a world where we had these atom cogs everywhere and we were going to make self-replicating nanobots. Lee Cronin (02:33:06): Not possible. Why? Because there’s no resources to build these self-replicating nanobots. You can’t get the precision. It doesn’t work. It was a major category error in taking engineering principles down to the molecular level. The only functioning nanomolecular technology we know is produced by evolution. There. Lee Cronin (02:33:27): So, now let’s go forward to AGI. What is AGI? We don’t know. It’s super, it can do this, or humans can’t think. I would argue the only AGIs that exist in the universe are produced by evolution. And sure, we may be able to make our working memory better. We might be able to do more things. The human brain is the most compact computing unit in the universe. It uses 20 watts, uses a really limited volume. It’s not like a ChatGPT cluster which has to have thousands of watts, and a model that’s generated, and it has to be corrected by human beings. You are autonomous and embodied intelligence. Lee Cronin (02:34:04): So, I think that there are so many levels that we’re missing out, we’ve just kind of went, “Oh, we’ve discovered fire. Oh gosh, the planet’s just going to burn one day randomly.” I just don’t understand that leap. There are bigger problems we need to worry about. So, what is the motivation? Why are these people, and let’s assume they’re earnest, have this conviction? Well, I think they’re making leaps and they’re trapped in a virtual reality that isn’t reality. Lex Fridman (02:34:34): Well, I can continue a set of arguments here, but also it is true that ideologies that fearmonger are dangerous. Because you can then use it to control, to regulate in a way that halts progress, to control people, and to cancel people, all that kind of stuff. So, you have to be careful, because reason ultimately wins. Right? Lex Fridman (02:35:03): But there is a lot of concerns with super-intelligent systems, very capable systems. I think when you hear the word “super-intelligent”, you’re hearing, “It’s smarter than humans in every way that humans are smart.” But the paperclip manufacturing system doesn’t need to be smart in every way. It just needs to be smart in a set of specific ways. And the more capable the AI systems become, the more you could see us giving them control over, like I said, our power grid, a lot of aspects of human life. And then that means they’ll be able to do more and more damage when there’s unintended consequences that come to life. Lee Cronin (02:35:46): I think that that’s right. The unintended consequences we have to think about, and that I fully agree with. But let’s go back a bit. Sentience … Again, I’m far away from my comfort zone and all this stuff, but hey, let’s talk about it. Because I give myself a qualification. Lex Fridman (02:36:02): Yeah, we’re both qualified in sentience, I think, as much as anyone else. Lee Cronin (02:36:07): I think the paperclip scenario is just such a poor one, because let’s think about how that would happen. And also, let’s think about, we are being so unrealistic about how much of the Earth’s surface we have commandeered. For paperclip manufacturing to really happen, do the math. It’s not going to happen. There’s not enough energy, there’s not enough resource. Where is it all going to come from? Lee Cronin (02:36:32): I think that what happens in evolution, it’s really: Why has a killer virus not killed all life on Earth? Well, what happens is, sure, superkiller viruses that kill the ribosome have emerged. But you know what happens? They nuke a small space because they can’t propagate. They all die. So, there’s this interplay between evolution and propagation, right? And death. So … Lex Fridman (02:36:56): In evolution. You don’t think it’s possible to engineer, for example, and sorry to interrupt, but a perfect virus? Lee Cronin (02:37:02): No. Lex Fridman (02:37:02): That’s deadly enough? Lee Cronin (02:37:04): No. Nonsensical. I think again, it wouldn’t work. Because if it was too deadly, it would just kill the radius and not replicate. Lex Fridman (02:37:11): Yeah. But you don’t think it’s possible to get a … Lee Cronin (02:37:16): If you were … Lex Fridman (02:37:17): Not kill all of life on Earth, but kill all humans. There’s not many of us. There’s only like 8 billion. There’s so much more ants. So many more ants, and they’re pretty smart. Lee Cronin (02:37:32): I think the nice thing about where we are, I would love for the AI crowd to take a leaf out of the book of the bio-warfare, chemical warfare crowd. I mean, not love, because actually people have been killed with chemical weapons in the first and second World War, and bio-weapons have been made, and we can argue about COVID-19 and all this stuff. Let’s not go there just now. But I think there is a consensus that some certain things are bad and we shouldn’t do them, right? And sure, it would be possible for a bad actor to engineer something bad, but we would see it coming and we would be able to do something about it. Lee Cronin (02:38:16): Now, I guess what I’m trying to say is when people talk about doom, and when you ask them for the mechanism, they just make something up. In this case, I’m with Yann LeCun. I think you put out a very good point about trying to regulate jet engines before we’ve even invented them. And I think that’s what I’m saying. Lee Cronin (02:38:39): I’m not saying we should … I just don’t understand why these guys are going around literally making stuff up about us all dying, when basically we need to actually really focus on … Now, let’s say there’s some actors that are earnest. Let’s say Yudkowsky is being earnest and he really cares. But he loves it. He goes, “Da, da, da, and then you’re all going to die.” It’s like, why don’t we try and do the same thing and say, “You could do this, and then you’re all going to be happy forever after”? Lex Fridman (02:39:07): Well, I think there’s several things to say there. One, I think there is a role in society for people that say we’re all going to die. Because I think it filters through as a message, as a viral message that gives us the proper amount of concern. Meaning it’s not 95%, but when you say 95% and it filters through society, it’ll give an average of like a 0.03%. An average. So, it’s nice to have people that are like, “We’re all going to die,” and then we’ll have a proper concern. Lex Fridman (02:39:41): For example, I do believe we’re not properly concerned about the threat of nuclear weapons currently. It just seems like people have forgotten that that’s a thing, and there’s a war in Ukraine with a nuclear power involved. There’s nuclear powers throughout the world, and it just feels like war in the brink of a potential world war to a percentage that I don’t think people are properly calibrating in their head. We’re all thinking it’s a Twitter battle as opposed to actual threat. Lex Fridman (02:40:12): So, it’s nice to have that kind of level of concern. But to me, when I hear AI doomers, what I’m imagining is with unintended consequences a potential situation where let’s say 5% of the world suffers deeply because of a mistake made, of unintended consequences. I don’t want to imagine the entirety of human civilization dying, but there could be a lot of suffering if this is done poorly. Lee Cronin (02:40:39): I understand that, and I guess I’m involved in the whole hype cycle. So, let’s say having some people saying AI doom is a worry, fine. Let’s give them that. But what seems to be happening is there seems to be people who don’t think AI is doing that, and they’re trying to use that to control regulation and to push people to regulate, which stops humans generating knowledge. And I am an advocate for generating as much knowledge as possible. Lee Cronin (02:41:15): When it comes to nuclear weapons, I grew up in the ’70s and ’80s where there was nuclear doom and a lot of adults really had existential threat, almost as bad as now with AI doom. They were really worried. There were some great … Well, not great. There were some horrific documentaries. I think there was one called Threads that was generated in the UK, which, it was terrible. It was so scary. Lee Cronin (02:41:40): And I think that the correct thing to do is obviously get rid of nuclear weapons, but let’s think about unintended consequences. We’ve got rid of … This is going to be such a non sequitur. We got rid of all the sulfur particles in the atmosphere, right? All the soot. And what’s happened in the last couple of years is global warming has accelerated because we’ve cleaned up the atmosphere too much. So … Lex Fridman (02:42:02): Sure. The same thing if you get rid of nuclear weapons. You’ll get [inaudible 02:42:05]- Lee Cronin (02:42:05): Exactly, that’s my point. So, what we could do is if we actually started to put the AI in charge … Which I’d really like an AI to be in charge of all world politics, and this will sound ridiculous for a second. Hang on. But if we could all agree on the- Lex Fridman (02:42:19): The AI doomers just woke up on that statement. Lee Cronin (02:42:22): Yeah, yeah, yeah. But I really don’t like politicians who are basically just looking at local sampling. But if you could say globally, “Look, here’s some game theory here. What is the minimum number of nuclear weapons we need to distribute around the world to everybody to basically reduce war to zero?” Lex Fridman (02:42:40): Just the thought experiment of, the United States and China and Russia and major nuclear powers get together and say, “All right, we’re going to distribute nuclear weapons to every single nation on Earth.” Oh, boy. That has a probably greater than 50% chance of eliminating major military conflict, but it’s not a hundred percent. Lee Cronin (02:43:07): But I don’t think anyone will use them, because … And look, what you’ve got to try and do is to qualify for these nuclear weapons … This is a great idea. The game theorists could do this, right? Lex Fridman (02:43:19): Uh-huh. Lee Cronin (02:43:20): I think the question is this … I really buy your question. We have too many nukes. Just from a feeling point of view, that we’ve got too many of them. So, let’s reduce the number, but not get rid of them because we’ll have too much conventional warfare. So then, what is the minimum number of nuclear weapons we can distribute around to remove … Humans hurting each other is something we should stop doing. It’s not out with our conceptual capability … Lee Cronin (02:43:46): But right now, what about certain nations that are being exploited for their natural resources in the future for a short-term gain because we don’t want to generate knowledge? So, if everybody had an equal doomsday switch, I predict the quality of life of the average human will go up faster. I am an optimist, and I believe that humanity is going to get better and better and better, that we’re going to eliminate more problems. But I think, yeah, let’s- Lex Fridman (02:44:13): But the probability of a bad actor, of one of the nations setting off a nuclear weapon, you have to integrate that into the calculus here. Lee Cronin (02:44:26): But we just give you [inaudible 02:44:28] nukes population. Right? What we do is we … I can’t believe this. But anyway, let’s just go there. So, if a small nation with a couple of nukes uses one because they’re a bit bored or annoyed, the likelihood that they are going to be pummeled out of existence immediately is 100%. And yet they’ve only nuked one other city. I know this is crazy, and I apologize for … Lex Fridman (02:44:51): Well, no, no. Just to be clear, we’re just having a thought experiment that’s interesting. But there’s terrorist organizations that would take that trade. We have to ask ourselves a question of: Which percentage of humans would be suicide bombers, essentially? Where they would sacrifice their own life because they hate another group of people. I believe it’s a very small fraction, but is it large enough to, if you give out nuclear weapons … Lee Cronin (02:45:25): I can predict a future where we take all nuclear material and we burn it for energy, right? Because we’re getting there. And the other thing you could do is say, “Look, there’s a gap.” So, if we get all the countries to sign up to the virtual agreement where we have a simulation where we can nuke each other in the simulation and the economic consequences are catastrophic … Lex Fridman (02:45:43): Sure. In the simulation, I love it. It’s not going to kill all humans, it’s just going to have economic consequences. Lee Cronin (02:45:49): Yeah, yeah. I don’t know, I just made it up. It seems like a cool idea. Lex Fridman (02:45:51): No, it’s interesting. But it’s interesting whether that would have as much power on human psychology as actual physical nuclear explosion. Lee Cronin (02:45:59): I think so. Lex Fridman (02:46:00): It’s possible, but people don’t take economic consequences as seriously I think as actual nuclear weapons exploding. Lee Cronin (02:46:07): I think they do in Argentina, and they do in Somalia. And they do in a lot of these places where … No, I think this is a great idea. I’m a strong advocate now for … So, what have we come up with? Burning all the nuclear material to have energy. And before we do that, because MAD is good, mutually assured destruction is very powerful, let’s take it into the metaverse and then get people to kind of subscribe to that. And if they actually nuke each other even for fun in the metaverse, there are dire consequences. Lex Fridman (02:46:36): Yeah, yeah. So, it’s like a video game. We all have to join this metaverse video game … Lee Cronin (02:46:41): Yeah. I can’t believe we just … Lex Fridman (02:46:43): And then there’s dire economic consequences. And it’s all run by AI, as you mentioned, so the AI doomers are really terrified at this point. Lee Cronin (02:46:52): No, they’re happy. They have a job for another 20 years, right? Lex Fridman (02:46:55): Oh, fear-mongering. Lee Cronin (02:46:56): Yeah, yeah, yeah. I’m a believer in equal employment. Lex Fridman (02:47:00): You’ve mentioned that, what’d you call it … Chem Machina? Lee Cronin (02:47:06): Yeah. Lex Fridman (02:47:07): Yeah. So, you’ve mentioned that a chemical brain is something you’re interested in creating, and that’s the way to get conscious AI soon. Can you explain what a chemical brain is? Lee Cronin (02:47:22): I want to understand the mechanism of intelligence that’s gone through evolution, right? Because the way that intelligence was produced by evolution appears to be the following: origin of life, multi-cellularity, locomotion, senses. Once you can start to see things coming towards you, and you can remember the past and interrogate the present and imagine the future, you can do something amazing, right? And I think only in recent years did humans become Turing-complete, right? Lex Fridman (02:47:57): Yeah. Lee Cronin (02:47:58): Right? So, that Turing completeness kind of gave us another kick up. But our ability to process that information was produced in a wet brain. And I think that we do not have the correct hardware architectures to have the domain flexibility and the ability to integrate information, and I think intelligence also comes at a massive compromise of data. Right now we’re obsessing about getting more and more data, more and more processing, more and more tricks to get dopamine hits. So, when we look back on this going, “Oh yeah, that was really cool, because when I asked ChatGPT, it made me feel really happy and I got a hit from it.” But actually it just exposed how little intelligence I use in every moment, because I’m easily fooled. Lee Cronin (02:48:58): So, what I would like to do is to say, “Well, hey, hang on. What is it about the brain?” So, the brain has this incredible connectivity, and it has the ability to … As I said earlier about my nephew, I went from “Bill” to “Billy” and he went, “All right, Leroy.” How did he make that leap? That he was able to basically without any training … I extended his name in a way that he doesn’t like. He wants to be called Bill. He went back and said, “You like to be called Lee? I’m going to call you Leroy.” Lee Cronin (02:49:29): So, human beings have a brilliant ability, or intelligent beings appear to have a brilliant ability to integrate across all domains all at once, and to synthesize something which allows us to generate knowledge. And becoming Turing-complete on our own, although AIs are built and Turing-complete things, their thinking is not Turing-complete in that they are not able to build universal explanations. And that lack of universal explanation means that they’re just- Lee Cronin (02:50:00): Lack of universal explanation means that they’re just inductivists. Inductivism doesn’t get you anywhere. It’s just basically a party trick. I think it’s in The Fabric Of Reality from David Deutsch where basically the farmer is feeding the chicken every day and the chicken’s getting fat and happy. And the chicken’s like, “I’m really happy every time the farmer comes in and feeds me.” And then one day the farmer comes in and instead of feeding the chicken, just rings its neck. And had the chicken had an alternative understanding of why the farmer was feeding it. Lex Fridman (02:50:37): It’s interesting though, because we don’t know what’s special about the human mind that’s able to come up with these kind of generalities. This universal theories of things. And we’ll come up with novelty. I can imagine… Because you gave an example about William and Leroy. I feel like an example like that we’ll be able to see in future versions of large language models. We’ll be really, really, really impressed by the humor, the insights, all of it. Because it’s fundamentally trained on all the incredible humor and insights that’s available out there on the internet. So we’ll be impressed. I think we’ll be impressed. Lee Cronin (02:51:22): Oh, I’m impressed. I’m impressed. Lex Fridman (02:51:25): Increasingly so. Lee Cronin (02:51:26): But we are mining the past. Lex Fridman (02:51:28): Yes. Lee Cronin (02:51:28): And what the human brain appears to be able to do is mine the future. Lex Fridman (02:51:31): Yes. So novelty, it is interesting whether these large language models will ever be able to come up with something truly novel. Lee Cronin (02:51:41): I can show on the back of a piece of paper why that’s impossible. And it’s like the problem is that… And again these are domain experts kind of bullshitting each other. The term generative, right. Average person say, oh, it’s no, no, no. Look, if I take the numbers between zero and 1000 and I train a model to pick out the prime numbers by giving all the prime numbers between zero and a thousand, it doesn’t know what prime number is. Occasionally if I can cheat a bit, it will start to guess. Lee Cronin (02:52:12): It never will produce anything out with the dataset because you mine the past. The thing that I’m getting to is I think that actually current machine learning technologies might actually help reveal why time is fundamental. It’s like kind of insane. Because they tell you about what’s happened in the past, but they can never help you understand what’s happening in the future without training examples. Sure, if that thing happens again. So let’s think about what large language models are doing. We have all the internet as we know it, language, but also they’re doing something else. We having human beings correcting it all the time. Those models are being corrected, Lex Fridman (02:52:54): Steered. Lee Cronin (02:52:56): Corrected, modified, tweaked. Lex Fridman (02:53:01): Well, yeah, but- Lee Cronin (02:53:02): Cheating. Lex Fridman (02:53:04): Well you could say the training on human data in the first place is cheating. Lee Cronin (02:53:08): Well, human is in the loop. Sorry to interrupt. Lex Fridman (02:53:10): Yes. So human is definitely in the loop, but it’s not just human is in the loop. A very large collection of humans is in the loop. Lee Cronin (02:53:10): Look I totally- Lex Fridman (02:53:21): And that could be… I mean to me it’s not intuitive that you said prime numbers, that the system can’t generate an algorithm. That the algorithm that can generate prime numbers or the algorithm that can tell you if a number is prime and so on. And generate algorithms that generate algorithms, that generate algorithms that start to look a lot like human reasoning. Lee Cronin (02:53:46): I think again, we can show that on a piece of paper, that sure. I think you have to have… So this is the failure in epidemiology. I’m glad I even can say that word, let know what it means. Lex Fridman (02:53:59): You said it multiple times. Lee Cronin (02:54:00): I know. It’s like three times now. Lex Fridman (02:54:01): Without failure. Quit while you’re ahead. Just don’t say it again because you did really well. Lee Cronin (02:54:07): Thanks. But I think, so what is reasoning? So coming back to the chemical brain. If I could show the inner… Because I mean I’m never going to make an intelligence in ca machina. Because if you don’t have brain cells, they don’t have glial cells, they don’t have neurons. But if I can take a gel and engineer the gel to have it be a hybrid hardware for reprogramming, which I think I know how to do, I will able to process a lot more information and train models billions of times cheaper and use cross domain knowledge. And there’s certain techniques I think we can do. But there’s still missing, though the abilities that human beings have had to become true and complete. And so I guess the question to give back at you is like how do you tell the difference between trial and error and the generation of new knowledge? Lee Cronin (02:55:06): I think the way you can do it is this, is that you come up with a theory, an explanation, inspiration comes from out, and then you then test that, and then you see that’s going towards the truth. And human beings are very good at doing that. And the transition between philosophy, mathematics, physics and natural sciences. And I think that we can see that. Where I get confused is why people misappropriate the term artificial intelligence to say, “Hey, there’s something else going on here.” Because I think you and I both agree, machine learning’s really good, it’s only going to get better. We’re going to get happier with the outcome. But why would you ever think the model is thinking or reasoning? Reasoning requires intention. And the intention, if the model isn’t reasoning, the intentions come from the prompter. And the intention has come from the person who programmed it to do it. Lex Fridman (02:56:08): But don’t you think you can prompt it to have intention?Basically start with the initial conditions and get it going? Where currently large language models, ChatGPT only talks to you when you talk to it. There’s no reason why you can’t just start it talking. Lee Cronin (02:56:31): But those initial conditions came from someone starting it. Lex Fridman (02:56:35): Yes. Lee Cronin (02:56:35): And that causal chain in there. So that intention comes from the outside. I think that there is something in that causal chain of intention that’s super important. I don’t disagree, we’re going to get to AGI. It’s a matter of when and what hardware. I think we’re not going to do it in this hardware and I think we’re unnecessarily fetishizing really cool outputs and dopamine hits. Because obviously that’s what people want to sell us. Lex Fridman (02:56:57): Well, but there could be AGI is a loaded term. But there could be incredibly super impressive intelligence systems on the way to AGI. So these large language models, I mean if it appears conscious, if it appears super intelligent, who are we to say it’s not. Lee Cronin (02:57:21): I agree, but the super intelligence I want, I want to be able to have a discussion with it about coming up with fundamental new ideas that generate knowledge. And if the superintelligent we generate can mine novel even from the future that I didn’t see in its training set in the past, I would agree that something really interesting is coming on. I’ll say that again. If the intelligence system, be it a human being, a Chatbot, something else, is able to produce something truly novel that I could not predict ,even having full audit trail from the past, then I’ll be sold. Lex Fridman (02:57:58): Well, so we should be clear that it can currently produce things that are in a shallow sense novel. That are not in the training set. But you’re saying truly novel. Lee Cronin (02:58:11): I think they are in the training set. I think everything it produces comes from a training set. There’s a difference between novelty and interpolation. We do not understand where these leaps come from yet. That is what intelligence is I would argue. Those leaps and some people say no, it’s actually just what will happen if you just do cross domain training and all that stuff. And that may be true. And I may be completely wrong. But right now the human mind is able to mine novelty in a way that artificial intelligence systems cannot. And this is why we still all have a job. And we’re still doing staff. And I used ChatGPT for a few weeks. Oh this is cool. And then what happened is it took me too much time to correct it. Then it got really good. And now they’ve done something to it. It’s not actually that good. Lex Fridman (02:58:58): Yeah, right. Lee Cronin (02:58:59): I don’t know what’s going on. Lex Fridman (02:59:00): Censorship. Yeah, I mean that’s interesting. But it will push us humans to characterize novelty better. Characterize the novel, what is novel, what is truly novel, what’s the difference between novelty and interpolation. Lee Cronin (02:59:10): I think that this is the thing that makes me most excited about these technologies, is they’re going to help me demonstrate to you that time is fundamental. And the unit future is bigger than the present. Which is why human beings are quite good at generating novelty because we have to expand our dataset. And to cope with unexpected things in our environment. Our environment throws them all at us. Again, we have to survive in that environment. And I mean, I never say never. I would be very interested in how we can get cross domain training cheaply in chemical systems. Because I’m a chemist and bray, the only sim thing I know of is a human brain. But maybe that’s just me being boring and predictable and not novel. Lex Fridman (02:59:54): Yeah. You mentioned GPT for electron density. So a GPT like system for generating molecules that can bind to host automatically. I mean that’s interesting. I’s really interesting. Applying this same kind of transform mechanism. Lee Cronin (03:00:11): I mean, my team, I try and do things that are non obvious but non obvious in certain areas. And one of the things I was always asking about in chemistry, people like to represent molecules as graphs and it’s quite difficult. It’s really hard if you’re doing AI and chemistry, you really want to basically have good representations. You can generate new molecules are interesting. And I was thinking, well molecules aren’t really graphs and they’re not continuously differentiable. Could I do something that was continuously differentiable? I was like, well, molecules are actually made up of electron density. So I got thinking and say, well, okay, could there be a way where we could just basically take a database of readily solved electron densities for millions of molecules? So we took the electron density for millions of molecules and just train the model to learn what electron density is. Lee Cronin (03:01:06): And so what we built was a system that you literally could give it a, let’s say you could take a protein that has a particular active site or a cup with a certain hole in it. You pour noise into it and with A GPT you turn the noise into electron density. And then in this case it hallucinates, like all of them do. But then hallucinations are good because it means I don’t have to train on such a huge dataset, because these data sets are very expensive. How do you produce it? So go back a step. So you’ve got all these molecules in this dataset, but what you’ve literally done is a quantum mechanical calculation. We produce electron densities for each molecule. So you say, oh, this representation of this molecule has these electron densities associated with it, so you know what the representation is and you train the neural network to know what electron density is. Lee Cronin (03:01:54): So then you give it an unknown pocket. You pour in noise and you say, right, produce me electron density, it produces electron density that doesn’t look ridiculous. And what we did in this case is we produce electron density that maximizes the electrostatic potential, so the stickiness, but minimizes what we call the steric hindrance. So the overlaps, so it’s repulsive. So make the perfect fit. And then we then use kind of like a ChatGPT type thing to turn that electron density into what’s called a smile. A smile string is a way of representing a molecule in letters. And then we can then- Lex Fridman (03:02:32): So it just generates them then. Lee Cronin (03:02:34): Just generates them. And then the other thing is then we bung that into the computer and then it just makes it. Lex Fridman (03:02:39): Yeah, the computer being the thing that right… To generate- Lee Cronin (03:02:40): The robot we’ve got that can basically just do chemistry. So we’ve kind of got this end-to-end drug discovery machine where you can say, “Oh, you want to bind to this active site, here you go.” I mean it is a bit leaky and things kind of break, but it is the proof of principle. Lex Fridman (03:02:56): But were the hallucinations, are those still accurate? Lee Cronin (03:03:01): Well the hallucinations are really great in this case, because in the case of a large language model, the hallucinations just make everything up. It doesn’t just make everything up, but it gives you an output that you are plausibly comfortable with and thinks you’re doing probabilistically. The problem on these tron density models is it’s very expensive to solve a shredding equation going up to many heavy atoms and large molecules. And so we wondered if we trained the system on up to nine heavy atoms, whether it would go beyond nine and it did, It started to generate molecules for 12. No problem. They look pretty good. And I was like, well this hallucination I will take for free. Thank you very much. Lee Cronin (03:03:42): Because it just basically… This is a case where interpolation extrapolation worked relatively well. And we were able to generate the really good molecules. And then what we were able to do here is, and this is a really good point and what I was trying to say earlier, that we were able to generate new molecules, from the known set, that would bind to the host. So a new guest would bind. Were these truly novel? Not really because they were constrained by the host. Were they new to us? Yes. So I do, well understand… I can concede that machine learning systems, artificial intelligence systems can generate new entities, but how novel are they? It remains to be seen. Lex Fridman (03:04:32): And how novel the things that humans generate is also difficult to quantify. They seem novel. Lee Cronin (03:04:40): That’s what a lot of people say. So the way to really get to genuine novelty, and assembly theory shows you the way, is to have different causal chains overlap. And this really, really resonates with the time is fundamental argument. And if you are bringing together a couple of objects with different initial conditions coming together, when they interact, the more different their histories, the more novelty they generate in time going forward. And so it could be that genuine novelty is basically about mix it up a little. And the human brain is able to mix it up a little little, and all that stimulus comes from the environment. But all I think I’m saying is the universe is deterministic going back in time. Non-deterministic going forward in time. Because the universe is too big in the future to contain in the present. Therefore these collisions of known things generate unknown things, that then become part of your data set and don’t appear weird. That’s how we give ourselves comfort. The past looks consistent with this initial condition hypothesis, but actually we’re generating more and more novelty. And that’s how it works. Simple. Lex Fridman (03:05:58): So it’s hard to quantify novelty looking backwards. I mean the present and the future at the novelty generators. Lee Cronin (03:06:05): But I like this whole idea of mining novelty. I think it is going to reveal why the limitations of current AI is a bit like a printing press. Everyone thought that when the printing press came that writing books is going to be terrible, that you had evil spirits and all this. They were just books. Lex Fridman (03:06:26): And same with AI. But I think just the scale you can achieve in terms of impact with AI systems is pretty nerve wracking. Lee Cronin (03:06:35): But that’s what the big companies want you to think. Lex Fridman (03:06:39): But not in terms of destroy all humans. But you can have major consequences in the way social media has had major consequences, both positive and negative. And so you have to think about it and worry about it. But yeah, people that fear monger… Lee Cronin (03:06:55): My pet theory for this, you want to know? Lex Fridman (03:06:58): Yeah. Lee Cronin (03:06:59): Is I think that a lot… And maybe I’m being… And I really do respect a lot of the people out there who are trying to have discourse about the positive future. So open AI guys, meta guys and all this. What I wonder if they’re trying to cover up for the fact that social media has had a pretty disastrous effect at some level, and they’re just trying to say, “Oh yeah, we should do this.” Covering up for the fact that we have got some problems with teenagers, and Instagram, and Snapchat, and all this stuff, and maybe they’re just overreacting now. It’s like, “Oh yeah, sorry, we made the bubonic plate and gave it to you all and you’re all dying.” And “Oh yeah, but look at this over here it’s even worse.” Lex Fridman (03:07:40): Yeah, there’s a little bit of that. But there’s also not enough celebration of the positive impact that all of these technologies have had. We tend to focus on the negative and tend to forget that. In part because it’s hard to measure. It is very hard to measure the positive impact social media had on the world. Lee Cronin (03:07:58): Yeah, I agree. But what I worry about right now is I do care about the ethics of what we’re doing. And one of the reasons why I’m so open about the things we’re trying to do in the lab, make life look at intelligence, all this, so people say, what are the consequences of this? And you say, what are the consequences of not doing it? And I think that what worries me right now in the present is lack of authenticated users and authenticated data and- Lex Fridman (03:08:25): Human users. Lee Cronin (03:08:26): Yeah, human. Lex Fridman (03:08:28): I still think that there will be AI agents that appear to be conscious, but they would have to be also authenticated and labeled as such. There’s too much value in that. Like friendships with AI systems. There’s too much meaningful human experiences to have with the AI systems that I just… Lee Cronin (03:08:48): But that’s like a tool, right? It’s a bit like a meditation tool, right? Lex Fridman (03:08:50): Sure. Lee Cronin (03:08:50): Some people have a meditation tool, it makes them feel better. But I’m not sure you can ascribe sentience and legal rights to a chatbot that makes you feel less lonely. Lex Fridman (03:09:00): Sentience, yes. I think legal rights, no. I think it’s the same. You can have a really deep, meaningful relationship with a dog. Lee Cronin (03:09:08): Well the dog is sentient. Lex Fridman (03:09:10): Yes. Lee Cronin (03:09:12): The chatbots right now, using the technology we use, it’s not going to be sentient. Lex Fridman (03:09:16): This is going to be a fun continued conversation on Twitter that I look forward to. Since you’ve had also from another place some debates that were inspired by the assembly theory paper, let me ask you about God. Is there any room for notions of God in assembly theory? Of God. Lee Cronin (03:09:42): Yeah. I don’t know what God is a… I mean, so God exists in our mind created by selection. So the human beings have created the concept of God in the same way that human beings have created the concept of super intelligence. Lex Fridman (03:09:57): Sure, but does it mean, does it not… It still could mean that that’s a projection from the real world where we’re just assigning words and concepts to a thing that is fundamental to the real world. That there is something out there that is a creative force underlying the universe. Lee Cronin (03:10:22): I think the universe… There is a creative force in the universe, but I don’t think it’s sentient. So I do not understand the universe. So who am I to say that God doesn’t exist? I am an atheist, but I’m not an angry atheist. There’s some people I know that are angry atheists and say- Lex Fridman (03:10:49): Cranky. Lee Cronin (03:10:50): Say that religious people are stupid. I don’t think that’s the case. I have faith in some things. I mean when I was a kid I was like, I need to know what the charge of electron is. And I was like, I can’t measure the charge on electron. I just gave up and had faith. Okay, you know, resistors worked. So when it comes to… I want to know why the universe is growing in the future and what humanity is going to become. And I’ve seen that the acquisition of knowledge via the generation of novelty to produce technology has uniformly made humans’ lives better. I would love to continue that tradition. Lex Fridman (03:11:31): You said that there’s that creative force. Do you think, just to think on that point, do you think there’s a creative force? Is there like a thing, like a driver that’s creating stuff? Lee Cronin (03:11:45): Yeah, so I think that… Lex Fridman (03:11:48): And where? What is it? Can you describe it mathematically? Lee Cronin (03:11:51): Well, I think selection. I think selection. Lex Fridman (03:11:53): Selection is the force. Lee Cronin (03:11:54): Selection is the force in the universe. It creates novelty. Lex Fridman (03:11:58): So is selection somehow fundamental? Like what… Lee Cronin (03:12:03): Yeah, I think persistence of objects that could decay into nothing through operations that maintain that structure. I mean, think about it. It’s amazing that things exist at all. That we’re just not a big commentorial mess. Lex Fridman (03:12:17): Yes. Lee Cronin (03:12:18): So the fact that- Lex Fridman (03:12:21): And exist. A thing that exists persist in time. Lee Cronin (03:12:23): Yeah. Let’s think, maybe the universe is actually in the present. The things… Everything that can exist in the present does exist. Lex Fridman (03:12:39): Well that would mean it’s deterministic, right? Lee Cronin (03:12:42): I think the universes might. So the universe started super small. The past was deterministic, there wasn’t much going on. And it was able to mine mine, mine, mine, mine. And so the process is somehow generating universes basically… I’m trying to put this into words. Lex Fridman (03:13:02): Did you just say there’s no free will though? Lee Cronin (03:13:04): No, I didn’t say that. Lex Fridman (03:13:05): As if- Lee Cronin (03:13:06): Sorry, sorry, sorry. Lex Fridman (03:13:06): -it can exist. Lee Cronin (03:13:07): I said there is free will. I’m saying that free will occurs at the boundary between the- Lex Fridman (03:13:17): The past and the future? Lee Cronin (03:13:19): The past and the future. Lex Fridman (03:13:20): Yeah, I got you. But everything that can exist does exist. Lee Cronin (03:13:25): So everything that’s possible to exist at this… So no, I’m really pulling this… Lex Fridman (03:13:30): There’s a lot of loaded words there. There’s a time element loaded into that statement. Lee Cronin (03:13:36): I think that the universe is able to do what it can in the present, right? Lex Fridman (03:13:40): Yeah. Lee Cronin (03:13:40): And then I think in the future there are other things that could be possible. We can imagine lots of things, but they don’t all happen. Lex Fridman (03:13:45): Sure. Lee Cronin (03:13:46): So what- Lex Fridman (03:13:46): So that’s where- Lee Cronin (03:13:47): So that’s what I guess I’m getting to. Lex Fridman (03:13:49): -you sneak in free will right there. Lee Cronin (03:13:50): Yeah. So I guess what I’m saying is what exists is a convolution of the past with the present, and the free will going into the future. Lex Fridman (03:14:00): Well, we could still imagine stuff. Right? We can imagine stuff that will never happen. Lee Cronin (03:14:04): And it’s amazing force. Because this is the most important thing that we don’t understand. Is our imaginations can actually change the future in a tangible way. Which is what the initial conditions and physics cannot predict. Your imagination has a causal consequence in the future. Lex Fridman (03:14:25): Isn’t that weird to you? Lee Cronin (03:14:26): Yeah. It breaks the laws of physics as we know them right now. Lex Fridman (03:14:37): So you think the imagination has a causal effect on the future? Lee Cronin (03:14:41): Yeah. Lex Fridman (03:14:42): But it does exist in there in the head. Lee Cronin (03:14:45): It does, but- Lex Fridman (03:14:45): There must be a lot of power in whatever’s going on. There could be a lot of power, whatever’s going on in there. Lee Cronin (03:14:50): If we then go back to the initial conditions, and that is simply not possible that can happen. But if we go into a universe where we accept that there is a finite ability to represent numbers. And you have rounding… Well not rounding errors, you have sum… What happens, your ability to make decisions, imagine and do stuff is that that interface between the certain and the uncertain. It’s not as Yashar was saying to me, “Randomness goes and you just randomly do random stuff.” It is that you are set free a little on your trajectory. Free will is about being able to explore on this narrow trajectory, that allows you to build… You have a choice about what you build. Or that choice is you interacting with a future in the present. Lex Fridman (03:15:39): What to you is most beautiful about this whole thing? The universe? Lee Cronin (03:15:46): The fact it seems to be very undecided, very open. The fact that every time I think I’m getting towards an answer to a question, there are so many more questions that make the chase. Lex Fridman (03:16:03): Do you hate that it’s going to be over at some point for you? Lee Cronin (03:16:06): No. Well for me. I think if you think about it, is it over for Newton now? Newton has had causal consequences in the future. We discuss him all the time, Lex Fridman (03:16:18): His ideas, but not the person. Lee Cronin (03:16:21): The person just had a lot of causal power when he was alive. But oh my God, one of the things I want to do is leave as many Easter eggs in the future when I’m gone to go, “Oh, that’s cool.” Lex Fridman (03:16:30): Would you be very upset if somebody made a good large language model that’s fine tuned to Lee Cronin? Lee Cronin (03:16:37): It would be quite boring. Because I mean, I… Lex Fridman (03:16:40): No novelty generation? Lee Cronin (03:16:42): I mean if it’s a faithful representation of what I’ve done in my life, that’s great. That’s an interesting artifact. But I think the most interesting thing about knowing each other is we don’t know what we’re going to do next. Lex Fridman (03:16:54): Sure. Sure. Lee Cronin (03:16:57): I mean within some constraints I’ve got, I can predict some things about you. You can predict some things about me. But we can’t predict everything. Lex Fridman (03:17:04): Everything. Lee Cronin (03:17:05): And it’s because we can’t predict everything is why we’re exciting to come back and discuss and see. So yeah, I’m happy that it’ll be interesting that some things that I’ve done can be captured, but I’m pretty sure that my angle on mining novelty for the future will not be captured. Lex Fridman (03:17:28): Yeah. Yeah. So that’s what life is, is just some novelty generation and then you’re done. Each one of us just generally a little bit. Or have the capacity to at least. Lee Cronin (03:17:43): I think life is a selection produces life. And life affects a universe. Universes with life in them are materially, physically, fundamentally different than universes without life. And that’s super interesting. And I have no beginnings of understanding. I think maybe this is in a thousand years, there’ll be a new discipline. And the humans will be like, “Yeah, of course. This is how it all works.” Right? Lex Fridman (03:18:10): In retrospect, it’ll all be obvious I think. Lee Cronin (03:18:13): I think assembly theory is obvious, that’s why a lot of people got angry. They were like, “Oh my God, this is such nonsense.” And like, “Oh, actually it’s not quite.” But the writing’s really bad. Lex Fridman (03:18:25): Well, I can’t wait to see where it evolves, Lee. And I am glad I get to exist in this universe with you. You’re a fascinating human. This is always a pleasure. I hope to talk to you many more times. And I’m a huge fan of just watching you create stuff in this world. And thank you for talking today. Lee Cronin (03:18:44): It’s a pleasure as always, Lex. Thanks for having me on. Lex Fridman (03:18:47): Thanks for listening to this conversation with Lee Cronin. To support this podcast, please check out our sponsors in the description. And now, let me leave you with some words from Carl Sagan. We can judge our progress by the courage of our questions, and the depth of our answers. Our willingness to embrace what is true rather than what feels good. Thank you for listening. And hope to see you next time.

本集資源與出處