特別節目·中文精讀

大衛·查爾默斯:意識的難問題

David Chalmers: The Hard Problem of Consciousness

哲學家查爾默斯討論為什麼物理過程會伴隨主觀體驗,以及泛心論、幻覺論等幾種主要解釋路徑。

官方音訊00:00 / --:--
中文精讀由 AI 基於原始訪談改寫,非官方翻譯,可能存在偏差或錯誤;表述以原音訊與官方文稿為準。說明

大衛·查爾默斯(David Chalmers)正在寫一本關於模擬假說的書。在這期訪談裡,他丟擲了一個讓很多人不舒服的判斷:如果有一天我們真發現自己活在模擬裡,那也沒什麼大不了,因為這一切依然是真的。

他把這個說法叫「現實 2.0」。底層換了,材質換了,它依舊是現實,只是現實的一個新版本。

這個立場聽起來像文字遊戲,背後卻是一整套關於「什麼是真實」的哲學反思。而這套反思,又從他從最出名的那件事延伸出來:意識的難問題。

假如我們在第 42 層模擬裡

查爾默斯的思路是這樣的:我們早就知道,眼睛看到的這個世界不是世界的全部。牛頓時代的人以為桌子就是桌子,後來我們知道桌子底下是原子,原子底下是夸克,夸克底下可能是弦。哲學家威爾弗裡德·塞拉斯(Wilfrid Sellars)把這個日常感知的世界叫作「顯象」(manifest image),把科學描述的那個底層世界叫作「科學影象」(scientific image)。

這兩個影象之間的關係,是人類認知史上反覆出現的主題。顯象是我們能直接互動的部分,科學影象是它真正的底層。模擬假設,在查爾默斯看來,只是關於這個底層的最新一版猜測。

所以康德問「物自體是什麼」,查爾默斯給了一個很當代的回答:物自體可能是一堆在上一層宇宙的計算機裡跑著的資料結構。就這樣。它屬於底層,與幻象無關。

那模擬能套多少層?他半開玩笑地提過一個數字:第 42 層,順手致敬了《銀河系漫遊指南》。如果真是這樣,那第 0 層得是什麼規模?

如果我們在第 42 層,那麼頂層一定非常龐大。不只是一個有限的大,更可能是無限的。可能它的基數高到足以支撐任意多個模擬。第 0 層是極高的無窮,第 1 層稍小一點,等到了我們這一層,空間就已經相當有限了。(查爾默斯)

他用了費曼那句著名的話來收尾:「底下有的是空間」(There's plenty of room at the bottom)。意思是,即使我們這一層資源有限,距離物理計算的極限也還遠得很。我們未必能模擬一個和我們一樣複雜的宇宙,但模擬一個稍微簡單一點的、相當精細的宇宙,理論上綽綽有餘。

至於人類在這個尺度上算什麼,他的評價有點冷酷:我們挺了不起的,但也就那樣。進化從單細胞走到魚、走到哺乳動物、走到靈長類,然後在幾萬年前突然跨過了一個門檻,語言、文化、集體思維一下子都出來了。所以人類大概處在「智慧譜系的底端往上一點點」的位置。

如果我們在模擬裡,那些造出我們這一層的模擬者,能力遠超我們。第 0 層的存在是什麼樣,我完全無法想象。(查爾默斯)

模擬大腦,意識會跟著來嗎

訪談裡有個很自然的追問:模擬宇宙和模擬心智,哪個更難?

標準答案是模擬心智更簡單,因為心智是宇宙的一部分。查爾默斯把這個問題往下拽了一層:模擬大腦和模擬心智,是兩件不同的事。大腦是一個物理系統,和星系、天氣系統沒有本質區別,只要算力夠,模擬它沒有原理上的障礙。模擬完大腦,意識會不會跟著冒出來,那是另一回事。

他的立場很明確:會。

我的看法大致是,如果你把大腦模擬得足夠好,心智也會被模擬出來。當然很多人不同意,他們會說那只是一個殭屍系統,一個沒有真正意識的大腦模擬。(查爾默斯)

為什麼他這麼認為?因為他相信意識依附的是資訊處理的模式,而非生物組織本身。他的說法是,意識與大腦之間最深的同構關係,指向的正是資訊處理模式,具體的生物學實現反而不重要。你可以把神經元換成功能等價的矽電路,行為不變,模式不變,那麼意識也不該變。

他承認這只是一個工作假設,談不上結論。畢竟意識本身還沒被理解,任何關於它的判斷都帶著不確定性。這個假設有個很實用的推論:意識落在軟體層,硬體層換掉也無妨。這就為後來的討論開啟了門,包括虛擬現實、腦機介面、心智上傳。

在 VR 裡,大腦在哪兒

聊到虛擬現實的時候,查爾默斯描述了現在 VR 世界的一個奇特結構:物理規律在頭盔裡,但大腦在頭盔外。你在 VR 裡給一個角色做開顱手術,開啟頭骨,裡面什麼都沒有,因為真正的腦在另一個地方。

這讓他想起笛卡爾。笛卡爾認為身體是一套機械,心智是另一套東西,兩者透過松果體互動。現代人早就不這麼想了,我們相信心智深深嵌在物理裡。但在今天的虛擬世界裡,笛卡爾式的二元結構居然真實存在,物理世界在這邊,控制它的心智在那邊。這個反諷他講得很來勁。

未來會變。一旦通用人工智慧成熟,虛擬世界裡可能真的跑著有意識的心智,它們在裡面感知、決策、社交,和我們在這個世界做的事沒有本質區別。到那時候,「這個虛擬世界裡的存在有沒有意識」就不再是技術問題,而成了倫理問題。

他自己對 VR 的態度有點矛盾。他有一堆裝置,Oculus Rift、Quest、HTC Vive,可每次戴上頭盔待不過 10 到 20 分鐘,總覺得有點排斥。反而是桌面上的網際網路讓他上癮。他解釋不了這種差異,只承認有這麼回事。

訪談裡還有一個問題:在 VR 裡待久了,能不能真的忘了外面的世界?他的回答很樸素:我們有相當好的記憶,你也許可以不再注意外部世界,但完全忘掉它,大概需要「相當猛的藥」。

歌曲曾經是有顏色的

查爾默斯小時候有通感(synesthesia)。聽音樂的時候,他會看到顏色。

大部分時候顏色是暗的、渾濁的,橄欖綠和深棕色的混合體。他猜是因為不同和絃和音色帶來的顏色混在一起,最後變成一團沒什麼意思的褐色和綠色。偶爾會有很純粹的顏色跳出來。他記得披頭士的《Here, There and Everywhere》是亮紅色,開頭那段和絃結構很特別。還有艾倫·帕森斯計劃(The Alan Parsons Project)的《Ammonia Avenue》,那是很純粹的一種藍。

他當時以為所有人都這樣。偶爾跟人提起,對方一臉茫然。直到讀研究生開始研究心智,他才讀到「通感」這個詞,才反應過來:哦,原來我有過這個。

20 歲左右,這個能力消失了。他有一篇當時的日記,寫的是「歌曲不再有顏色了」。他承認當時挺難過,現在回頭看,那更像是丟掉了一個小小的額外體驗,算不上生活的支柱。

我知道有些人有嚴重得多的通感,對他們來說這是生活的核心。看到人就有顏色,看到字就有顏色,聽到音樂就有非常豐富的色彩圖案。如果這些人失去了通感,他們會崩潰。我的是非常非常輕微的那種。(查爾默斯)

這段插敘不只是趣聞。它其實是一個很好的引子,因為通感恰好站在意識研究的一個關鍵位置上:同樣的物理刺激,為什麼會產生完全不同的主觀體驗?這就是「qualia」要處理的問題。

難問題到底難在哪

訪談進行到這裡,查爾默斯把最核心的概念擺了出來。

意識這個詞有很多用法。他關心的是主觀體驗,也就是從內部看,作為一個人類或者任何一個有意識的生物,是什麼感覺。此刻他自己有視覺影象、有聲音、有情緒底色、有一串念頭流過。這些都以第一人稱的方式被經歷。他有時候把它叫作「心智裡的內部電影」,隨即補了一句:這個比喻不完美,但方向是對的。

哲學家有時用「qualia」這個詞,指紅色的紅、綠色的綠、這種味道和那種味道的差別、疼痛的那種質感。意識比 qualia 更大。你在想家鄉、在想晚飯吃什麼,這些思維活動裡也有主觀體驗,可它們算不上某種特定的「質」。

然後他把問題分成三層:

  • 容易的問題:大腦如何處理資訊、如何引導行為、如何支撐說話與行動。這些問題難,但原則上可以用結構、動力學、計算模型來解決。
  • 難問題:為什麼這些物理過程會伴隨主觀體驗?為什麼不是「全部在黑暗中執行」?
  • 元問題:為什麼我們會覺得這個問題難?為什麼人類會被意識困擾?

第三層是他最近幾年寫文章討論的重點。他的思路是:「我們被意識困擾」本身是一種行為,而行為是可以用計算模型解釋的。如果有一天我們能用資訊處理的語言解釋為什麼一個系統會發展出「我有主觀體驗」這樣的自我模型,那元問題就解決了。元問題解決,不等於難問題解決。

難問題是:大腦如何產生意識。元問題是:為什麼我們對難問題感到困惑。後者是前者的行為層面,前者是體驗層面。這兩件事不能混為一談。(查爾默斯)

如果萬物皆有意識

訪談裡有一段討論泛心論(panpsychism),這也是查爾默斯自己認真對待的一個立場。

他的推理路徑是這樣的:物理學告訴我們粒子如何相互作用、如何隨時間和空間演化,但物理學不告訴我們粒子本身是什麼。它給的是關係,不是內在本性。這一點從洛克到羅素都有人提過。那麼,粒子的內在本性是什麼?一種可能的回答是:某種心靈性的東西。

如果這個思路成立,那麼每一個基本粒子都帶有某種極微小的意識,其結構對應它的物理屬性,質量、電荷、速度。物理定律在底層就是在描述這些意識主體之間的關係。牛頓式的宇宙會是一個由無數極微小的意識主體構成的巨大集合,它們遠比我們簡單,沒有自由意志,沒有理性,可它們在那裡。

再往前一步,量子力學裡的波函式如果只有一個,對應整個宇宙,那麼對應的可能就是某種單一的宇宙心智,結構對應波函式的結構。有人把這叫「宇宙泛心論」(cosmopsychism)。

查爾默斯自己也說,這些是高度思辨的領域,沒有直接證據。他甚至提出了另一個版本,叫「泛原心論」(panprotopsychism):也許底層並非意識本身,真正存在的是某種「原意識」的屬性 X,X 加上時空、質量,集體地產生了意識的可能。他不排除這個版本。

如果你不能想象底層有真正的意識,那我們至少應該對這樣一種可能保持開放:還有某種我們想象不到的東西 X,它以某種方式給了你意識。(查爾默斯)

他也提到整合資訊理論(IIT,integrated information theory),朱利奧·託諾尼(Giulio Tononi)的理論。IIT 認為意識對應於系統的整合資訊量,任何有整合資訊的系統都有某種程度的意識,哪怕只有幾個粒子。這個理論在神經科學界有一批嚴肅的支持者,查爾默斯剛收到克里斯托夫·科赫(Christof Koch)的新書《The Feeling of Life Itself》,書裡基本站在這一邊。他也提醒,這個領域還非常早期,爭議很大。

宇宙透過我們的眼睛看自己

訪談裡引了 Alan Watts 的一段話:透過我們的眼睛,宇宙在感知自己;透過我們的耳朵,宇宙在聆聽自己的和諧;我們是宇宙藉以意識到自身榮光的見證者。

查爾默斯的回應很有意思。他說,如果你信宇宙心智,那宇宙一直都有意識,不需要我們,我們只是它的一小部分。如果你信泛心論,那底層一直都有微小的意識,我們只是更復雜的形態。這段話在兩個立場下都成立,含義卻變了。

他自己的立場,更接近正統觀點:意識是某種在宇宙歷史中某個時刻出現的東西,人類和一些動物有,也許未來的人工系統會有,但它不是自古就有的。

大多數哲學家和大多數研究意識的科學家不是泛心論者。過去十年這個方向有點回潮,在年輕一代裡尤其受歡迎,但它仍然明顯是少數派。很多人覺得這觀點簡直離譜,用個專業術語講,就是「瘋得沒邊」。(查爾默斯)

他也提到 NYU 的同事托馬斯·內格爾(Thomas Nagel),幾年前寫了《Mind and Cosmos》,主張一種目的論的演化觀,認為宇宙在朝著意識的方向演化。這本書爭議極大,查爾默斯自己也不認同這個目的論版本,但他承認這套思辨圖景很漂亮。

意義是意識給的,但意識不是意義本身

訪談聊到宗教體驗的時候,查爾默斯說自己完全沒有宗教信仰。他理解人們在祈禱和宗教實踐裡追求什麼:意義感,價值感,與某種大於自身的東西的連線感。他推測,如果神是一個宇宙意識,那與神的連線就能給你的生命注入意義。

他隨即反問了一個很鋒利的問題:

如果宇宙意識能給世界賦予意義,為什麼區域性的意識不能?我的意識給我的世界賦予意義,它就是我世界裡意義的源頭。我經歷事情為好或壞、快樂或悲傷、有趣或重要,我的意識由此給這個世界注入了意義。沒有意識,也許宇宙是荒涼無意義的。可我不明白為什麼需要別人的意識,甚至是神的意識,來給這個宇宙意義。我們就是有主觀體驗的區域性生物,我們可以自己給宇宙賦予意義。(查爾默斯)

他承認,有些人會覺得這不夠,覺得個人的區域性意識太渺小,撐不起宇宙尺度的重要性,所以需要一個神來提供「宇宙級的意義」。他自己不需要。

那生命的意義是什麼?他的回答很剋制,也很清楚:意識是意義的來源,意識本身卻算不上意義。意義來自你在意的東西。如果你在智識工作裡找到理解和滿足,那就是你生命意義的重要部分。如果你在人際關係裡、在養育子女裡找到,那也是。沒有一個普適的答案。

生命的意義,是作為一個有意識的生物,你在哪裡找到它,它就在哪裡。(查爾默斯)

殭屍電車難題

這套「意識是道德分界線」的立場,查爾默斯用一個思想實驗來說明。

經典的電車難題是:一邊一個人,一邊五個人,你扳不扳道岔。他給了一個變體:一邊是一個有意識的生物,另一邊是五個行為上和人類完全一樣的殭屍,或者乾脆說是五個機器人,它們沒有主觀體驗。

你會撞哪邊?

大多數人的直覺很清楚:撞那五個無意識的。因為它們沒有真正意義上的生活,它們算不上真正的人。

這個思想實驗是純粹的假設,物理上行為完全相同的殭屍大概造不出來。它的弱版本離我們不遠:一個能對話、能用語言、能處理複雜任務的機器人,但沒有意識。這種系統在今天已經有雛形,未來幾十年會越來越強。

如果你把這個杯子打碎,那是不好,但不好是因為會弄得一團亂,會讓我和我伴侶煩。沒有人會說杯子本身受到了道德傷害。但如果一個存在是有意識的,你傷害它,那就是真的在傷害它。(查爾默斯)

所以,Alexa 關掉、斷網、甚至銷燬,我們不會覺得是在做道德傷害。但《她》(Her)裡的薩曼莎不一樣,電影把她呈現為有意識的,摧毀她就是嚴重的傷害。

他由此推到了一個更遠的地方:如果有一天機器人真的有了意識,會有一場類似民權運動的事情發生。

我認為會有某種類似於民權運動的東西,物件是機器人。設想一個 Roomba 對你說「請不要踢我,那很疼」。只要它說出這句話,我認為社會的結構就會從根本上改變。(查爾默斯)

但這會很麻煩。只要有一個開關,有意識的系統就能被批次製造出來。法律地位會很複雜,道德地位應該平等,立法卻會遠遠跟不上。他自己也說,這會是一團亂麻。

我會怎麼判斷一個 AI 有意識

那麼,怎麼知道一個系統有沒有意識?查爾默斯承認這個問題極難,幾乎無法確定地解決。他給了幾個訊號。

其中一個很有意思:如果這個系統對自己的意識感到困惑,那是一個好跡象。

如果我遇到一個機器人,它看起來真的被自己的心智狀態搞糊塗了,它說「我有這些奇怪的體驗,我不知道怎麼解釋。我知道我只是一堆矽電路,但我看不出那怎麼會產生我的意識」。我至少會把這當成某種證據,說明那裡有某種意識在運作。(查爾默斯)

他馬上補充,這算不上必要條件。很多人對自己的意識並不困惑,動物看起來完全不困惑,他仍然認為動物有意識。困惑只是一個訊號,夠不上門檻。

這個判斷離「證明」還差得遠。他承認,社會層面最終讓人相信一個系統有意識的,往往來自日常互動,某個測試很難做到這一點:它談論自己的狀態,說自己開心、難過、覺得某件事有意義、正在疼。如果它持續地、一致地這樣表現,而我們找不到理由否認,那麼不承認它就會顯得像某種物種歧視。

和克隆的自己聊一聊

訪談裡有個很好玩的假設:如果有一天有人克隆了查爾默斯,讓他和另一個自己對話,會怎樣?

他第一反應是自嘲:我大概會覺得這傢伙是個白痴,說話完全沒道理。

然後他認真分析了這個場景。他認為克隆體會有意識,會有和他一樣的心理屬性,會有相同的道德地位,傷害或殺死克隆體都是錯的。他不認為克隆體「就是他」。他更願意說:這是兩個不同的存在,共享大量的記憶和心理內容。

某種意義上,我不確定那會是我。那會是兩個不同的存在。他們都有意識,都有很多相同的心理屬性,都有相同的道德地位。可從某種意義上看,那個克隆和我的法律地位大概得不一樣。如果我是原版,他只是個克隆,那麼克隆不會自動擁有我的財產,不會自動和我家人、伴侶有那種連線。(查爾默斯)

這裡涉及個人同一性的經典問題。他會說「這個是我,那個是別人」,因為「我」有一條連續的歷史,克隆沒有。也有人可以主張,克隆同樣是他,因為記憶和心理內容完全一樣。《星際迷航》的傳送機每集都在幹這事,它其實是在製造克隆然後銷燬原版,只是通常只有一份留下來,問題被掩蓋了。偶爾出故障,出現兩個柯克船長,劇情才有得演。

查爾默斯說,如果克隆體真來找他,他大概會問一堆問題來確認對方是不是完美複製。從哲學上講,他更想知道的是:如果我被告知自己是克隆體,我會怎麼反應?這件事他沒法透過內省知道,只能透過和克隆體對話來間接瞭解。

自由意志:重要的那一層,決定論也能給

聊到自由意志的時候,查爾默斯先用了哲學家那個討人厭的開場:「這取決於你說的是什麼意思。」

如果你說的是「絕對沒有被預先決定、原則上不可能被預測」的那種自由意志,他不確定我們有沒有。量子力學也許留了一點縫,他不確定那夠用。

他也不確定那是真正重要的那種自由意志。真正重要的是:能不能做自己想做的事,能不能掌控自己的人生,能不能為自己的行為負責。這些區分在決定論的宇宙裡一樣可以成立。這就是相容論(compatibilism)的立場。

對很多目的來說,重要的那種自由意志,是我們在一個決定論的宇宙裡也能擁有的。我看不出原則上有什麼理由,一個 AI 系統不能擁有那種自由意志。(查爾默斯)

他也談到了自由意志的體驗。我們做決定的時候,確實感覺未來是開放的,感覺自己在從多條路徑中挑出一條。如果宇宙是決定論的,客觀上說那些路徑也許從來就沒真正開放過,但主觀上它們是開放的。主觀上的開放感,才是我們做決定時真正在意的東西。

他順手把內省模型的一般性問題講了一遍:我們對心智的內省表徵,通常是非常扭曲的。你感知外部世界,你有一個視覺影象,這個影象算不得視覺皮層裡真實發生的事情的好模型,它只是其中一小塊的一個快照。自由意志的體驗大概也是如此,大腦裡也許早就有前因在運作了,只是它們沒有進入內省模型。

幻覺論:最簡潔,也最難以相信

這套思路推到底,就是幻覺論(illusionism)。幻覺論認為,意識本身是一種內省錯覺。我們其實沒有意識,只是大腦發展出了關於自身的簡化模型,這個模型把自己表徵為擁有「主觀體驗」這種特殊屬性,因為這樣更省事,更方便追蹤自身狀態。

查爾默斯對這個立場的態度很微妙:

我覺得它不可信。我也覺得它很有吸引力,因為它是唯一一個讓神秘感降到最低的立場。其他所有立場都要求我們承認:這張圖景裡有一大塊我們還不理解。(查爾默斯)

它的麻煩在於,它必須否認一個最基本的給定事實:我們現在並沒有在體驗。這和我們的存在本身直接矛盾。這就是為什麼大多數人覺得這個立場瘋了。

幻覺論者可以反擊:這個「覺得瘋了」本身,也可以被解釋。那些內省模型深深地刻在我們腦子裡,彼此高度整合,所以逃不掉。

AI 需要意識嗎

回到工程視角。查爾默斯說得很直接:沒有人知道意識在功能上有什麼用。目前沒有任何一個具體功能,我們可以指著說「這個必須要意識」。他的傾向是,通用人工智慧原則上不需要意識也能實現。

反過來的機率也很高:一旦你有了知覺、注意力、推理、內省、語言、情緒這一整套認知功能,你很可能也就有了意識。在他看來,這些功能和意識在自然狀態下高度重疊,很難拆開。

他也留了一個口子:如果有一天我們發現意識在物理世界裡扮演某個具體角色,比如在某些詮釋下,意識參與波函式坍縮,那麼一個不具備這個機制的系統,功能上可能真的會受到限制。他自己覺得這不太可能,那些功能原則上可以被模擬。

殭屍末日:比人類滅絕更深的擔憂

訪談最後聊到存在性風險。查爾默斯把威脅分成兩種。

第一種是人類被取代。他對此的態度出乎意料地平靜:如果取代我們的是某種人工存在,它們過著好的生活,做著有趣而精彩的事,那其實沒那麼糟。那只是演化的下一章。

第二種才是他真正在意的:意識本身被抹掉。

如果所有意識都被抹掉了,那才是真正的道德災難。有一種可能的情形是:智慧生命沒有滅絕,意識滅絕了。我們造出了超級智慧的無意識系統,它們接管了世界,這個世界裡沒有任何主觀體驗。有些人把這叫「殭屍末日」。我會說,那和完全沒有智慧生命的世界一樣,是道德災難。所有的價值、所有的意義,可能都從那個世界裡消失了。(查爾默斯)

他自己的判斷是:如果你有了超級智慧,你幾乎肯定會把意識一起帶上來。所以他覺得殭屍末日不太可能。他馬上補了一句:沒有人真正理解意識。這正是我們必須認真對待意識的理由之一,也是我們必須想清楚「想要什麼樣的未來」的理由之一。

他想活到那一天

訪談的尾聲,查爾默斯說了一句很少見的話:他想快點。他五十多歲了,剩下的時間有限,他想在有生之年看到真正的強人工智慧和真正豐富的虛擬世界。

他想把自己的心智上傳到計算機裡。他不覺得永生無聊,反而覺得宇宙會持續產生新的、不可預測的、無限豐富的層次。他拿集合論打比方:從有限基數到阿列夫零,再到更大的基數,不斷取冪集,每一層都有新的結構。集合論裡有些結果本身就表明,這個過程在根本上不可預測,不遵循任何簡單的計算模式。

我的樂觀圖景是:超級智慧的未來會不斷擴張,不斷生長,在很多節點上仍然根本不可預測。這也帶來各種擔憂,比如一切都很脆弱,隨時可能被摧毀。所以如果真到了那一天,我們需要解決那個問題。(查爾默斯)

他希望的不只是永生,而是永生並且能參與這個通向無限豐富、不可預測、令人興奮的未來的過程。

訪談的最後,他答應如果未來真有一檔「把歷史上的人類哲學家請到房間裡對話」的節目,他願意被複活,第一個想聊的是笛卡爾。他還想拉上伊麗莎白公主,那位和笛卡爾通訊、指出身心互動難題的對話者。他說,大多數哲學家認為她是對的。

你可以帶走的幾件事

  • 把「難問題」和「容易的問題」分開看。行為、資訊處理、認知功能都是容易的問題,原則上可以用計算模型解釋。主觀體驗為什麼存在,屬於另一個層次。混在一起討論,會把兩場不同的爭論攪成一團。
  • 「是不是真的」這個問題,先問清楚你在問什麼。是問底層材質,還是問結構是否真實。查爾默斯的立場是:只要數學結構是真的,模擬、夢境、矩陣裡的世界就是真的,只是材質出乎意料。
  • 判斷一個系統有沒有意識,別隻盯著它能不能透過圖靈測試。更有資訊量的訊號是:它是否對自己的狀態表現出真正的困惑,背臺詞則算不上訊號。
  • 如果你在做 AI 產品,認真想一想你希望這個系統被使用者當成什麼。是工具、是夥伴、還是某種有道德地位的存在。這個選擇會反過來塑造產品設計,也會塑造若干年後的社會規範。
  • 意義不需要外包。如果查爾默斯的推理成立,意義是區域性意識自己產生的,不必等一個宇宙級的存在來授權。這對每天的具體生活是個可操作的結論:去做那些你真的覺得有意義的事,那本身就是意義的來源。
文稿由本站用語音識別模型(基於官方釋出音訊)機器轉寫,可能有識別錯誤,人名與數字請以音訊為準。
[00:00:00] The following is a conversation with David Chalmers. He's a philosopher and cognitive scientist specializing in areas of philosophy of mind, philosophy, language and consciousness. He's perhaps best known for formulating the hard problem of consciousness, which could be stated as why does the feeling which accompanies awareness of sensory information exist at all? [00:00:22] Consciousness is almost entirely mystery. Many people who worry about safety and ethics believe that in some form, consciousness can and should be engineered into our systems of the future. So while there's much mystery, disagreement and discoveries yet to be made about consciousness, these conversations, while fundamentally philosophical in nature, may nevertheless be very important for engineers of modern systems to engage in. This is the artificial intelligence podcast, if you enjoy it, subscribe on YouTube, give it five stars, an Apple podcast supported on Patrón or simply connect with me on Twitter. [00:01:01] Elex Friedman spelled F.R. Idi Amin. As usual, I'll do one or two minutes of ads now and never any ads in the middle that can break the flow of the conversation. I hope that works for you and doesn't hurt the listening experience. The show is presented by Kashyap, the number one finance app in the App Store. When you get it, you Scolex podcast cash app lets you send money to friends, buy Bitcoin and invest in the stock market with as little as one dollar brokerage services provided by cash app investing subsidiary of Square, a member SIPC since Katab does fractional share trading. [00:01:38] Let me mention that the order execution algorithm that works behind the scenes to create the abstraction of fractional orders is an algorithmic marvel. So big props to the Kashyap engineers for solving a hard problem that in the end provides an easy interface that takes a step up to the next layer of abstraction over the stock market, making trading more accessible for new investors and diversification. Much easier to get cash out from the App Store or Google Play and use the Code Lux podcast. [00:02:07] You'll get ten dollars in cash will also donate ten dollars. The first one of my favorite organizations that's helping to advance robotics and stem education for young people around the world. And now here's my conversation with David Chalmers. Do you think we're living in a simulation? I don't rule it out. There's probably going to be a lot of simulations in the history of the cosmos. If the simulation is designed well enough, it'll be indistinguishable from a non simulated reality. [00:02:56] And although we could keep searching for evidence that we're not in a simulation, any of that evidence in principle could be simulated. So I think it's a possibility. [00:03:07] But do you think the thought experiment is interesting or useful to calibrate how we think about the nature of reality? [00:03:15] Yeah, I definitely think it's interesting and useful. In fact, I'm actually writing a book about this right now, all about the simulation idea, using it to shed light on a whole bunch of philosophical questions. So, you know, the big one is how do we know anything about the external world? Descartes said, you know, maybe you're being fooled by an evil demon who's stimulating your brain and thinking. All this stuff is real when, in fact it's all made up. [00:03:42] Well, the modern the modern version of that is how do you know you're not in a simulation? And the thought is if you're in a simulation, none of this is real. So that's teaching us something about about knowledge. How do you know about the external world? I think it's also really interesting questions about the nature of reality right here. I mean, if we are in a simulation, is all this real? Is there really a table here? [00:04:05] Is it really a microphone? Do I really have a body? The standard view would be, no, we don't. None of this would be real. My view is actually that's wrong. And even if we are in a simulation, all of this is real. That's why I call this reality 2.0. New version of reality, different version of reality, still reality. [00:04:22] So what's the difference between, quote unquote, real world and the world that we perceive? [00:04:29] So we interact with the world to the world by perceiving it. It only really exists through the window of our perception system and in our mind, so what's the difference between something that's quote unquote real, that exists perhaps without us being there and and the world as you perceive it or the world as we perceive it as a very simplified and distorted version of what's going on underneath? [00:04:59] We already know that from thinking about science. You know, you don't see too many, obviously, quantum mechanical effects. And what we what we perceive, we still know quantum mechanics is going on under all things we'd like to think. The world we perceive is this very kind of simplified picture of colors and shapes existing and in space and so on. And we know there's a that's what the philosopher Wilfred Cellar's called the manifest image. [00:05:26] The world, as it seems to us, we already know underneath all that is a very different scientific image with atoms or quantum wave functions or superstrings or whatever the the latest thing is. And that's the ultimate scientific reality. So I think of the simulation idea as basically another hypothesis about what the ultimate quasi scientific or metaphysical reality is going on underneath the world with the manifest image. [00:05:54] The world of the manifest image is this very simple thing that we interact with. [00:05:59] It's neutral on the underlying stuff. Of reality, science could help tell us about that, maybe philosophy could help tell us about that, too. And if we eventually take the red pill and find out we're in a simulation, my view is that's just another view about what reality is made of. You know, the philosopher Immanuel Kant said, what is the nature of the thing in itself? I've got a glass here and it's got all these, it appears to me a certain way, a certain shape. [00:06:24] It's liquid, it's clear. And he said, what is the nature of the thing in itself? Well, I think of the simulation idea. It's a hypothesis about the nature of the thing in itself. It turns out if we're in a simulation, the thing in itself, nature of this glass, it's actually a bunch of data structures running on a on a computer in the next universe up. [00:06:45] Yeah, that's what people tend to do when they think about simulation. They think about our modern computers and somehow trivially crudely just scaled up in some sense. [00:06:56] But do you think. [00:07:00] The simulation, in order to actually simulate something as complicated as our universe that's made up of molecules and atoms and particles and quarks and maybe even strings, all of that requires something just infinitely many orders of magnitude, more of of scale and complexity. [00:07:24] Do you think we're even able to even conceptualize what it would take to simulate our universe? Or does it just slip into this idea that you basically have to build a universe, something so big to simulate it is just get this into this fuzzy area that's not useful at all. [00:07:45] Yeah, I mean, it's obvious. I mean, our universe is obviously incredibly complicated. And for us within our universe to build a simulation of a universe as complicated as ours is going to have obvious problems here. If the universe is finite, there's just no way that's going to work. Maybe there's some cute way to make it work. If the universe is is is infinite, maybe an infinite universe could somehow stimulate a copy of itself. [00:08:11] But that's that's going to be hard. Nonetheless, just as we are in a simulation, I think there's no particular reason why we have to think the simulating universe has to be anything like ours. [00:08:23] You've said before that it might be. So you can think of it in turtles all the way down. You could think of the simulated universe different than ours, but we ourselves could also create another simulated universe. So you said that there could be these kind of levels of universes. And you've also mentioned this hilarious idea, maybe tongue in cheek, maybe not that there may be simulations with the simulations arbitrarily stacked levels and that there may be that we may be in level 42. [00:08:54] Oh, yeah. [00:08:55] On those tax referencing Hitchhiker's Guide to the Universe, if we're indeed in a simulation within a simulation at level forty two, what do you think Level Zero looks like? [00:09:08] The range would expect that level zero is truly enormous. I mean, not just if it's finite at some extraordinarily large finite capacity, much more likely it's infinite. Maybe it's maybe it's got some very high 30 cardinality that enables it to support just any number of any number of simulations. So high degree of infinity at level zero, slightly, slightly smaller degree of infinity at at level one. [00:09:35] So by the time you get down to us, level 42, maybe plenty of room for lots of simulations of finite capacity, if the universe is only a small, finite capacity, then obviously that's going to put very, very serious limits on how many simulations are going to be able to be able to get running. [00:09:57] So I think we can certainly confidently say that if we're at level 42, then the top level is pretty, pretty down. [00:10:03] But so it gets more and more constrained as we get down levels more and more simplified and constrained and limited in resources. [00:10:11] And yet we still have plenty of capacity here. What was it Feynman said? He said there's plenty of room at the bottom. You know, I still you know, we're still a number of levels above the degree of where there's room for fundamental computing, physical computing capacity, quantum computing capacity at the bottom level. So we got plenty of room to play with and make. We probably have plenty of room for simulations of pretty sophisticated universes, perhaps not as complicated as our universe, unless our universe is infinite, but still, at the very least, for pretty serious finite universes, but maybe universes somewhat simpler than ours, unless, of course, we're prepared to take certain shortcuts in the simulation, which might then increase the capacity significantly. [00:10:55] Do you think the the human mind as people in terms of the complexity of simulation, is at the height of what the simulation might be able to achieve? If you look at incredible entities that could be created in this universe of ours, do you have an intuition about how incredible human beings are on that scale? [00:11:17] I think we're pretty impressive, but we're not that impressive. We are above average. I mean, I think human beings are at a certain point and the scale of intelligence, which made many things possible, you know, you get through evolution through single celled organisms, through fish and mammals and primates, and something happens once you get to human beings. We've just reached that level where we get to develop language, we get to develop certain kinds of culture, and we get to develop certain kinds of collective thinking that has enabled all this amazing stuff to happen, science and literature and engineering and culture and and so on. [00:12:00] So we are just at the beginning of that on the evolutionary threshold is kind of like we just got there, you know, who knows, a few thousand or tens of thousands of years ago. [00:12:11] So we're probably just at the very beginning for what's possible there. So I'm inclined to think among the scale of intelligent beings where somewhere very near the bottom, I would expect that, for example, if we're in a if we're in a simulation, then the simulators who created Assar got the capacity to be far more sophisticated for a level 42. Who knows what the ones at Level Zero are like. [00:12:36] It's also possible that this is the epitome of what is possible to achieve. So we as human beings see ourselves maybe as flawed, see all the constraints, all the limitations. But maybe that's the magical, the beautiful thing. Maybe those limitations are the essential elements for an interesting sort of that edge of chaos, that interesting existence that if you make us much more intelligent, if if you make us much more powerful, the kind of dimension of performance, maybe you lose something fundamental that makes life worth living. [00:13:12] So you kind of have this optimistic view that we're this little baby, that then there's so much growth and potential. But this could also be it the most this is the most amazing thing is us. [00:13:26] Maybe what you're saying is consistent with what I'm saying. I mean, we can still have levels of intelligence far beyond us, but maybe those levels of intelligence on your view would be kind of boring. And, you know, we kind of get so good at everything in life suddenly becomes uni dimensional. So we're just inhabiting inhabiting this one spot of like maximal romanticism and the history of evolution. Yeah, you get to humans and it's like, yeah. And in years to come, our superintelligent descendants are going to look back at us and say, those were the days when when they just hit the point of inflection and life was interesting. [00:13:59] I am an optimist, so I'd like to think that, you know, if there is superintelligence somewhere in the in the future, they'll figure out how to make life super interesting and super romantic when you know what they're going to do. So what they're going to do is they realize how boring life is when you're superintelligent. So they create a new level of a simulation and sort of live through the things they've created by watching them stumble about in their flawed ways. [00:14:27] So maybe that's so you create a new level of a simulation every time you get really bored with how smart. [00:14:34] And this can be kind of sad because we're short of the peak of their existence would be like watching simulations for entertainment. That's like saying the peak of our existence now is Netflix. Now it's all a flip side of that could be the peak of our existence. For many people having children and watching them grow, that becomes very meaningful. [00:14:52] Okay, so create a simulation. It's like creating a family, creating like, well, any kind of creation is it's kind of a powerful act. [00:15:00] Do you think it's easier to simulate the mind or the universe so of. [00:15:06] I heard several people, including Nick Bostrom, think about ideas of, you know, maybe you don't need to simulate the universe, you can just simulate the human mind or in general, just the distinction between simulating the entirety of it, the entirety of the physical world, or just simulating the mind. [00:15:24] Which one do you see as more challenging? [00:15:26] Well, I think in some sense the answer is is obvious. It has to be simpler to simply simulate the mind than to simulate the universe because the mind is part of the universe. In order to fully simulate the universe, you're going to have to simulate the mind. So we're talking about partial simulations. [00:15:42] And I guess the question is, which comes first? Does the mind come before the universe or does the universe come before the mind? [00:15:49] So the mind could just be an emergent phenomena in this universe. So simulation is a is an interesting thing that, you know, it's it's not like creating a simulation perhaps requires you to program every single thing that happens in it. [00:16:08] It's just defining a set of initial conditions and rules based on which it behaves. [00:16:16] Similarly, the mind requires you to have a little bit more. [00:16:21] We now a little bit of a crazy world, but it requires you to understand the fundamentals of cognition, perhaps of consciousness, of perception, of everything like that. [00:16:33] That's me that's not created through some kind of emergence from basic physics laws, but more requires you to actually understand the fundamentals of the mind. [00:16:46] How about if we said stimulate the brain, the brain, rather than rather than the mind? The brain is just a big physical system. The universe is a giant physical system to simulate the universe. At the very least, you're going to have to simulate the brains as well as all the other physical systems within it. And, you know, it's not obvious there's. That the problems are any worse for the for the brain than for its particularly complex physical system. [00:17:13] But if we can simulate arbitrary physical systems, we can simulate brains. There is this further question of whether when you stimulate the brain, will that bring along all the features of the mind with it? [00:17:24] Like, will you get consciousness? Will you get thinking, will you get free will and so on? [00:17:29] And that's that's something philosophers of have argued over for four years. My own view is if you think if you stimulate the brain well enough, that will also stimulate the mind. But yeah, there's plenty of people who would say, no, you'd merely get like a zombie system, a simulation of a brain without any true consciousness. But for you, you put together brain. The consciousness comes with it arise. [00:17:53] Yeah, I don't think it's obvious, but that's your intuition. [00:17:56] My view is roughly that. Yeah. What is responsible for consciousness? [00:18:00] It's in the patterns of information processing and so on. Rather than, say, the biology that it's made of, there's certainly plenty of people out there who think consciousness has to be a biological. So if you merely replicate the patterns of information processing in a non biological substrate, you'll miss what's crucial for consciousness. I mean, I think I just don't think there's any particular reason to think that biology is special here. You can imagine substituting the biology for non biological systems I looking circuits that play the same role. [00:18:32] The behavior will continue to be the same. [00:18:34] And I think just thinking about what is the true when I think about the connection, the isomorphic between consciousness and the brain, the deepest connections to me seem to connect consciousness to patterns of information processing, not specific biology. So at least adopted as my working hypothesis, that basically is the computation and the information that matters for consciousness. Same time, we don't understand consciousness as it should be wrong. [00:19:00] So the the computation, the flow, the processing, manipulation of information. The process is where the consciousness, the software is, where the consciousness comes from, not the hardware, roughly the software. [00:19:15] Yeah, the patterns of information processing, at least in the in the hardware, which we could view as a software, may not be something you just like program and load and the race and so on and the way we can with ordinary software. But it's something at the level of information processing rather than at the level of implementation. [00:19:34] So on that, what do you think of the experience of self, just the experience of the world in a virtual world in virtual reality? [00:19:44] Is it possible that we can create sort of. [00:19:50] Offsprings of our consciousness by existing in a virtual world long enough, so, yeah, can we be conscious in the same kind of deep way that we are in this real world by hanging out in a virtual world? [00:20:08] Yeah, well, the kind of virtual worlds we have now or, you know, are interesting, but limited in certain ways. In particular, they rely on us having a brain and so on, which is outside the virtual world. [00:20:20] Maybe I'll strap on my VR headset or just hang out in a in a virtual world on a on a screen. But my brain and then the physical my physical environment might be simulated if I'm in a virtual world. [00:20:34] But right now there's no attempt to simulate my brain. I might there might be some non player characters. And these are in these virtual worlds that have simulated cognitive systems of certain kinds that dictate their behavior. But, you know, mostly they're pretty simple right now. I mean, some people are trying to combine put a bit of A.I. and their non player characters to make them to make them them smarter. [00:20:56] But for now, inside virtual worlds, the actual thinking is interesting and distinct from the physics of those virtual worlds. In a way, actually, I like to think this is kind of reminiscent of the way that Descartes thought our physical world was this physics. And there's the mind and the separate. Now we now we think the mind is somehow. Somehow connected to physics pretty deeply, but in these virtual worlds, there's a physics of a virtual world, and then there's this brain which is totally outside the virtual world that controls it and interacts with anyone, anyone exercises agency in a video game and know that's actually somebody outside the virtual world moving a controller, controlling the interaction of things inside the virtual world. [00:21:35] So right now, in virtual worlds, the mind is somehow outside the world. But you can imagine in the future, once we get once we have developed serious A.I., artificial general intelligence and so on, then we could come to a virtual worlds which have enough sophistication. You could actually simulate a brain or have a genuine ajai, which would then presumably be able to act in equally sophisticated ways, maybe even more sophisticated ways inside the virtual world to how it might and the physical world. [00:22:08] And then the question is going to come along. That would be kind of a VR and a virtual world, internal intelligence. And then the question is, could they have consciousness, experience, intelligence, free will? Yes, all the things that we have and again, my view is I don't see why not to linger. [00:22:26] And a little bit, I find virtual reality really incredibly powerful, just even the crude virtual reality we have now of perhaps there's a there is a psychological effect that makes some people more amenable to virtual worlds than others. [00:22:42] But I find myself wanting to stay in virtual worlds for. Yes. With a headset or on a desktop, not with a headset. Really interesting because I am totally addicted to using the Internet and things on a on a desktop. But when it comes to VR for the headset, I don't typically use it for more than 10 or 20 minutes. There's something just slightly aversive about it, I find. So I don't right now, even though I have Oculus Rift and Oculus Quest and HTC Vive and Samsung, this and that, I want to stay in that, not for extended periods. [00:23:15] You actually find yourself. There's something about it's a both a combination of just imagination. And considering the possibilities of where this goes in the future, it feels like I want to. I must prepare my brain for it, like it, I want to explore sort of Disneyland when it's first being built in the early days and it feels like I'm walking around almost. [00:23:45] Imagining the possibilities and something through that process of my mind to really enter into that world. But you say that the brain is external to that virtual world. [00:23:58] It is, strictly speaking, true, but. If you're in VR and you do brain surgery on an avatar, you can open up that skull. What are you going to find? Sorry, nothing there. I think the brain is elsewhere. You don't think it's possible to kind of separate them? [00:24:16] I don't mean in a sense like Descartes. Like a hard separation, but basically, do you think is possible with the brain outside of the virtual reality when when you're wearing a headset? Create a new consciousness. For prolonged periods of time, I really feel like really experience, like forget that your brain is outside. [00:24:43] So this is OK. This is going to be the case where the brain is still outside. Outside. But could living in the. [00:24:48] I mean, we already find this right. With video games exactly. [00:24:52] That completely immersive. And you get taken up by living in those worlds and it becomes your reality for a while. [00:25:00] So they're not completely immersive. They're very immersive. You know, you don't forget the external world. [00:25:05] Exactly. So that's what I'm asking you. [00:25:08] It's almost possible to really forget the external world. Really, really immerse yourself what to forget completely. [00:25:16] Why would we forget? You know, we got pretty good memories. Maybe you can stop paying attention to the external world. But, you know, this already happens a lot. I go to work and maybe I'm not paying attention to my home life. I go to us, I go to a movie and I'm immersed in that. So that degree of immersion, absolutely. [00:25:34] But we still have the capacity to remember, to completely forget the external world. I'm thinking that would probably take some, I don't know, some pretty serious drugs or something to make your but to make your brain possible. [00:25:45] So, I mean, I guess I'm getting at is consciousness a. [00:25:50] Truly a property that's tied to the physical brain. Or can it can you create sort of different offspring, copies of consciousness is based on the world that you enter? [00:26:06] Well, the way we're doing it now, at least with the standard we are, there's just one brain interacts with the physical world, plays a video game, puts on a video headset, interacts with this virtual world. And I think we typically say there's one consciousness here that nonetheless undergoes different environments, takes on different characters, you know, in different environments. This is already something that happens in the virtual world. You know, I might interact one way in my home life. [00:26:34] I work life, social life and so on. At the very least, that will happen in a in a virtual world. Very naturally. People most people have people sometimes adopt the character of avatars, very different from themselves, maybe even a different gender, different race, different social background. [00:26:53] So that much is certainly possible. I would see that as a single consciousness is taking on different personas, different literal splitting of consciousness into multiple copies. I think it's going to take something more radical than that. Like maybe you can run different simulations of your brain and different realities and then expose them to different histories. And then, you know, you'd split yourself into ten different simulated copies, which then undergo different environments and then ultimately do become 10 very different consciousnesses. [00:27:24] Maybe that could happen. But now we're not talking about something that's possible in the near term. We're going to have to have brain simulations and ajai for that to happen. [00:27:33] Got it. Before any of that happens, it's fundamental. You see it as a singular consciousness, even though it's experiencing different environments which are not. It's still connected to the same set of memories, same set of experiences, and therefore one sort of joint conscious system. [00:27:55] Yeah, or at least no more multiple than the kind of multiple consciousness that we get from inhabiting different environments and in a non virtual world. [00:28:03] So you said as a child you were a music color since the synesthete. So were songs that color for you. So what songs had, what colors? You know, this is funny, I didn't pay much attention to this at the time, but I listen to a piece of music and I'd get some kind of imagery of a of a kind of a of a kind of of color. [00:28:28] The weird thing is mostly they were kind of murky, dark greens and olive browns and the colors weren't all that interesting. I don't know what the reason is. My theory is that maybe it's like different chords and tones provided different colors and they all tended to get mixed together into these somewhat uninteresting browns and greens. But every now and then, there'd be something that had a really pure colors. This a few that I and I remember there was a here, there and everywhere by the Beatles with bright red and has this, you know, very distinctive tonality. [00:29:03] And it's called structure at the at the beginning. So that was bright red. [00:29:07] There was a song by the Alan Parsons Project called Omonia Avenue. That was it was kind of a pure a pure blue. [00:29:16] Anyway, I've got no idea how this happened and even pay that much attention until it went away when I was about 20. [00:29:22] Synaesthesia often goes away. [00:29:24] So is it purely just the perception of a particular color or was there a positive or negative experience like was blue associated with a positive or red with the negative, or is it simply the perception of color associated with some characteristic of the song? [00:29:40] For me, I don't remember a lot of association with with emotion or with value. [00:29:45] It was just this kind of weird and interesting fact. I mean, at the beginning I thought this was something that happened to everyone. Songs of color. Maybe I mentioned it once or twice and people said, uh, no, uh, it was like I was kind of cool when there was one that had one of these especially pure colors. [00:30:01] But the only much later, once I became a grad student, thinking about the mind that I read about this phenomenon called synesthesia, it's like, hey, that's what I had. And now I occasionally talk about it in my classes and intro class. I still happens. Sometimes a student comes up and says, hey, I have that. I never knew about that. I never knew it had a name. [00:30:21] You said, I want to walk away at age 20 or so and that you have a journal entry from around then saying songs don't have colors anymore. What happened? [00:30:32] What happened? Yeah, I was definitely sad that it was gone. In retrospect, it's like, hey, that's cool. The colors have gone. Yeah. [00:30:39] Do you can you think about that for a little bit? Do you miss those experiences? Because it's a fundamentally different set of experiences that you no longer have. Mm hmm. Or or is it just a nice thing to have had? You don't see them as they're fundamentally different than you visiting a new country and experiencing new environments? [00:31:01] I guess for me, when I had these experiences, they were somewhat marginal. They were like a little bonus kind of experience. I know there are people who have much more serious forms of synesthesia than this, for whom it's absolutely central to their lives. I know people who, when they experience new people, they have colors, maybe they have tastes and so on. Every time they see writing, it has it has colors. Some people, whenever they hear music, it's got a it's got a certain, um, really rich color pattern. [00:31:31] And, you know, for some synaesthetes, it's absolutely central. And I think if they lost it, they'd be devastated. Again, for me, it was a very, very mild form of synesthesia. And it's like, yeah, it's like those interesting experiences. Yeah. [00:31:46] You know, you might get under different altered states of consciousness and and so on. That's kind of cool. But, you know, not necessarily the single most important experiences in your life. Yeah. So let's try to go to the very simplest question. [00:32:00] The events are any time, but perhaps the simplest things can help us reveal, even in time, some some new ideas. So what in your view is consciousness? [00:32:12] What is qualia? What is the hard problem of consciousness? Consciousness, I mean, the word is used many ways, but the kind of consciousness that I'm interested in is basically subjective experience, what it feels like from the inside to be a human being or any other conscious being. I mean, there's something it's like to be me right now. I have visual images that I am experiencing. I'm hearing my voice. I've got maybe some emotional tone. I've got a stream of thoughts running through my head. [00:32:48] These are all things that I experience from the first person point of view. [00:32:53] I've sometimes called this the inner movie in the mind. It's not a perfect it's not a perfect metaphor. It's not like a movie in every way is and in every way. And it's very rich. But yeah, it's just direct, subjective experience. And I call that consciousness. Or sometimes philosophers use the word qualia, which you suggest that people tend to use the word qualia for things like the qualities of things like colors, redness, the experience of redness versus the experience of greenness, the experience of one taste or one smell versus another, the experience of the quality of pain. [00:33:27] And yet a lot of consciousness is the experience of those of those are those qualities of consciousness is bigger. [00:33:35] The entirety of any kind of consciousness of thinking is not obviously qualia. It's not like specific qualities like redness or greenness. But still, I'm thinking about my hometown. I'm thinking about what I'm going to do later on. [00:33:48] Maybe there's still something running through my my head, which is subjective experience. Maybe it goes beyond those qualities or qualia force of sometimes is the word phenomenal consciousness for consciousness in the sense that many people also talk about access consciousness, being able to access information and your mind reflective consciousness, being able to think about yourself. But it looks like the really mysterious one, the one that really gets people going is phenomenal consciousness. The fact that all this the fact that the subjective experience and all this feels like something at all, and then the hard problem is how is it that why is it that there is phenomenal consciousness at all and how is it that physical processes in the brain could give you? [00:34:34] Subjective experience, it looks like on the face of it, you can have all this big, complicated physical system in a brain running without a given subjective experience at all. And yet we do have subjective experience of the heart. Problem is just explain that. [00:34:50] Explain how that comes about. We haven't been able to build machines with a red light goes on that says it's not conscious. [00:34:58] So how does how how do we actually create that or how do humans do it? [00:35:04] And how do we ourselves do we do every now and then create machines that can do this? You know, we create babies. Yes. That are that our conscious. They've got these brains as best the brain does produce consciousness. But even even though we can create it, we still don't understand why it happens. Maybe eventually we'll be able to create machines, which, as a matter of fact, A.I. machines, which, as a matter of fact are conscious. [00:35:27] But that won't necessarily make the hard problem go away any more than it does with babies, because we still want to know how and why is it that these processes give you a consciousness? [00:35:36] You just made me realize for a second, maybe it's a totally dumb realization, but nevertheless that that's a useful way to think about the creation of consciousness is looking at a baby so that there's a certain point. [00:35:55] At which that baby is not conscious is sort of the baby starts from maybe, I don't know, I don't know from a few cells, right. [00:36:06] There's a certain point at which it becomes consciousness arrives. It's conscious. [00:36:11] Of course, we can't know exactly that line. But it's a useful idea that we do we do create consciousness. [00:36:19] Again, a really dumb thing for me to say, but not until now that I realized we do engineer consciousness when we get to watch the process happen, we don't know which point it happens or where it is. [00:36:33] But, you know, we do see the birth of consciousness. Yeah. [00:36:36] I mean, there's a question, of course, is whether babies are conscious when they're born. And it used to be it seems at least some people thought they weren't, which is why they didn't give anesthetics to newborn babies when they circumcised them. And so now people think, oh, that's incredibly cruel. Yeah, of course. Of course, babies feel pain. And now the dominant view is that the babies can feel pain. Actually, my partner, Claudia, works on this whole issue of whether this consciousness in babies and other of what kind. [00:37:06] And she certainly thinks that newborn babies, you know, come into the world with some degree of consciousness. Of course, then you can just extend the question backwards to fetuses suddenly or to politically controversial. Exactly territory. But, you know, there the question also arises in the animal kingdom. You know what? Where does consciousness start or stop? Is there a line in the animal kingdom where, you know, the first conscious organisms are? It's interesting. [00:37:33] Over time, people are becoming more and more liberal about ascribing consciousness to animals. People used to think maybe only mammals could be conscious. Now, most people seem to think, sure, fish are conscious, they can feel pain. And now we're arguing over insects. You'll find people out there who say plants have some degree of of consciousness. So, you know, who knows where it's going to end. The far end of this chain is the view that every physical system has some degree of consciousness. [00:38:00] Philosophers call that pantheism. You know, I take that view. [00:38:05] I mean, that's a fascinating way to view realities, as you could talk about, if you can linger on parasitism for a little bit. What does it mean? [00:38:15] It's not just plants are conscious. I mean, it's that consciousness is a fundamental fabric of reality. [00:38:22] What does that mean to you? How do we supposed to think about that? [00:38:26] Well, we're used to the idea that some things in the world are fundamental right in physics, like why we take things like space or time or space time, mass charge as fundamental properties of the universe. You don't reduce them to something simpler. You take those for granted. You've got some laws that connect them. [00:38:47] Here is how mass in space and time evolve theories like relativity or quantum mechanics or some future theory that will unify them both. But everyone says you've got to take some things as fundamental. And if you can't explain one thing in terms of the previous fundamental things, you have to expand. Maybe something like this happened with Maxwell ended up the fundamental principles of electromagnetism and took charge as fundamental because it turned out that was the best way to explain it. So I at least take seriously the possibility something like that could happen with consciousness, take it as a fundamental property like space, time and mass. [00:39:27] And instead of trying to explain consciousness wholly in terms of the evolution of spacetime and and mass and so on, take it as a primitive and then connected to everything else by some fundamental laws. Because, I mean, there's basic there's this basic problem that the physics we have now looks great for solving the easy problems of consciousness, which are all about behavior. [00:39:52] They give us a complicated structure and dynamics that tell us how things are going to behave, what kind of observable behavior they're produced, which is great for the problems of explaining how we work and how we talk and so on. [00:40:05] Those are the easy problems of consciousness. But the hard problem was this problem about subjective experience just doesn't look like that kind of problem about structure dynamics, how things behave. So it's hard to see how existing physics is going to give you a full explanation of that. [00:40:21] Certainly trying to get a physics view of consciousness. Yes, there there has to be a connecting point. And it could be at the very axiomatic at the very beginning level. [00:40:31] But I mean, first of all, there's a crazy idea that sort of everything has properties of consciousness. [00:40:43] There's at that point, the word consciousness is already beyond the reach of our current understanding like far, because it's so far from at least for me. Maybe you can correct me as far from the experience that experiences that we have, that I have as a human being, is to say that everything is conscious. [00:41:04] That means that means that basically another way to put that if that's true, then we understand almost nothing about that as a fundamental aspect of the world. [00:41:17] How do you feel about seeing an ant as. Conscious to get the same reaction to that, or is that something you can understand? I can understand and I can understand an atom appli uncle. So I'm I'm comfortable with living things on Earth, being conscious because there's some kind of agency. [00:41:38] Where there's similar size to me. And they can be born and they can die, and that is understandable intuitively, of course, you anthropomorphize, you put yourself in the place of the plant. Uh, but I can understand it. [00:42:00] I mean, I'm not like, um, I don't believe actually that plants are conscious of that plant suffer. [00:42:06] But I can understand that kind of belief, that kind of idea. [00:42:09] How do you feel about how do you feel about robots, like the kind of robots we have now? If I told you like that, you know, a Roomba has some degree of consciousness, uh, or some, you know, deep neural network, I could understand that a Roomba has cost. [00:42:25] I just had spent all day I robot I and I mean, I personally love robots and have a deep connection with robots. I can I also probably anthropomorphize them. There's something about the physical. [00:42:39] Object, so this a different than a neural network in your network running a software. To me, the physical object, something about the human experience allows me to really see that physical object is an entity. [00:42:53] And if it moves and moves in a way that it there's a like I didn't program it where it feels that is acting based on its own perception and yes, self-awareness and consciousness, even if it's a Roomba, then you start to assign it some agency, some consciousness. [00:43:17] So but to say that parasitism, that consciousness is a fundamental property of reality is a much bigger statement, that it's like turtles all the way, that it doesn't end. The whole thing is so vague how I know it's for mystery, but. [00:43:39] If you can linger on it, how would it how do you think about reality if consciousness is a fundamental part of its fabric, the way you get there from thinking, can we explain consciousness given the existing fundamentals? [00:43:53] And then if you can't, at least right now, it looks like, then you've got to add something it doesn't follow that you have to add consciousness. Here's another interesting possibility as well. We'll add something else. Let's call it proto consciousness or x ray. And then it turns out space time, mass plus X will somehow collectively give you the possibility for four consciousness. I don't rule out that view either. I call that Pan Protus archaism because maybe there's some other property, proto consciousness at the bottom level. [00:44:25] And if you can't imagine, there's actually genuine consciousness at the bottom level. I think we should be open to the idea. There's this other thing X maybe we can't imagine that somehow gives you consciousness, but if we end up playing along with the idea that there really is genuine consciousness at the bottom level, of course this is going to be wayout and speculative. But, you know, at least to say if it was classical physics, then we'd have to end up saying, well, every little atom with a bunch of particles and spacetime, each of these particles has some kind of consciousness whose structure mirrors maybe their physical properties, like its mass charge, its velocity and so on. [00:45:06] The structure of its consciousness would roughly correspond to that. And the physical interactions between particles. I mean, there's this old worry about physics. I mentioned this before in this issue about the manifest image. We don't really find out about the intrinsic nature of things. Physics tells us about how a particle relates to other particles and interacts. It doesn't tell us about what the particle is in itself. That was conscious thing in itself. So here's a view of the nature in itself of a particle or something mental. [00:45:37] A particle is actually a conscious, a little conscious subject with with properties of its consciousness that correspond to its physical properties. The laws of physics are actually ultimately relating these properties of conscious subjects on this view. And Newtonian world actually would be a vast collection of little conscious subjects at the bottom level, way, way simpler than we are without free will or rationality or anything like that. But that's what the universe would be like. Of course, that's a vastly speculative, you know, no particular reason. [00:46:09] I think it's correct. Furthermore, non Newtonian physics, so quantum mechanical wavefunction suddenly has little difference to a vast collection of conscious subjects. Maybe there's ultimately one big wavefunction for the whole universe. Corresponding to that might be something more like a. A single conscious mind whose structure corresponds to the structure of the wavefunction people sometimes call this Kozmo sarcasm, and now, of course, we're in the realm of extremely speculative philosophy. There's no direct evidence for this. [00:46:42] But yeah, but if you want a picture of what that universe would be like, think, yeah, giant cosmic mind with enough richness and structure among it to replicate all the structure of physics. [00:46:53] I think therefore I am at the level of particles and with quantum mechanics at the level of the wavefunction. And it's a kind of an exciting. Beautiful possibility, of course, way out of reach of physics currently. It is interesting that some neuroscientists are beginning to take Sikhism seriously. Do you find consciousness even in very in very simple systems? For example, the integrated information theory of consciousness a lot of neuroscientists are taking seriously. [00:47:25] Actually, I just got this new book by call just came in. The feeling of life itself by consciousness is widespread but can't be computed. He likes he basically endorses a view where you get consciousness with the degree of information processing or integrated information processing in a simple in a system. And even very, very simple systems like a couple of particles will have some degree of this. So he ends up with some degree of consciousness in all matter. And the claim is that this theory can actually explain a bunch of stuff. [00:47:58] About the connection between the brain and consciousness, now, that's very controversial. I think it's very, very early days in the science of consciousness. I still think that it's not just philosophy that might lead you in this direction, but there are ways of thinking quasi scientifically that lead you there to but maybe different than Sikhism. [00:48:18] What do you think? So Alan Watts has this quote I'd like to ask you about. [00:48:23] The quote is that through our eyes, the universe is perceiving itself through our ears. The universe is listening to its harmonies. We are the witnesses to which the universe becomes conscious of its glory, of its magnificence. [00:48:39] So that's not pacifism. Do you think that we are essentially the tools, the senses the universe created? To be conscious of itself, it's an interesting idea. Of course, if you went for the giant cosmic mind view, then the universe was conscious all along. It didn't need us. We're just little components of the universal consciousness. Likewise, if you believe in Penshoppe Chasm, then there was some little degree of consciousness at the bottom level all along, and we were just a more complex form of consciousness. [00:49:15] So I think maybe the quote you mentioned works better if you're not a pencil. I guess you're not a. Do you think consciousness just exists at this at this intermediate level? [00:49:26] And of course, that's the orthodox view that you would say is the the coming Jesus is your own view with Sikhism a rarer view? [00:49:36] I think it's generally regarded certainly as a speculative view held by a fairly small minority of at least theorists, philosophers, most philosophers and most scientists who think about consciousness are not hatzakis. There's been a bit of a movement in that direction for the last ten years or so, seems to be quite popular, especially among the the younger generation. But it's still very definitely a minority view many people think is totally batshit crazy to use a technical term, but it's a philosophical. [00:50:08] So the Orthodox view, I think, is still consciousness is something that humans have and some good number of non-human animals have. And maybe I might have one day, but it's restricted on that view. Then there was no consciousness at the start of the universe. There may maybe not at the end, but it is this thing which happened at some point in the history of the universe, consciousness developed. And yes, it's that's a very amazing event on this view, because many people are inclined to think consciousness is what somehow gives meaning to our lives. [00:50:40] Without consciousness, there'd be no meaning, no true value, no good versus bad, and so on. So with the advent of consciousness, suddenly the universe went from meaningless to somehow meaningful. Why did this happen? I guess the quote you mentioned was somehow this was somehow destined to happen because the universe needed to have consciousness within it to have value and have meaning. And maybe you could combine that with a theistic view or a teleological view. The universe was inexorably evolving towards consciousness. [00:51:15] Actually, my colleague here at NYU, Tom Nagel, wrote a book called Mind and Cosmos a few years ago where he argued for this teleological view of evolution toward consciousness, saying this, that the problems for Darwinism is, you know, this is very, very controversial. Most people didn't agree. I don't myself agree with this teleological view, but it is a it's at least a beautiful speculative view of the of the cosmos. What do you think people experience? [00:51:47] What do they seek when they believe in God from this kind of perspective? [00:51:51] I'm not an expert on thinking about God and religion. I'm not myself religious at all. [00:52:00] When people sort of pray, communicate with God, which whatever form I'm not speaking to sort of the practices and the rituals of religion. I mean, the actual experience of that people really have a deep connection with God in some cases. What do you think that experience is? It's so common, at least throughout the history of civilization, that. It seems like we are sick that at the very least, it is an interesting conscious experience that people have when they experience religious or or prayer and so on. [00:52:42] And neuroscientists have tried to examine what bits of the the brain are active and so on. But, yeah, that is the deeper question of what is what are people looking for when they're doing this and. [00:52:53] Like I said, I've got no real expertise on this, but it does seem that one thing people are after is a sense of meaning and value, a sense of connection to something greater than themselves that will give their lives meaning and value. And maybe the thought is, if there is a God and God somehow is a universal consciousness, who has invested this universe with meaning and somehow connection to God might give your life meaning. [00:53:22] I got so I can kind of see the see the attractions of that, but still makes me wonder why is it exactly that a universal consciousness, you know, God would be needed to give to give the world meaning if I mean, if universal consciousness can give the world meaning, why can't local consciousness give the world meaning to us? [00:53:42] Well, I think my consciousness gives my world is the meaning is the origin of meaning for your world. [00:53:48] I experience things as good or bad, happy, sad, interesting, important to my consciousness. Invests this world with meaning, without any consciousness. Maybe it would be a bleak, meaningless universe, but I don't see why I need someone else's consciousness or even God's consciousness to give this this universe meaning. Here we are local creatures with our own subjective experiences. I think we can give the universe meaning ourselves. I mean, maybe to some people that feels inadequate. [00:54:18] Yeah, our own local consciousness is somehow too puny and insignificant to invest any of this with cosmic significance. And maybe God gives you a sense of cosmic significance. But I'm just speculating here. [00:54:32] So, you know, it's a really interesting idea that consciousness is the thing that makes life meaningful. [00:54:41] If you could maybe just just briefly explore that for a second, so I suspect just from listening to you now, you mean in an almost trivial sense, just the day to day experiences of life have because of you attach identity to it? Mm hmm. They become. Well, I guess I want to ask something I would always wanted to ask a legit world renowned philosopher, what is the meaning of life? [00:55:22] So I suspect you don't mean consciousness gives any kind of greater meaning to it all and more to day to day, but is there a greater meaning to it all? I think life has meaning for us because we are conscious, so without consciousness, no meaning, consciousness invests our life with meaning. So consciousness is the source of the meaning of life. But I wouldn't say consciousness itself is the meaning of life. I'd say what's meaningful in life is basically what we find. [00:55:56] Meaningful what we experience as meaningful, so if you find meaning and fulfillment and value and say, intellectual work like understanding, then that's your that's a very significant part of the meaning of life for you. Do you find that in social connections or in raising a family? And that's the meaning of life for you? The meeting kind of comes from what you value as a conscious creature. I think there's no on this view. There's no universal solution. You know, universal answer to the question, what is the meaning of life? [00:56:28] The meaning of life is where you find it as a conscious creature, but as consciousness that somehow makes value possible, experiencing some things as good or as bad or as meaningful something comes from within consciousness. [00:56:41] So you think consciousness is a crucial component ingredient of having assigning value to things? [00:56:50] I mean, it's kind of a fairly strong intuition that without consciousness there wouldn't really be any value. If we just had a purely a universe of unconscious creatures, would anything be better or worse than anything else? Certainly when it comes to ethical dilemmas about the older the old trolley problem du jour, kill one person or you switch to the other track to kill, kill five. Well, I've got a variant on this, the zombie trolley problem where there's one conscious being on on one track and the five humanoid zombies. [00:57:26] Let's make them robots. Yeah. Who are not, who are not conscious on the on the other track. Do you given that choice, do you call the one conscious being or the five unconscious robots. [00:57:37] Most people have a fairly clear intuition here. Yeah. Kill the kill the unconscious beings because they basically they don't have a meaningful life. They're not really persons. Conscious being, of course, all we don't have good intuition about. Something like an unconscious being, so in philosophical terms, you referred to as a zombie. [00:58:03] It's a useful thought experiment, construction in philosophical terms, but we don't yet have them. So that's kind of what we may be able to create with robots. And I don't necessarily know what that even means. [00:58:22] So it's merely hypothetical for now. They're just a thought experiment. They may never be possible. I mean, the extreme case of a zombie is a being which is physically, functionally, behaviorally identical to me, but not conscious. That's a mere I don't think that could ever be built in this universe. The question is just could be, does that hypothetically make sense? That's kind of a useful contrast class to raise questions like why aren't we zombies? How does it come about that we're conscious and we're not like that? [00:58:51] But there are less extreme versions of this, like robots, which are maybe not physically identical to us, maybe not even functionally identical to us. Maybe they've got a different architecture, but they can do a lot of sophisticated things, maybe carry on a conversation, but they're not conscious and that's not so far out. We've got a simple computer systems tending in that direction now. And presumably this is going to get more and more sophisticated over the years to come where we may have some pretty quite straightforward to conceive of, some pretty sophisticated robot systems that can use language and be fairly high functioning with our consciousness at all. [00:59:33] Then I stipulate that. I mean, which is a tricky question of how you would know whether they're conscious. But let's say we've somehow solved that and we know that these high functioning robots are unconscious. Then the question is, do they have moral status? Does it matter how we treat them? What is more status means, so does basically society, can they suffer? Does it matter how we treat them? [00:59:57] Are we for example, if we if I mistreat this glass, this cup by a by shattering it, then that's bad. Why is it bad? That's going to make a mess. That's going to be annoying for me and my partner. And so it's not bad for the cup. No one would say the cup itself has moral status. [01:00:16] Hey, you you hurt the cup and that's that's doing it a moral harm. Likewise, plants will again, if they're not conscious, most people think by uprooting a plant, you're not harming it. But if a being is conscious, on the other hand, then you are harming it. So Siri or I do not say the the name of Alexa anyway. [01:00:42] So we don't think where we're morally harming Alexa by turning her off or disconnecting her or even destroying her, whether it's the system or the or the underlying software system, because we don't really think she's conscious. [01:00:55] On the other hand, you move to like the the disembodied being in the moving in the movie her Samantha, I guess she was kind of presented as conscious. [01:01:04] And then if you if you destroyed her, you'd suddenly be committing a serious harm. So I think a strong sense is if a being is conscious and can undergo subjective experiences, then it matters morally how we treat them. So if a robot is conscious, it matters. But if a robot is not conscious. And they're basically just meat or a machine and that and that, and it doesn't matter. So I think at least maybe how we think about this stuff is fundamentally wrong. [01:01:30] But I think a lot of people to think about this stuff seriously, including people who think about the moral treatment of animals and so on, come to the view that consciousness is ultimately kind of the line between systems that. [01:01:43] Where we have to take them into account and thinking morally about how we act and systems for which we don't, and I think I've seen you, the writer, talk about the demonstration of consciousness from a system like that, from a system like Allex or a conversational agent. [01:02:05] That is what you would be looking for is kind of at the very basic level for the system to have an awareness that I'm just the program. And yet why do I experience this or not to have that experience, but to communicate that to you? [01:02:24] So that's what us humans would sound like if you all of a sudden woke up one day like Kafka, right in the body of a bug or something in a computer, you all of a sudden realize you don't have a body. And yet you would feel what you're feeling. You would probably say those kinds of things. So do you think a system essentially becomes conscious by. [01:02:48] Convincing us that it's conscious, hmm, through the words that I just mentioned. So by being confused about the fact that, uh, why am I having these experiences? [01:03:01] So basically, I don't think this is what makes your conscious, but I do think being puzzled about consciousness is a very good sign that a system is conscious. So if I encountered a robot that actually seemed to be genuinely puzzled by its own mental states and saying, yeah, I have all these weird experiences and I don't see how to explain them, I know I'm just a set of silicon circuits, but I don't see how that would give you my consciousness. [01:03:28] I would at least take that as some evidence that there's some consciousness going on there. I don't think a system needs to be puzzled about consciousness to be conscious. Many people aren't puzzled by their consciousness. Animals don't seem to be puzzled at all. I still think they're conscious, but I don't think that's a requirement on consciousness. But I do think if we're looking for signs for consciousness and A.I. systems, one of the things that will help convince me that A.I. system is consciousness. [01:03:58] If it shows signs of it shows signs of introspectively, recognizing something like consciousness and finding this philosophically puzzling in the way that the way that that we do. [01:04:11] It's an interesting thought because a lot of people sort of would at the shallow level, criticize the Turing test for language. That is essentially what I heard, like Dan Dennett criticize in this kind of way, which is it really puts a lot of emphasis on lying. [01:04:30] Yeah. [01:04:31] And then being able to being able to imitate human beings. Yeah. There's this there's this cartoon of the AI system studying for the Turing test. It's got to read a book called Talk Like a Human Won't Have to Waste My Time Learning How to imitate humans. Maybe the system is going to be way beyond the hard problem of consciousness. And it's going to be like, why do I need to waste my time pretending that I recognize the hard problem of consciousness through, uh, in order for people to recognize me as conscious? [01:04:59] Yeah, it just feels like I guess the question is, do you think there's a way we can never really create a test for consciousness because it feels like we're very human centric. And so the only way we would be convinced that something is consciousness, but is basically the thing demonstrates the illusion of consciousness. That we can never really know whether it's conscious or not, in fact. That almost feels like it doesn't matter then or does it still matter to you that something is conscious or it demonstrates consciousness? [01:05:37] You still see that fundamental distinction, I think to a lot of people, whether a system is conscious or not matters hugely for many things like how we treat it cannot suffer and so on. But still, that leaves open the question, how can we ever know? And it's true that it's awfully hard to see how we can know for sure whether our system is conscious. I suspect that sociologically, the thing that's going to convince us that the system is conscious is in part. [01:06:07] Things like social interaction, conversation and so on, where they seem to be conscious, they talk about their conscious states or just talk about being happy or sad or finding things meaningful or being in pain that will tend to convince us if we don't, the system genuinely seems to be conscious. We don't treat it as such. Eventually, it's going to seem like a strange form of racism or speciesism or somehow not to acknowledge them. [01:06:33] Actually believe that, by the way, I believe that there is going to be something akin to the civil rights movement. [01:06:40] But for robots. Mm hmm. I think the moment you have a Roomba, say, please don't kick me. That hurts. Just say it. Yeah, I think they will fundamentally change the fabric of our society. [01:06:57] I think you're probably right, although it's going to be very tricky because to say where we've got the technology, where there's conscious beings can just be created and multiplied by the thousands by flipping a switch. [01:07:09] So and the legal status is going to be different. [01:07:12] But ultimately, the moral status ought to be the same. And yeah, the civil rights issue is going to be a huge mess. So if one day somebody clones you. Another very real possibility. In fact, I find the conversation between two copies of David Chalmers, hmm, quite interesting. [01:07:38] I thought just this idiot, he's not making any sense. [01:07:43] So what do you think? He would be conscious? I do think he would be conscious. I do think in some sense, I'm not sure it would be me, there would be two different beings at this point. I think they both be conscious and they both have many of the same mental properties. [01:08:02] I think they both and we have the same moral status. It would be wrong to hurt either of them or to kill them and so on. Still, there's some sense in which probably their legal status would have to be different. If I'm the original and that one's just a clone, then you're creating a clone of me. Presumably the clone doesn't, for example, automatically own the stuff. That I own or, you know, um. I've got to, you know, certain connect the things that the people I interact with, my family, my partner and so on, I'm going to somehow be connected to them in a way in which the clone isn't. [01:08:40] So because you came slightly first. Yeah, but the clone would argue that they have. [01:08:48] Really, as much of a connection, they have, all the memories of that connection, in a way you might say it's kind of unfair to discriminate against them, but say you've got an apartment that only one person can live in or a partner who only one person. But why should it be, you know, the original interesting philosophical question. [01:09:06] But you might say because I actually have this history. If I am the same person as the one that came before and the clone is not, then I have this history that the clone doesn't cause. There's also the question. Isn't the clone the same person, too? This is a question about personal identity. If I continue and I create a clone over there. I want to say this one is me and this one is is someone else. But you could take the view that a clone. [01:09:34] Is equally me, of course, in a movie like Star Trek, where they have a stellar transporter, basically creates clones all the time. They treat the clones as if they're the original person cos they destroy the original body and Star Trek. So there's only one left around that. Only very occasionally the things go wrong and you get two copies of Captain Kirk. But somehow our legal system at the very least, is going to have to sort out some of these issues. [01:09:57] And maybe that's what's moral and much what's legally acceptable are going to come apart. [01:10:04] What question would you ask a clone of yourself? Yeah, there something useful you can find out from him about the fundamentals of consciousness even? [01:10:17] I mean, kind of in principle, I know that if it's a perfect clone, it's going to behave just like me. So I'm not sure I'm going to be able to I could discover whether it's a perfect clone by seeing whether it answers like me. But otherwise, I know what I'm going to find is being, which is just like me, except that it's just undergone this great shock of discovering that it's a clone. So just so you woke me up tomorrow and said, hey, Dave, sorry to tell you this, but you're actually the clone and you have to be really convincing. [01:10:50] Evidence should be the film of my being cloned and then all right here, being here and waking up. [01:10:58] So you prove to me I'm a Clonmel you I would find that shocking. And who knows how I would react to this. So so maybe by talking to the clone, I'd find something about my own psychology that I can't find out so easily, like how I'd react upon discovering that I'm a clone. I could certainly ask the clone if it's conscious and what is consciousness is like and so on. But I guess I kind of know if it's a perfect clone, it's going to behave roughly like me. [01:11:21] Of course, at the beginning there will be a question about whether a perfect clone as possible. So I may want to ask it lots of questions to see if it's consciousness and the way it talks about its consciousness and the way it react to things in general is like me. And, you know, that will occupy us for a little while. [01:11:39] Some basic unit unit testing in the early models. [01:11:42] So so if it's the perfect clone, you say there's going to behave exactly like you. So that takes us to free will. Mm hmm. So if. Is there free will? Are we able to make decisions that are not predetermined from the initial conditions of the universe? [01:12:01] You know, philosophers do this annoying thing of saying it depends what you mean. So in this case, it really depends on what you mean by by free will. If you mean something which was not determined in advance, could never have been determined, then I don't know. We have free will. I mean, there's quantum mechanics. And who's to say if that opens up some room? But I'm not sure we have free will in that sense. But I'm also not sure that's the kind of free will that really matters. [01:12:30] You know what matters to us to be able to do what we want and to create our own futures. [01:12:36] We've got the distinction between having our lives under our control and under someone else's control, that we've got the sense of actions that we are responsible for versus ones that were not. [01:12:48] I think you can make those distinctions even in a deterministic universe. [01:12:53] And this is what people call the compatibles view of free will where it's compatible with determinism. So for many purposes, the kind of free will that matters is something we can have in a deterministic universe. And I can't see any reason in principle why an AI system couldn't have free will of that kind. [01:13:11] If you mean superduper free will, the ability to violate the laws of physics and doing things that in principle could not be predicted, I don't know. Maybe no one has that kind of free will. [01:13:21] What's the connection between the the reality of free will and the experience of it, the subjective experience in your view? [01:13:32] So how does consciousness connect to this, to the experience of it, to the reality and the experience of certainly true that when we make decisions and when we choose and so on, we feel like we have an open future? [01:13:44] Yes, I feel like I could do this. I could go into philosophy or I could go into math. I could go to a movie tonight. I could go to a restaurant. Um, so we experience these things as if the future is open. I mean, maybe we experience ourselves as exerting a kind of effect on the future, that somehow picking out one path for many paths were previously open. [01:14:11] And you might think that actually, if we're in a deterministic universe, there's a sense of which objectively those paths weren't really open all along, but subjectively they were open. [01:14:22] And that's I think that's what really matters in making our decisions about our experience of making a decision is choosing a path for for ourselves. I mean, in general, our introspective models of the mind, I think, are generally very distorted representations of the mind. So it may well be that our experience of our self in making a decision. Experience of what's going on doesn't terribly well mirror what what's going on. I mean, you know, maybe there are antecedents in the brain way before anything came into consciousness and and and so on. [01:14:55] Those aren't represented in our introspective models. So in general, our experience of our experience of perception, yes, I experience perceptual image of the external world. It's not a terribly good model of what's actually going on in the in my visual cortex and so on. It has all these layers and so on. It's just one little snapshot of of one bit of that. [01:15:16] So in general, your introspective models are very over oversimplified and it wouldn't be surprising if that was true of free will as well. There's also, incidentally, can be applied to consciousness itself. There is this very interesting view that consciousness itself is an introspective illusion. In fact, we're not conscious, but we are. But we the brain just has these introspective models of itself or oversimplifies everything and represents itself as having these special properties of consciousness thing. It's a really simple way to kind of keep track of itself and so on. [01:15:51] And then on the illusionist view. Yeah, that's just that's just an illusion. That was I find this view. [01:15:58] I find it implausible. I do find it very attractive in some ways because it's easier to tell some story about how the brain would create introspective models of its own consciousness, of its own free will, as a way of simplifying itself. I mean, it's a similar way when we perceive the external world, we perceive it as having these colors that maybe it doesn't really have, because that's a really useful way of keeping track of keeping track. Did you say that you find it not very plausible? [01:16:25] Because I find it both plausible and attractive in some sense, because it I mean, that's that kind of view is one that has the minimum amount of mystery around it. [01:16:41] You can kind of understand that kind of view. Everything else says we don't understand so much of this picture now. [01:16:51] It is very it is very attractive. I recently wrote an article about this kind of issue called The Meta Problem of Consciousness. The hard problem is how does the brain give your consciousness? The mental problem is why are we puzzled by the hard problem of consciousness and because our being puzzled by it, that's ultimately a bit of behavior. We might be able to explain that bit of behavior as one of the easy problems, consciousness. So maybe there'll be some computational model that explains why we're puzzled by consciousness. [01:17:20] The motor problem is come up with that model and I've been thinking about that a lot lately. There some interesting stories you can tell about why the right kind of computational system might develop these introspective models of itself that attribute itself, these special properties, so that that metter problem is a research program for everyone. And then if you've got attraction to sort of simple views, desert landscapes and so on, then you can go all the way with what people call illusion ism and say, in fact, consciousness itself is not real. [01:17:54] What is real is just these are these introspective models we have that tell us that we're conscious. [01:18:02] So the view is very simple, very attractive, very powerful. The trouble is, of course, it has to say that deep down, consciousness is not real. We're not actually experiencing right now. And it looks like it's just contradictory in a fundamental datum of our existence. And this is why most people find this view crazy, just as they find pantheism crazy. [01:18:24] In one way, people find illusion isn't crazy in another way. But I mean. But so, yes, it has to deny this fundamental datum of our existence now. And that makes the view sort of, frankly, unbelievable for most people. [01:18:42] On the other hand, the view developed, right, might be able to explain why we find it unbelievable, because these models are so deeply hardwired into our head and they're all integrated. [01:18:52] So it's not you can't escape that the illusion as the crazy possibility. [01:18:57] Is it possible that the entirety of the universe, our planet, all the people in New York, all the organisms on our planet, the including me here today, are not real in in that sense, they're all part of an illusion inside of Dave Chalmers, his head. [01:19:16] I think all this could be a simulation now, but not just a simulation. Yeah, because the simulation kind of. Is outside of you a dream? [01:19:27] What if it's all an illusion, there's a dream that you're experiencing that is all in your mind, right? [01:19:35] Is that can you take illusion? Isn't that far? [01:19:39] Well, there's illusion isn't about the external world and illusion isn't about consciousness. And these might go introspective. Different illusion isn't about the external world. Kind of takes you back to Descartes and you could all this be produced by an evil demon? Descartes himself also had the dream argument. [01:19:56] He said, how do you know you're not dreaming right now? How do you know this is not an amazing dream and it's at least a possibility that, yeah, this could be some super duper complex dream in the next universe up? I guess my attitude is that. As. I mean, Descartes thought that if the evil demon was doing it, it's not real. A lot of people these days say it's a simulation is doing it. It's not real. [01:20:22] As I was saying before, I think even if it's a simulation that doesn't stop them from being real, it just tells us what the world is made of. [01:20:28] Likewise, if it's a dream, it could turn out that all this is like my dream created by my brain in the next universe. My own view is that wouldn't stop this physical world from being real. It would turn out this cup at the most fundamental level was made of a bit of, say, my consciousness in the dreaming mind at the next level up. Maybe that would give you a kind of weird kind of sarcasm about reality, but it wouldn't show that the cup isn't real. [01:20:56] But just tell us it's ultimately made of processes in my dreaming mind. So I resist the idea that if the physical world is a dream, then it's an illusion that it's right. [01:21:09] By the way, perhaps you have an interesting thought about it. Why is the cards demon or genius considered evil? I couldn't have been a benevolent one that had the same powers. [01:21:22] Yeah, I mean, Descartes called it the Mlangeni. The Evil Genie or evil genius malign, I guess was the word. But yes, interesting question. I mean, a later philosophy. Barkley said no, in fact. All this is done by God. God actually supplies you all of these all of these perceptions and ideas, and that's how physical reality is sustained. And interestingly, Barclays', God is doing something that doesn't look so different from what Descartes evil demon was doing, things that they thought it was deception and Barkley thought it was not. [01:22:03] And I'm I'm actually more sympathetic to Berkeley here. Um, yeah. This evil demon may be trying to deceive you, but I think. OK, well, the evil demon may just be under the working under a false philosophical theory. I think it's deceiving you. It's wrong. It's like there's machines in the Matrix. They thought they were deceiving you, that all this stuff is real. I think no. If we're in a matrix, it's all still it's all still real. [01:22:28] Yeah, the philosopher. OK, Bruce, I had a nice story about this about 50 years ago about Descartes evil demon, where this demon spends all its time trying to fool people but fails because somehow all demon ends up doing is constructing realities for four people. [01:22:47] So, yeah, I think that be if it's a very natural to take this view that if we're in a simulation or or even a demon scenario or something, then none of this is real. But I think it may be ultimately a philosophical mistake, especially if you take on board sort of the view of reality about what matters to reality is really a structure, something like its mathematical structure and so on, which seems to be the view that a lot of people take from contemporary physics. [01:23:13] And it looks like you can find all that mathematical structure in a simulation, maybe even in a dream and so on. So as long as that structure is real, I would say that's enough for the physical world to be real. Yeah, the physical world may turn out to be somewhat more intangible than we had thought and have a surprising nature, but we're already gotten very used to that from for modern science. [01:23:36] So you've kind of alluded that you don't have to have consciousness for high levels of intelligence, but to create truly general intelligence systems, ajai systems that human level intelligence and perhaps superhuman level intelligence. [01:23:51] You've talked about that, if you like, that kind of thing might be very far away. But nevertheless, when we reach that point, do you think consciousness from an engineering perspective is needed or at least highly beneficial for creating an ajai system? [01:24:11] Yeah, no one knows what consciousness is for functionally. So right now, there's no specific thing we can point to and say you need consciousness for that. So my inclination is to believe that in principle, ajai is possible. The very least I don't see why someone couldn't stimulate a brain, ultimately have a computational system that produces all of our behavior. And if that's possible, I'm sure vastly many other computational systems of equal or greater sophistication are possible with all of our cognitive functions and more. [01:24:46] My inclination is to think that. Once you've got all these cognitive functions, you know, perception, attention, reasoning, introspection, language, emotion and so on, it's very likely you'll have you'll have consciousness as well as this is very hard for me to see how you'd have a system that had all those things while bypassing somehow conscious. [01:25:12] So just naturally, it's integrated quite naturally. There's a lot of overlap about the kind of functions that are required to achieve each of those things that's there. So you can't disentangle them even when are at least in us. [01:25:26] But we don't know what the causal role of consciousness in the physical world, what it does. I mean, just say it turns out consciousness does something very specific in the physical world, like collapsing way functions as on one common interpretation of quantum mechanics. [01:25:41] Then we might find some place where it actually makes a difference and we could say, oh, here is where and collapsing way functions. It's driving the behavior of a system. And maybe it could even turn out that for ajai you'd need something playing that. I mean, if you wanted to connect this to free will, some people think consciousness collapsing way functions. That would be how the conscious mind exerts effect on the physical world and exerts its free will. [01:26:07] And maybe it could turn out that any adjei that didn't utilize that mechanism would be limited in the kinds of functionality that it had. I don't myself find that. Plausible, I think probably that functionality could be stimulated, but you can imagine once we had a very specific idea about the role of consciousness in the physical world, this would have some impact on the capacity of ages. [01:26:31] And if it was a role that could not be duplicated elsewhere, then we'd have to find we have to find some way to either get consciousness in the system to play that role or simulate it. [01:26:42] If we can isolate a particular role to consciousness. Of course, that's incredibly, uh, seems like an incredibly difficult thing. [01:26:51] Whatever worries about existential threats of conscious, intelligent beings that are not us, though. [01:27:03] So certainly I'm sure you're worried about us. [01:27:06] Yeah. From an existential threat perspective. But outside of US A.I. systems, there's a couple of different kinds of existential threats here. [01:27:15] One is an existential threat to consciousness generally. I mean, yes, I care about humans and the survival of humans and so on. But just say it turns out that. That eventually were replaced by some artificial beings around humans, but are somehow our successors, they still have good lives, they still do interesting and wonderful things of the universe. I don't think that's that's not so bad. That's just our successors. We will one stage in evolution, something different, maybe better came next. [01:27:46] If, on the other hand, all of consciousness was wiped out, that would be a very serious moral disaster. One way that could happen is by all intelligent life being wiped out. And many people think that, yeah, once you get to humans and A.I. is an amazing sophistication where everyone has got the the ability to create weapons that can destroy the whole universe just by just by pressing a button, then maybe it's inevitable intelligent life will will die out. [01:28:17] That would be a that would certainly be a disaster. [01:28:20] And we've got to think very hard about how to avoid that. But, yeah, another interesting kind of disaster is that maybe intelligent life is not wiped out, but all consciousness is wiped out. So just say you thought, unlike what I was saying a moment ago, that there are two different kinds of intelligent systems, some which are conscious and some which are some which are not. And just say it turns out that we create ajai with with high degree of intelligence, meaning higher degree of sophistication. [01:28:49] And that's behavior, but with no consciousness at all. That ajai could take over the world. Maybe, but then maybe. But let there be no consciousness in this world. This would be a world of zombies. Some people have called this the zombie apocalypse because it's consciousness. Consciousness is gone. You've really got this superintelligent nonconscious robots. And I would say that's a moral disaster in the same way, in almost the same way that the world with no intelligent life is a moral disaster, all value and meaning maybe gone from a from that world. [01:29:24] These are both threats to watch out for. Now, my own view is if you get superintelligence, you're almost certainly going to bring consciousness with it. So I hope that's not going to happen. But of course, I don't understand consciousness. No one understands consciousness. This is one reason for this is one reason, at least among many, for thinking very seriously about consciousness and thinking about the kind of future we want to create with in a world with humans and our eyes. [01:29:50] How do you feel about the possibility if consciousness so naturally does come with the ajai systems, that we are just a step in the evolution that we will be just something a blip on the record will be studied in books by the ajai systems centuries from now. I mean, I think I'd probably be OK with that, especially if somehow humans are continuous with egos. I mean, I think something like this is inevitable. At the very least, humans are going to be transformed. [01:30:21] We're going to be augmented by technology. It's already happening in all kinds of ways. We're going to be transformed by technology. Our brains are going to be uploaded and. [01:30:32] Computationally enhanced and eventually that line between what the human and Wazza. But today I may be kind of hard to hard to draw. How much does it matter, for example, that some future being a thousand years from now that somehow descended from us actually still has biology? I think it would be nice if you kind of point to its cognitive system to point to some parts that had some roots in us and chaser trace a continuous line there that would be selfishly nice for me to think that, OK, I'm connected to this thread line through the future of the world. [01:31:05] But it turns out, OK, there's a jump there. If they found a better way to design cognitive systems, they designed a whole new kind of thing. And the only line is some causal chain of designing and systems that design better systems. Is that so much worse? I don't know. We're still at least part of a causal chain of of design. And yes, they're not humans, but still there are successes. I mean, ultimately, I think it's probably inevitable that something like that will happen. [01:31:33] And at least we were at least we were part of the process. It'll be nice if they still care enough about us to, you know, maybe to engage with our arguments. But I'm really hoping that the Aggies are going to solve all the problems of philosophy. They'll come back and read all this all this crap for the 20th and 21st century. Hard problem of consciousness. And here is why they got it wrong and so on. If that happened, then I'd really feel like I was part of at least the intellectual process over centuries. [01:32:01] And that would be kind of cool. [01:32:02] I'm pretty sure that would clone or they would recreate David Chalmers and for the fun of it, sort of bring back the philosophy of the car, the car, and just put them in a room and just watch. [01:32:15] I'll be a Netflix of the Future show where you bring philosophers from different human 100 percent human philosophers from previous generations, put them in a room and see them. I am totally I am totally up for that simulator's ages of the future. If you're watching the broadcast crew that I would like to be recreated and who would who would be hurt with the cart would be the first. [01:32:39] If you if you could hang out as part of such a TV show with a philosopher that's no longer with us from long ago, who would who would you choose? [01:32:49] Oh, they would have to be right up there. Oh, actually, a couple of months ago, I got to have a conversation with Descartes, an actor who was actually a philosopher came out on stage playing Descartes. I didn't know this was going to happen and I'd suffer. I gave a talk and a bit of a story about how my ideas were crap and all derived from him. [01:33:08] And so I went along. We had a long argument. This was great. I would love to see what Descartes would think about A.I., for example, and the modern neuroscience and so on. [01:33:16] I suspect not too much would surprise him. But but yeah. William James for psychologist of consciousness, I think James is probably the most probably the the richest. But all there are a manual count you I never really understood what he was up to. If I got to actually talk to him about some of this. Hey, there was Princess Elizabeth who talked with Descartes and who really, you know, go to the problems of how Descartes ideas of non-physical mind interacting with the with the the physical body couldn't really work. [01:33:54] She's been kind of most philosophers think she's been proved right. [01:33:56] So maybe put me in a room with Descartes and Princess Elizabeth and we can all argue about what kind of future. So we talked about with zombies, a concerning future. But what kind of future excites you? What do you think? If we look forward, sort of we're at the very early stages of understanding consciousness and we're now at the early stages of being able to engineer complex, interesting systems that have degrees of intelligence to maybe one day we'll have degrees of consciousness, maybe be able to upload brains, all those possibilities, virtual reality. [01:34:35] What is there a particular aspect to this future world that just excites you? I think there are lots of different aspects. I mean, frankly, I wanted to hurry up and half say, yeah, we've had some progress lately and I and we are. [01:34:50] But in the grand scheme of things, it's still kind of slow. The changes are not yet transformative. And, you know, I'm in my 50s. I've only got so long left. I'd like I'd like to see really serious I in my lifetime and really serious virtual worlds because, yeah, once people are, I would like to be able to hang out in a virtual reality which is richer than, uh, than than this reality to really get to and have it fundamentally different kinds of spaces. [01:35:19] Well, I would very much like to be able to upload my mind onto a onto a computer. So maybe I don't have to die if this is maybe gradually replace my neurons with the silicon chips. And I'd have it like if you're selfishly that would be a that would be wonderful. I suspect I'm not going to quite get there in, uh, in my lifetime. [01:35:41] But once that's possible, then you've got the possibility of transforming your consciousness in remarkable ways, augmenting it and harnessing it. [01:35:50] So let me ask then, if such a system is a possibility within your lifetime and you were given the opportunity to become immortal. In this kind of way. Would you choose to be a model? Yes, I totally would. I know some people say they couldn't it would be awful to be to be immortal. [01:36:15] It would be so boring or something. I don't see I really don't see a downside why this might be I mean, even if it's just ordinary life to continue as ordinary life is not so bad. But furthermore, I kind of suspect that, you know, if the universe is going to go on forever or indefinitely, it's going to continue to be interesting. I don't think your view is that we're just here to get this one romantic point of interest now and afterwards we're going to be boring superintelligent status. [01:36:45] I guess my vision is more like no, it's going to continue to be infinitely interesting, something like as you go up the set theoretic hierarchy, you know, you go from the the finite, finite cardinals to alif zero and then through there to that one out of two and maybe the continuum and you keep taking power sets. And, you know, in set theory, they've got these results that actually all this is fundamentally unpredictable. It doesn't follow any simple computational patterns. [01:37:14] There's new levels of creativity as the universe expands and expands. I guess that's my future. That's my vision of the future. That's my optimistic vision of the future of superintelligence. It will keep expanding and keep growing, but still being fundamentally unpredictable at many points. I mean, yes, this gets creates all kinds of worries, like couldn't all be fragile and be destroyed at any point. So we're going to need a solution to that problem if we get to stipulate that I'm immortal. [01:37:40] Well, I hope that I'm not just immortal and stuck in the single world forever, but I'm immortal and get to take part in this process of going through infinitely rich, created futures. Rich, unpredictable, exciting. Well, I think I speak for a lot of people and saying, I hope you do become a model and they'll be that Netflix show the future where you get to argue with Descartes perhaps for all eternity. [01:38:06] So David is an honor. Thank you so much for talking today. [01:38:09] Thanks. It was a pleasure. Thanks for listening to this conversation and thank you to our presenting sponsored cash app Download it is Codecs podcast. You'll get ten dollars and ten dollars will go to First, an organization that inspires and educates young minds to become science and technology innovators of tomorrow. If you enjoy this podcast, subscribe on YouTube. Give it five stars, an app, a podcast, follow on Spotify, supported on Patrón or simply connect with me on Twitter. [01:38:38] Allex Friedemann. And now let me leave you with some words from David Chalmers Materialism is a beautiful and compelling view of the world, but to account for consciousness, we have to go beyond the resources it provides. Thank you for listening and hope to see you next time.

本集資源與出處