Everything you said seems true. We don’t understand the how brain works as well as we understand how neural networks work, and the brain does have many more mechanisms for operating.

Nonetheless, I think the similarity remains, which is that we do not understand how the modern AI is computing its results in a similar way that we don’t understand how the brain is doing so.

We can describe how the computer works, but not how the program achieves the result.

We can say “it knows based on its experience in millions of games that a board looking like this needs this move next” but this is only like saying “a person knows based on experience that …” anything.

It doesn’t answer the question “how does the thing recognise and analyse the factors involved”.

You can’t actually do what you said: you can’t “study every bit of information” in a neural network. You can study network weights and values, but this offers no more insight into how it gets the result than studying synases firing tells you how the brain decides what to do next.

This will become more true as memory is introduced into these systems, which in turn increases the opportunity for self-reference.

I do agree that AI appears to have less opportunity for more “unexplained phenomena” such as telepathy, because the physics of neural networks are as you say well understood.

So maybe I have ended up in furious agreement with you, I’m not sure

The goal of my analogy with computers was not to show that there is a way we can understand how thought processes work, since I agree that we cannot understand how neural networks work by studying every bit of information.

The goal was to argue that consciousness, if it can exist in computers, is a physical thing, and not something hidden in a deeper layer of reality that we haven’t discovered / understood yet. The physics of brains does not allow such a thing in the same way as the physics of computers doesn’t allow for it, however, with brains we don’t fully understand the physical part of thinking either (but with computers we do)!

one time, at the end of a journey i was laying in bed and i closed my eyes. I had no choice but to let my mind wander. And then i smelled fish and thought “thats strange” then in my minds eye i looked down and saw these crab legs moving and i thought “how interesting that they move the way they do”. It wasnt till later that i think i realized what it woulda been like to be a crab.
I had a similar experience with a rainbow trout where i felt the primal urge to swim back to where i was spawned. The interesting thing is i didn’t know they did that and also that i recently coincidentally was driven back to the hospital where i was born and its like a 100 min away drive lol

Side note: I hope my tone isn’t coming off nitpicky or argumentative, because I’m actually really enjoying this philosophical discussion. A couple of questions regarding yours statements below:

So first, with regard to your statement that you can imagine an infinitely large series of numbers, but that doesn’t mean that this infinitely large things actually exists. I guess this brings up some really fundamental questions - do you see the things that math describes as having an independent existence outside our ideas in the universe? Or is math only a product of our ideas playing among themselves in a circular fashion? Are infinitely large numbers a “real thing” that has a correlate in the reality outside of us (in that you can take any number N and have a larger number N+1) or is just a game that we play in our minds?

Second, all of your arguments against something having the capacity to be infinite seem to be focused on resources - i.e. finite time, finite steps, etc. I guess I keep coming back to the idea of a given phenomenon having the capacity to be infinite in the abstract (in that if you have N you can always have N+1) rather than the concrete (i.e. “one person could never add up an infinite series of numbers because they would die of old age before they finished”).

So for me, the state space of “all the possible products of the human imagination” are infinite because they fall into that [N -> N+1] category - that regardless of the resources that exist to be thrown at it - there is the capacity to continuously increase that state space by coming up with chunks of state space that human imagination can inhabit, and having those new state spaces generate more complexity, create new innovations, which then enlarge that state space even further, etc.

It seems like we’re not exactly talking about the same things - it’s like we’re on different sides of a philosophical divide

SWIM went to work with the explicit idea of testing the telepathy. They thought the phrase in their head “im feeling sick i think im going to go home” and then their coworkers walked past and said the same thing verbatim. SWIM then went home freaked out by the timing and coincidence.

Not at all, it’s my pleasure to talk about philosophy of mathematics (although it might be considered off-topic for this thread?)

I might go a little overboard with my next response, but don’t blame me, eh?

So yes, this is the major dividing line in philosophy of mathematics. There is the realist view, of which probably the Platonist viewpoints is the most common, that our mathematical ideas are abstractions of existing concepts and rules (compare with the shadows on the wall of Plato’s cave). And then there is the anti-realist view, of which formalism and intuitionism could be considered common, in which mathematics has no objective truth and is merely the result of rules made up by us.

I have do make the disclaimer that consider myself to be in the formalist camp (as you might have noticed). I find it more beautiful if the thing we study is just how some rules interact with each other, than as a quest to find the truth. For one, I’m assured that it is impossible to find the truth (which I’ll explain below in a digression), and for another, one of my main interests is studying how different assumptions can give rise to different interesting mathematical models. If I were searching for the truth, most of that would become meaningless.

Perhaps it is a good point to stop and think for a moment what infinity actually is. How is infinity different from “finity”? Things like “unboundedly many”, “until forever” and “approaching zero” give some intuition to what it might mean, but they never get concrete. It does give us the idea that infinity has to do with the size of things.

So let’s start with the easy part: how do we know for a certain collection of objects, what its size is? Well, we do it by counting the objects. If I have n apples, then I could stick a unique number from 1 to n on each apple (that is, count them). How do we compare sizes? If I have a collection of m apples and a collection of n pears, I put them in pairs: for each apple, I choose a pear, and for each pear I choose an apple. If I run out of one of the two fruits, then I know that that collection had less than or equal objects than the other. In particular, if I can do it in such a way that I run out of the apples and the pears both at the same time, then I have two collections of equal size.

So now let’s lift this idea to the infinite. To begin with, we have a problem: using just finite resources (time, space, objects), I can never reach infinitely many things. This is actually something you could prove using the above description of size. The idea is that at each step x in my trying to reach infinity can only use a finite number f(x) of resources, so in total I have collected f(0)+f(1)+…+f(x) resources. But since everything is finite, this is still just a finite collection of resources: I didn’t get anywhere. Surely, if I do this for infinitely many steps, I can get infinitely many things, but who says there is enough time to do this for infinitely many steps? Could I ever claim to be at a point in my construction where I have done an infinite number of steps? It is not at all something obvious we should be allowed to do so.

So, we need to assume that there exists something that is infinite to get something infinite. This already makes it incredibly difficult to ever point to some actual thing being infinite. But if we disregard the Platonic difficulties with accepting infinity (which would need us to be convinced it actually exists), we could argue in the formal way that if such a thing as infinity existed, then we could study its properties. Usually we take the set of all finite counting numbers (0,1,2,3,…), also called ordinals, as our prototype for an infinitely large collection. We could “create” such a collection by a neverending process of taking the collection of finite ordinals up to a certain size 1,2,…,n, and then making a new collection 1,2,…,n,n+1 with just one more object. If we assume what would be the result of this neverending process, we get a collection with infinitely many objects (finite ordinals in this case).

Now that we have our infinitely many ordinals, I could describe any collection of things to have an infinite size, when I could label each object in my collection with a unique (finite) ordinal. If I run out of (finite) ordinals, then I know my collection is infinite.

In fact, I wish to digress a little yet again
In fact, I wish to digress a little yet again, to discuss that there are actually many sizes of infinity. This is what gave rise to Axiomatic Set Theory, after Georg Cantor discovered this fact. There are collections that are properly larger than some infinite collection (in fact, for any infinite collection there is a strictly larger infinite collection). This might seem obvious at first sight, since we could just add more objects to an infinite collection, but this is not the case: simply adding some objects might not change the size.

For example, if I take all the even counting numbers (0,2,4,6,…), then there are just as many of them as there are general counting numbers (0,1,2,3,…): I could pair to each general counting number a unique even counting number, by pairing the number n to the number 2×n. By the above description of when two collections would have an equal size, this means that these two collections have the same size, even though “half” of the counting numbers are missing in my collection of even numbers.

However, there are properly larger collections, such as the collection of real numbers. The proof that this is true is one of the most beautiful mathematical proofs out there, and not too difficult to understand. It’s called Cantor’s diagonal argument, and I highly recommend reading it.

Here's the promised digression about that I believe it impossible to find the truth

Mathematical proofs are in the end based on some assumptions. Simply speaking, we can’t start without something. In the early 19th century, a school of mathematics arose that was specifically interested in describing a sufficient set of these starting assumptions, called axioms that were strong enough to prove all of mathematics in a very formal, logically sound way. The philosophy of this school was called logicism, made particularly famous by the attempts of Bertrand Russel and Alfred North Whitehead, resulting in the Principia Mathematica.

Now along came the 25 year old logician Kurt Gödel, who showed using a very clever trick, that it is impossible for any collection of axioms that is strong enough to do arithmetic in (that is, counting, addition and multiplication), can never be able to prove for all mathematically expressible statements whether it is true or false. Furthermore, he showed that it is impossible for such a collection of axioms to show that it would not lead to a contradiction: this means that if the axiomatic system was reasonable in that it would not have contradictory statements, then we would never be able to use this axiomatic system to prove so.

And sure enough, there were mathematical statements that have been proved to be unprovable using “standard” mathematical approaches (I’ll leave “standard” undefined, but read it as the kind of mathematics that 95% of mathematicians are concerned with). Two famous ones are the Axiom of Choice, which states that we could pick representatives from an infinite number of nonempty collections, or the Continuum Hypothesis, which states that any infinite collection of real numbers can only have two possible sizes. It has been shown for both of these statements that they could be true, and that they could be false, without making any difference to “standard” mathematics.

The question them becomes, are these statements Platonically speaking true or are they false? It will be extremely difficult to make a good case for either of these claims, since we cannot use “standard” mathematics to determine it. In my opinion this makes a strong case to refuse to assign any truth value to such statements, and instead consider them as formally following from certain (non-“standard”) assumptions and being negated by other (non-“standard”) assumptions.

I agree with this. In the abstract, the concept of infinity is something tangible, that we could work with, and create new concepts with. In the concrete, the concept of infinity does exist, since we can think of it. However, in the concrete, I am not convinced of the existence of infinity, i.e. the thing the concept talks about. To be clear: I’m ambivalent about it, I think it is very well possible that it exists (and would love it if it did), but it could equally well be that our universe is finite in nature.

Here I feel there is a flaw in the distinction between the concept and the thing itself. The space of “all the possible products of the human imagination” might be infinite (although I am not convinced of this either), but I think only the concept of this state space is part of the actual state space of our universe. Meaning that it might be that not every possible idea is in itself an existing things.

In my view, the thing that is “an idea that a human has” is an existing part of our universe, while “the idea” that a human has, is not an existing part of our universe.

Here you describe a process of creating something larger. As with the problems above, I find it not naturally obvious that such a process would have a result. There is a difference in the things a process can produce if we let it run forever, and the things a process could actually produce.

I also object to the state space of the universe expanding when ideas are born. In my view, those the “thinking of those ideas” are still part of the same state space that already existed. The object that is the idea itself, does not make part of the state space (unless it already was).

I am reminded of a zen story where a monk is asked to be judicial in a disagreement between two people. He listens to the first argument and says “Yes.Yes. You’re right. You’re right.” And then listens to the second and says “Yes. Yes. You’re right. You’re right.”
And somebody says “wait a minute, you can’t agree with two totally different arguments.” And the monk says “Yes. Yes. You’re right. You’re right.”

So, Naps, here’s a true story. I had a cool green copper wind chime with five or six tubes of different lengths when I was a teenager. One afternoon I was lying in my bed and spacing out listening to the wind chime ring its different and random clusters of notes here and there. For about five minutes I got into a zone where could anticipate what the next cluster of sounds would be. I heard them in my Inner ear before they happened. They were each different. I got so freaked out, I jumped up and took the wind chime down from outside my window and buried it in the back yard. In hindsight, sad, one should not give in to fear.

I believe it is possible to have contact with the numinous, infinite, & divine. You know it when it’s happening. Just a drop of the infinite in a system goes a long way; can change everything.

Hm. Assuming the visible universe (~10^27 meters in diameter) consisted of planck-length (~10^-34 meters) voxels and assuming they could be in one of two states (on/off, if you will), also assuming the universe was cubic with side length ~10^27 meters… (because otherwise it’s spherical and calculating 4/3 x pi x r^3 is probably not worth the hassle)

10^81 cubic meters, with each cubic meter subdivided into 10^102 voxels, that’s a total of 10^183 voxels and a grand total of 2^(10^183) possible states of the universe, or about 10^(10^182) A decimal number with 10^182 digits. Quite big, but still finite. xD

Sometimes I feel that considering my mortality is a way to get a taste of the infinite. It is quite likely that there’s nothing after death, and that I will never exist again forever; not existing, no time or experience, but still never coming back again forever. Very strange