Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

So you think no silicon computer could ever correctly calculate the way atoms move, and photons bounce?

Because that's the only way for it to fail cognition tests! It has to calculate different photons than you'd get from a real body.

And I feel like the idea that some physical processes just can't be simulated is magical thinking.



Does simulating a gold bar turn the simulation into gold?

I feel im going round in circles here. A description of a system, even if that description is "active" (ie., it evolves over time)... is not the same as the system.

I can take a photograph of a mountain. My hand has no mountain in it, but a photograph.

I can describe any system with mathematics. I can give every atom in your body a number for all of its properties, and a location with respect to the centre of the earth and then append all those numbers together to form a massive number X.

Over time because your position and properties change the number which describes you X2 differs from X.

If I start by writing X down, then X2, then X3, etc. then the ink on the page describes you as a changing system.

The ink isnt you. It isnt alive. It's ink.

That is all a machine is. We have replaced ink with electricity and paper with silicon, but it is only correlated with a changing number.

WE perform the translation from this number to something else in the world. The person who reads the ink on the paper is the person who knows what X becoming X2 means as it pertains to you. The paper and ink do not mean anything alone, they are not you and share none of your properties.

When a chat bot says "hi" it is just a change to an LCD screen caused by an electrical fluctuation caused by a prior electrical fluctuation. It is just a new line of ink on the page.

There is nothing thinking, saying, speaking, understanding, "hi". It is just a change to some liquid crystal which fools you as you read it. YOU impart meaning on it when you look at it. It isnt a person, it's just ink.

The most ambitious we can be about machines is that they fool people into thinking they are having a conversation with someone. Ie., that paper shreds with ink phrases on them tumble out of a folder in just-the-right-order as-if a conversation was happening. But it's a tumbling of electric, there is no conversation.


> If I start by writing X down, then X2, then X3, etc. then the ink on the page describes you as a changing system.

> The ink isnt you. It isnt alive. It's ink.

> That is all a machine is. We have replaced ink with electricity and paper with silicon, but it is only correlated with a changing number.

Okay, good. Now here is the important part.

I am not making the claim that this machine is a real person.

I am making the claim that if you video-call the machine, it will produce lights and sounds that are identical to video calling a real person.

If the simulation is accurate, isn't that a straightforward consequence?

You keep saying that the machine won't be real AND that it will fail sophisticated cognition tests.

Those are not the same issue.

I'm not arguing that it's real. I'm arguing that it will pass every cognition test you can throw at it.

Is there a flew in my very short chain of logic?


There are tests to distinguish gold from silicon. And so there will be for however your machine works. I cannot say now what those test will be, any more than you can make such a machine.

Something not being the thing it is simulating entails there will be tests to distinguish it.

The tests cannot be "cognative" because there is no cognition going on.

A simulation of an animal does not live in the world, experience and understand it -- nor render the world intelligible to itself and others. A simulation of an animal is just a current flowing around a wire.

I would guess the tests will always, actually, be quite simple -- perhaps not expressible as a single conversation -- because somehow like a chess game it has every infinite sequence of conversations available to it.

Perhaps, in a novel social situation adapting to evolving minds as they respond to each other. Suppose this is recorded today: https://www.youtube.com/watch?v=99IitWYZ0aU#t=60s

and your machine is sat in the audience.

The question is then: "What does Kenneth think about the audience's laughter?"


> There are tests to distinguish gold from silicon. And so there will be for however your machine works.

Unless something was coded wrong, gold inside the simulation will give the same numbers as gold outside, so you can't tell which is which.

Let me be clear here. You don't touch the machine directly, you get the numbers the simulation spits out. The 'proof of concept' interaction is that you are on a video call with the atoms and photons inside the simulation. The video looks like a person, and your job is finding any difference between it and a video call with a real person.

> Something not being the thing it is simulating entails there will be tests to distinguish it.

That implies that the atoms and photons are being simulated incorrectly. Are you saying it's not possible to have an accurate simulation of atoms and photons?

> A simulation of an animal does not live in the world

The simulated atoms interact with a simulated cage, so they should give the same results despite being mere electricity.

> I would guess the tests will always, actually, be quite simple -- perhaps not expressible as a single conversation -- because somehow like a chess game it has every infinite sequence of conversations available to it.

> Perhaps, in a novel social situation adapting to evolving minds as they respond to each other.

> The question is then: "What does Kenneth think about the audience's laughter?"

The simulated atoms will change simulated orientation the same way real atoms would. If you look for physical evidence of learning you'll find the same molecules moving the same way. Why would the simulation fail this test?


> You don't touch the machine directly, you get the numbers the simulation spits out.

So you're restricting the use of this machine to a situation designed to fool human beings?

The criterion for general intelligence is actual intelligence, not putting it in ideal conditions and seeing if people are fooled.

> Why would the simulation fail this test?

It seems like you think this machine is going to simulate the entire universe, evolve its model of the universe and therefore perfectly predict its next state -- and on the basis of this prediction provide an answer.

Sure, perhaps I will concede: if you are able to simulate the universe in infinite detail you might be able to perfectly predict its next state.

This isnt any ambition of any one however. And has nothing to do with AI. If the precondition of AI is "a perfect simulation of everything", then that's close enough -- for me -- to call it impossible.

Even so, in this sense however, we do not " simulate gold " . What it means to "simulate gold" is to take some small number of aspects, model them with equations, and run those equations.

A video game that allowed you to perform mass-spectrometry on any possible compound, along with everything else you could possibly do to everything -- would I think, be a video game which requires a whole other universe to exist.

And so, it seems your argument is that "when scientists can model the universe in infinite detail so as to perfectly predict its next state, we will have AI!" (and, as far as the quantum state of brains go, it's close enough to inifinity to model all of that)..

OK, sure. I don't know how scientists are going to build a universe simulator without a "theory of everything" and how, even with such a theory, a machine can predict the next-state of a large system in sub-infinite times. Processing merely some particle collisions in the LHC takes months.

I cannot see how a machine is going to actually track the evolving entangled state of an audience of human beings.

"Infinitely precise information about the universe" I think actually requires you to actually be the universe. That's maybe a speculation however, but I would be surprised if the universe could be described in less volume than it occupies. And if an infinity of precision (ie., perfect parity in every simulated result) is actually possible without the target system.

A machine can only simulate what is known. The actual behaviour of the universe is much larger than what is known. As soon as we discover something new, then we have a test to prove the machine is a machine.


> The criterion for general intelligence is actual intelligence, not putting it in ideal conditions and seeing if people are fooled.

Having to do it across a wire is "ideal conditions"?

The initial comment was about "artificial general intelligence". Every single one of those problems can be done across a wire.

Every word that has ever been spoken, every gesture that has ever been made, you can do across a wire.

It's good enough to solve any practical problem in the world. It just won't be "real".

> It seems like you think this machine is going to simulate the entire universe, evolve its model of the universe and therefore perfectly predict its next state -- and on the basis of this prediction provide an answer.

No, it's going to simulate a tiny cubicle with a person inside.

I guess you could call it a simulated universe, but the universe is only two cubic meters.

> I cannot see how a machine is going to actually track the evolving entangled state of an audience of human beings.

Put cameras in the seat in the theater. One copy of the feed goes to a real person, the other goes to the machine. Both can track the evolving state of the audience fine. Neither one should be expected to perfectly simulate the rest of the audience.

> I would be surprised if the universe could be described in less volume than it occupies.

Don't worry, I don't expect the machine to be smaller than two cubic meters!

> A machine can only simulate what is known. The actual behaviour of the universe is much larger than what is known. As soon as we discover something new, then we have a test to prove the machine is a machine.

That's fair. So version 1.0 will have slightly-wrong physics. Do you think that will necessarily make the simulation go awry? Do you think we'll never know enough about physics to simulate a small box with a person in it?


> Do you think we'll never know enough about physics to simulate a small box with a person in it?

In the sense you mean simulation, ie., describe with all required detail some system -- we can barely simulate a few atoms let alone a room with a human being in it.

Im not sure this is even a question of knowing the physics. The problem is that even an atom has an infinite density of "descriptive information"... ie., in order to describe in toto we would be calculating forever.

This is not what any one in AI is even trying to do by the way. This isnt machine learning. This isn't AI.

I'm not convinced simulation in this depth will ever be achieved, I cannot imagine it could ever be performant. Every single causal interaction taking place over a second is an entire universe in itself. To have this second alone described in simulation is a vast undertaking, let alone a conversation.

Maybe I would agree that while this system would be "good enough", if it could predict an appropriate response by simulating a target human being to this depth... all the way down to how dopamine bonds to receptors in the frontal lobe, etc. -- then sure, I could see that it would be close enough.

However this isnt what anyone means when we say something is "simulated". They mean that it a single aspect alone is idealised into a single equation and treated under perfect conditions without any other factor being relevant, and then a calculation involving this equation is run.

People in AI are not even considering animal consciousness as being a relevant thing to simulate (even though that's what consciousness is). They think it is just a matter of some idealized formal structure.

If they realised that it would require an electronic system to calculate every descriptive quantity regarding every particle of some animal, computational general-AI research projects would be binned for the next millennia at least.

In the case of AI, no one is trying to "simulate a human being" in the sense you describe. They are trying to find an extremely simplified highly idealized equation to describe thinking.

They are trying to model intelligence as if the salient features of animal consciousness were not biological but equational. "Good Bye" follows "Hello" because insert program...

No, "Good Bye" follows "Hello" because people who speak english have lived a life of speaking it in which experiences have been acquired in response to the world ie., their brains have developed under sociolinguistic conditions: with light and sound bouncing off their bodies and the bodies of those around them such that their neurological structure as evolved to causally associate "hello" with akind of social circumstane and "goodbye" with likewise.

There is nothing apart from this connected social-neurological system that constitutes why "goodbye" follows "hello". That is how it comes to be. Any rule or system which appeals to an equation that isn't modelling this entire process to its full depth is just "accidentally correlated" with english-- and will be trivially easy to expose.

And so on for every aspect of consciousness.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: