‘According to Strong AI, the computer is not merely a tool in the study of the mind; rather, the appropriatelyprogrammed computer really is a mind…said to understand and have other cognitive states’.
Searle is here going to object to claims that an ‘appropriately programmed computer’ can have cognitive states and can explain human cognition by refering to Roger Schank’s projects.

‘One can describe Schank’s program as follows: The aim of the program is to simulate the human ability to understand stories. It is characteristic of human beings [that they can] answer questions about the story even though the information that they give was never explicitly stated in the story.
‘Schank’s machines can similarly answer questions… in this fashion. To do this they have a ‘representation’ of the sort of information that human beings have about restaurants…the machine will print out answers of the sort that we would expect human beings to give if told similar storis’.

Partisans of Strong AI claim that [in this situation] the machine…’can literally be said to understand the story…and…that what the machine and its program do explains the human ability to understand the story and answer questions about it’
Both claims to Searle seem ‘to be totally unsupported by Schank’s work’. (That is not to say that Schank himself is totally commited to these claims.)
‘One way to test any theory of the mind is to ask oneself what it would be like if my mind actually worked on the principles that the theory says all minds work on. Let us apply this test to the Schank program.’
…’Suppose I am locked in a room and given a large batch of Chinese writing…I know no Chinese…Now suppose that after this first batch of Chinese writing I am given a second batch together with a set of rules for correlating the second batch with the first batch…I can [now] identify the symbols entirely by their shapes. Now suppose also that I am given a third batch together with some instructions that enable me to correlate elements of this third batch with the first two batches.
…Unknown to me, the people who are giving me all these symbols call the first batch a ‘Script’, the second batch a ’story’ and the third batch ‘questions’. They call the symbols I give them back in response to the third batch ‘answers to the questions’ and the set of ruls in English that they gave me, they call the ‘program’.
…Nobody just looking at my answers can tell that I don’t speak a word of Chinese. As far as the Chinese is concerned, I simply behave like a computer’.

In light of the claims above…
1. ‘Quite obvious in the example that I do not understand a word of Chinese. I have inputs and outputs that are indistinguishable from those of the native Chinese speaker…I still understand nothing. For the same reasons, Schank’s computer understands nothing of any stories’
2. The claim that the program explains human understanding is false because the ‘the computer and its program do not provide sufficient conditions of understanding since the computer and the program are funtioning and there is no understanding’.
‘No reason whatever has been offered to suppose that such principles are necessary or even contributory, since no reason has been given to suppose that whe I understand english I am operating with any formal profram at all’.
Before looking at replies to this example, I ‘first want to block some common misundertandings about ”understanding”. There are clear cases in which ‘understanding’ literally applies, and clear cases in which it does not apply: and these two sorts of cases are all I need for this argument.
‘If the sense in which Schank’s programmed computers understand stories is supposed to be the metaphorical sense in which the door understands, and not the sense in which I understand English’.
‘Newell and Simon write that the kind of cognition they claim for computers is exactly the same as for human beings, and it is the sort of claim I will be considering’. ‘I will argue that in the literal sense the programmed computer understands what the car and the adding machine understand, namely, exactly nothing. The computer understanding is not just partial or incomplete; it is zero.’
Now to the replies:
1. The Systems Reply (Berkeley)- This reply is basically that, in the room example, ‘understanding is not be ascribed to the mere individual; rather it is being ascribed to this whole system of which he is part’
‘MY RESPONSE to the systems theory is quite simple:Let the individual internalize all of these elements of the system…We can even get rid of the room and suppose he works outdoors. All the same, he understands nothing of the Chinese, and a fortiori neither does the system, because there isn’t anything in the system that isn’t him. If he doesn’t unerstand, then there is no way the system could understand because the system is just a part of him.’
A counter to this could be that ”the man as a formal symbol manipulation system” really does understand Chinese.’ But, this can’t be true because ‘the Chinese subsystem knows only that ‘’squiggle squiggle” is followed by ‘’squoggle squoggle”. ‘The whole point of the original example was to argue that such symbol manipulation by itself couldn’t be sufficient for understanding Chinese in any literal sense
‘The only motivation for saying there must be a subsystem in me that understands Chinese is that I have a program and I can pass the Turing test; I can fool native Chinese speakers. But precisely one of the points at issue is the adequacy of the Turing test. The example shows that there could be two ‘’systems”, both of which pass the Turing test, but only one of which understands’.
Furthermore, the systems reply woud appear to lead to consequences that are independantly absurd…it looks like all sorts of noncognitive subsystems are going to turn out to be cognitive’ (ie. the heart, stomach etc). ‘If we accept the systems reply, then it is hard to see how we avoid saying [that these subsystems] are all understanding subsystems’.

‘If Strong AI is to be a branch of Psychology, then it must be able to distinguish those systems that are genuinely mental from those that are not… Anyone who thinks strong AI has a chance as a theory of the mind ought to ponder the implications of that remark’.
2. The Robot Reply (Yale)- This argument goes; ”Suppose we wrote a different kind of program from Schank’s program. Suppose we put a computer inside a robot. This computer would not just take formal symbols as input and give out formal symbols as output, but would operate in such a way that the robot does something very much like perceiving, walking, moving about- anything you like. All of this would be controlled by its computer ‘brain’. Such a robot would, unlike Schank’s computer, have genuine understanding and other mental states.”

REPLY- The addition of such ‘perceptual’ and ‘motor’ capacities adds nothing by way of understanding to Schank’s original program. The robot receives input via it’s ‘perceptual’ apparatus, and instructions are given to its ‘motor’ apparatus without the motor knowing any of these facts. All the robot does is follow formal instructions about manipulating formal symbols.
3. The Brain Simulator Reply (Berkeley and M.I.T)- This argument goes; ”Suppose we design a program that doesn’t represent information that we have about the world, but simulates the actual sequence of neuron firings at the synapses of the brain of a native Chinese speaker when he understands stories in Chinese and gives answers to them…Surely in such a case we would have to say that the machine understood the stories; and if we refuse to say that, wouldn’t we also have to deny that native Chinese speakers understood the stories?”
REPLY- I thought the whole idea of strong AI is that we don’t need to know how the brain works to know how the mind works…On the assumptios of strong AI, the mind is to the brain as the program is to the hardware, and thus we can understand the mind without doing neurophysiology. It we had to know how the brain worked to do AI, we wouldn’t do AI.
Even so, if we input into the man Chinese, fire neurons and consequently, the man replies in Chinese, this doesn’t mean he understands. Again, instructions are merely being followed.
4. The Combination Reply (Berkeley and Stanford)- This argument goes; ”While each of the previous three replies might not be completely convincing by itself, it you take all three, they are collectively more convincing. Imagine a robot with a brain shaped computer lodged in its cranial cavity, imagine the computer programmed with all the synapses of a human brain, imagine the whole behaviour of the robot is indistinguishable from human behaviour, and nw think of the whole thing as a unified system and not just a computer with inputs and outputs. Surely in such a case, we would have to ascribe intentionality to the system’
REPLY- ‘I agree that in such a case we would find it rational to accept that the robot had intentionality, as long as we knew nothing more about it’. ‘If we knew independantly how to account for its behavious without such assumptions we would not attribute intentionality to it, especially if we knew it had a formal program’.
‘We would regard the robot as an ingenious mechanical dummy. The hypothesis that the dummy has a mind would now be unwarranted and unnecessary…He doesn’t see what comes into the robot’s eyes, he doesn’t intend to move the robots arm, and he doesn’t understand any of the remarks made to or by the robot.
5. Other Minds Reply- ”How do you know that other people understand Chinese or anything else? Only by their behaviour. The computer can pass behavioural tests, so if you are going to attribute cognition to other people, you must in principle also attribute it to computers”
REPLY- This objection is only worth a short reply. It is not about how I know that other people have cognitive states, but rather what it is that I am attributing to them when I attribute cognitive states to them.
‘In cognitive sciences one presupposes the reality and knowability of the mental in the same way that in physical sciences one has to presuppose the reality and knowbility of physical objects’
6. The Many Mansions Reply (Berkeley)- ”Your whole argument presupposes that AI is only about analog and digital computers. But that just happens to be the present state of technology…eventually we will be able to build devices that have these causal processes, and that will be AI. So your arguments are in no way directed at the ability of AI to produce and explain cognition”
REPLY- I really have no objection to this reply save to say that it in effect trivializes the project of Strong AI by redefining it as whatever artificially produces and explains cognition
Back to the question:
‘There must be something about me that makes it the case that I understand English and a corresponding something lacking in me that makes it the case that I fail to understand Chinese. Now why couldn’t we give those somethings, whatever they are, to a machine?
The main point of the present argument is that no purely formal model will ever be sufficient by itself for intentionality because the formal properties are not by themselves constitutive of intentionality.
Mental states and events are literally a product of the operation of the brain, but the program is not in that way a product of the computer.
No one supposes that computer simulations of a rainstorm will leave us all drenched. Why on earth would anyone suppose that a computer simulation of understanding actually understand anything?
Unless you believe that the mind is separable from the brain both conceptually and empirically- dualism in a strong form- you cannot hope to reproduce the mental by writing and running programs since programs must be independant of brains. [So anyone that holds intentionality can be produced via a computer program, must therefore be a dualist- not a substance dualist- but a mind/body dualist].
‘Could a machine think? My own view is that only a machine could think…AI, by its own definition, is about programs, and programs are not machines’
THOUGHTS
Searle seems to have good arguments here. I agree with most of what he says. When we try to create intentionality in a program, something is missing. You cannot create consciousness this way. it’s like trying to make an omlette without any eggs.
Intentionality is a chemical-biological thing, that can only be replicated biologically, not mechanically.