258

I'm trying to understand Python's approach to variable scope. In this example, why is f() able to alter the value of x, as perceived within main(), but not the value of n?

def f(n, x):
    n = 2
    x.append(4)
    print('In f():', n, x)

def main():
    n = 1
    x = [0,1,2,3]
    print('Before:', n, x)
    f(n, x)
    print('After: ', n, x)

main()

Output:

Before: 1 [0, 1, 2, 3]
In f(): 2 [0, 1, 2, 3, 4]
After:  1 [0, 1, 2, 3, 4]

See also:

3

13 Answers 13

300

Some answers contain the word "copy" in the context of a function call. I find it confusing.

Python doesn't copy objects you pass during a function call ever.

Function parameters are names. When you call a function, Python binds these parameters to whatever objects you pass (via names in a caller scope).

Objects can be mutable (like lists) or immutable (like integers and strings in Python). A mutable object you can change. You can't change a name, you just can bind it to another object.

Your example is not about scopes or namespaces, it is about naming and binding and mutability of an object in Python.

def f(n, x): # these `n`, `x` have nothing to do with `n` and `x` from main()
    n = 2    # put `n` label on `2` balloon
    x.append(4) # call `append` method of whatever object `x` is referring to.
    print('In f():', n, x)
    x = []   # put `x` label on `[]` ballon
    # x = [] has no effect on the original list that is passed into the function

Here are nice pictures on the difference between variables in other languages and names in Python.

19
  • 4
    This article helped me to understand the problem better and it suggests a workaround and some advanced uses: Default Parameter Values in Python
    – Gfy
    Jun 5, 2011 at 16:48
  • @Gfy, I've seen similar examples before but to me it doesn't describe a real-world situation. If you're modifying something that's passed in it doesn't make sense to give it a default. Aug 15, 2012 at 18:16
  • @MarkRansom, I think it does make sense if you want to provide optional output destination as in: def foo(x, l=None): l=l or []; l.append(x**2); return l[-1]. Aug 31, 2012 at 13:03
  • For the last line of Sebastian's code, it said "# the above has no effect on the original list ". But in my opinion, it only has no effect on "n", but changed the "x" in the main() function. Am I correct?
    – user17670
    Sep 26, 2015 at 20:55
  • 1
    @user17670: x = [] in f() has no effect on the list x in the main function. I've updated the comment, to make it more specific.
    – jfs
    Sep 27, 2015 at 2:33
27

You've got a number of answers already, and I broadly agree with J.F. Sebastian, but you might find this useful as a shortcut:

Any time you see varname =, you're creating a new name binding within the function's scope. Whatever value varname was bound to before is lost within this scope.

Any time you see varname.foo() you're calling a method on varname. The method may alter varname (e.g. list.append). varname (or, rather, the object that varname names) may exist in more than one scope, and since it's the same object, any changes will be visible in all scopes.

[note that the global keyword creates an exception to the first case]

0
19

f doesn't actually alter the value of x (which is always the same reference to an instance of a list). Rather, it alters the contents of this list.

In both cases, a copy of a reference is passed to the function. Inside the function,

  • n gets assigned a new value. Only the reference inside the function is modified, not the one outside it.
  • x does not get assigned a new value: neither the reference inside nor outside the function are modified. Instead, x’s value is modified.

Since both the x inside the function and outside it refer to the same value, both see the modification. By contrast, the n inside the function and outside it refer to different values after n was reassigned inside the function.

7
  • 8
    "copy" is misleading. Python doesn't have variables like C. All names in Python are references. You can't modify name, you just can bind it to another object, that's all. It only makes sense to talk about mutable and immutable object in Python not they are names.
    – jfs
    Feb 22, 2009 at 17:16
  • 1
    @J.F. Sebastian: Your statement is misleading at best. It is not useful to think of numbers as being references.
    – Pitarou
    Feb 22, 2009 at 17:33
  • 10
    @dysfunctor: numbers are references to immutable objects. If you'd rather think of them some other way, you have a bunch of odd special cases to explain. If you think of them as immutable, there are no special cases.
    – S.Lott
    Feb 22, 2009 at 17:37
  • 1
    @S.Lott: Regardless of what's going on under the hood, Guido van Rossum put a lot of effort into designing Python so that the programmer can thing of numbers as being just ... numbers.
    – Pitarou
    Feb 22, 2009 at 18:00
  • 1
    @J.F., the reference is copied.
    – habnabit
    Feb 22, 2009 at 18:02
10

I will rename variables to reduce confusion. n -> nf or nmain. x -> xf or xmain:

def f(nf, xf):
    nf = 2
    xf.append(4)
    print 'In f():', nf, xf

def main():
    nmain = 1
    xmain = [0,1,2,3]
    print 'Before:', nmain, xmain
    f(nmain, xmain)
    print 'After: ', nmain, xmain

main()

When you call the function f, the Python runtime makes a copy of xmain and assigns it to xf, and similarly assigns a copy of nmain to nf.

In the case of n, the value that is copied is 1.

In the case of x the value that is copied is not the literal list [0, 1, 2, 3]. It is a reference to that list. xf and xmain are pointing at the same list, so when you modify xf you are also modifying xmain.

If, however, you were to write something like:

    xf = ["foo", "bar"]
    xf.append(4)

you would find that xmain has not changed. This is because, in the line xf = ["foo", "bar"] you have change xf to point to a new list. Any changes you make to this new list will have no effects on the list that xmain still points to.

Hope that helps. :-)

3
  • 6
    "In the case of n, the value that is copied..." -- This is wrong, there is no copying done here (unless you count references). Instead, python uses 'names' which point to the actual objects. nf and xf point to nmain and xmain, until nf = 2, where the name nf is changed to point to 2. Numbers are immutable, lists are mutable. Apr 19, 2012 at 19:19
  • Why is n passed by value but x passed by reference (which your answer implies, non?)?
    – jtlz2
    May 6, 2022 at 11:35
  • 1
    @jtlz2 both are passed by reference. For n and nf at the start of f(), the reference is to the number 1, so writing nf = 2 means you are changing nf's reference to point to 2 instead of 1; n in main still points to 1. But the references for x and xf at the start of f() both point to the list [0,1,2,3], so writing xf.append(4) modifies the thing that both xf and x reference and x can also see the changed list, while writing xf = ['foo', 'bar'] modifies xf so that it now references a whole new list ['foo', 'bar'], and x in main still references the original list.
    – simpleuser
    Jul 18, 2022 at 3:34
8

If the functions are re-written with completely different variables and we call id on them, it then illustrates the point well. I didn't get this at first and read jfs' post with the great explanation, so I tried to understand/convince myself:

def f(y, z):
    y = 2
    z.append(4)
    print ('In f():             ', id(y), id(z))

def main():
    n = 1
    x = [0,1,2,3]
    print ('Before in main:', n, x,id(n),id(x))
    f(n, x)
    print ('After in main:', n, x,id(n),id(x))

main()
Before in main: 1 [0, 1, 2, 3]   94635800628352 139808499830024
In f():                          94635800628384 139808499830024
After in main: 1 [0, 1, 2, 3, 4] 94635800628352 139808499830024

z and x have the same id. Just different tags for the same underlying structure as the article says.

2
  • Ironically that link doesn't work for me
    – jtlz2
    May 6, 2022 at 11:36
  • Yeap - I suppose after a few years that could happen....
    – jouell
    May 6, 2022 at 21:42
3

It´s because a list is a mutable object. You´re not setting x to the value of [0,1,2,3], you´re defining a label to the object [0,1,2,3].

You should declare your function f() like this:

def f(n, x=None):
    if x is None:
        x = []
    ...
2
  • 4
    It has nothing to do with mutability. If you would do x = x + [4] instead of x.append(4), you'd see no change in the caller as well although a list is mutable. It has to do with if it is indeed mutated.
    – glglgl
    Aug 20, 2014 at 11:50
  • 1
    OTOH, if you do x += [4] then x is mutated, just like what happens with x.append(4), so the caller will see the change.
    – PM 2Ring
    Jan 9, 2017 at 8:00
3

My general understanding is that any object variable (such as a list or a dict, among others) can be modified through its functions. What I believe you are not able to do is reassign the parameter - i.e., assign it by reference within a callable function.

That is consistent with many other languages.

Run the following short script to see how it works:

def func1(x, l1):
    x = 5
    l1.append("nonsense")

y = 10
list1 = ["meaning"]
func1(y, list1)
print(y)
print(list1)
2
  • There is no such thing as an "object variable". Everything is an object in Python. Some objects expose mutator methods (i.e. they are mutable), others do not. Aug 11, 2020 at 10:20
  • Bro the output at the end is missing. What is the result?
    – chainstair
    Apr 16, 2021 at 12:26
2

n is an int (immutable), and a copy is passed to the function, so in the function you are changing the copy.

X is a list (mutable), and a copy of the pointer is passed o the function so x.append(4) changes the contents of the list. However, you you said x = [0,1,2,3,4] in your function, you would not change the contents of x in main().

4
  • 5
    Watch the "copy of the pointer" phrasing. Both places get references to the objects. n is a reference to an immutable object; x is a reference to a mutable object.
    – S.Lott
    Feb 22, 2009 at 17:38
  • 2
    The int is not copied. Mutability has nothing to do with how assignment works; what's relevant is that a list has a method that you can call to mutate it.
    – chepner
    Apr 8, 2022 at 17:04
  • @chepner Does int have no methods that can mutate it? I think you should write an answer as you seem to have a sense of what's going on and you only posted recently..! Doesn't mutability <-> methods that can be called to mutate a variable? What if the mutating method is not called?
    – jtlz2
    May 6, 2022 at 11:38
  • 1
    A mutable object is one that can be mutated. It doesn't mean every method mutates it. Assignment doesn't care about mutability; it's just assigns a name to an object.
    – chepner
    May 6, 2022 at 12:14
2

Python is copy by value of reference. An object occupies a field in memory, and a reference is associated with that object, but itself occupies a field in memory. And name/value is associated with a reference. In python function, it always copy the value of the reference, so in your code, n is copied to be a new name, when you assign that, it has a new space in caller stack. But for the list, the name also got copied, but it refer to the same memory(since you never assign the list a new value). That is a magic in python!

1
  • 1
    Why are lists and integers handled differently - mutability, or something else?
    – jtlz2
    May 6, 2022 at 11:37
1

When you are passing the command n = 2 inside the function, it finds a memory space and label it as 2. But if you call the method append, you are basically refrencing to location x (whatever the value is) and do some operation on that.

1

Python is a pure pass-by-value language if you think about it the right way. A python variable stores the location of an object in memory. The Python variable does not store the object itself. When you pass a variable to a function, you are passing a copy of the address of the object being pointed to by the variable.

Contrast these two functions

def foo(x):
    x[0] = 5

def goo(x):
    x = []

Now, when you type into the shell

>>> cow = [3,4,5]
>>> foo(cow)
>>> cow
[5,4,5]

Compare this to goo.

>>> cow = [3,4,5]
>>> goo(cow)
>>> goo
[3,4,5]

In the first case, we pass a copy the address of cow to foo and foo modified the state of the object residing there. The object gets modified.

In the second case you pass a copy of the address of cow to goo. Then goo proceeds to change that copy. Effect: none.

I call this the pink house principle. If you make a copy of your address and tell a painter to paint the house at that address pink, you will wind up with a pink house. If you give the painter a copy of your address and tell him to change it to a new address, the address of your house does not change.

The explanation eliminates a lot of confusion. Python passes the addresses variables store by value.

2
  • 2
    A pure pass by pointer value is not very different from a pass by reference if you think about it the right way...
    – galinette
    May 19, 2014 at 14:09
  • Look at goo. Were you pure pass by reference, it would have changed its argument. No, Python is not a pure pass-by-reference language. It passes references by value. May 19, 2014 at 23:17
0

As jouell said. It's a matter of what points to what and i'd add that it's also a matter of the difference between what = does and what the .append method does.

  1. When you define n and x in main, you tell them to point at 2 objects, namely 1 and [1,2,3]. That is what = does : it tells what your variable should point to.

  2. When you call the function f(n,x), you tell two new local variables nf and xf to point at the same two objects as n and x.

  3. When you use "something"="anything_new", you change what "something" points to. When you use .append, you change the object itself.

  4. Somehow, even though you gave them the same names, n in the main() and the n in f() are not the same entity, they only originally point to the same object (same goes for x actually). A change to what one of them points to won't affect the other. However, if you instead make a change to the object itself, that will affect both variables as they both point to this same, now modified, object.

Lets illustrate the difference between the method .append and the = without defining a new function :

compare

    m = [1,2,3]
    n = m   # this tells n to point at the same object as m does at the moment
    m = [1,2,3,4] # writing m = m + [4] would also do the same
    print('n = ', n,'m = ',m)

to

    m = [1,2,3]
    n = m
    m.append(4)
    print('n = ', n,'m = ',m)

In the first code, it will print n = [1, 2, 3] m = [1, 2, 3, 4], since in the 3rd line, you didnt change the object [1,2,3], but rather you told m to point to a new, different, object (using '='), while n still pointed at the original object.

In the second code, it will print n = [1, 2, 3, 4] m = [1, 2, 3, 4]. This is because here both m and n still point to the same object throughout the code, but you modified the object itself (that m is pointing to) using the .append method... Note that the result of the second code will be the same regardless of wether you write m.append(4) or n.append(4) on the 3rd line.

Once you understand that, the only confusion that remains is really to understand that, as I said, the n and x inside your f() function and the ones in your main() are NOT the same, they only initially point to the same object when you call f().

-2

Please allow me to edit again. These concepts are my experience from learning python by try error and internet, mostly stackoverflow. There are mistakes and there are helps.

Python variables use references, I think reference as relation links from name, memory adress and value.

When we do B = A, we actually create a nickname of A, and now the A has 2 names, A and B. When we call B, we actually are calling the A. we create a ink to the value of other variable, instead of create a new same value, this is what we call reference. And this thought would lead to 2 porblems.

when we do

A = [1]
B = A   # Now B is an alias of A

A.append(2)  # Now the value of A had been changes
print(B)
>>> [1, 2]  
# B is still an alias of A
# Which means when we call B, the real name we are calling is A

# When we do something to B,  the real name of our object is A
B.append(3)
print(A)
>>> [1, 2, 3]

This is what happens when we pass arguments to functions

def test(B):
    print('My name is B')
    print(f'My value is {B}') 
    print(' I am just a nickname,  My real name is A')
    B.append(2)


A = [1]
test(A) 
print(A)
>>> [1, 2]

We pass A as an argument of a function, but the name of this argument in that function is B. Same one with different names.
So when we do B.append, we are doing A.append When we pass an argument to a function, we are not passing a variable , we are passing an alias.

And here comes the 2 problems.

  1. the equal sign always creates a new name
A = [1]
B = A
B.append(2)
A = A[0]  # Now the A is a brand new name, and has nothing todo with the old A from now on.

B.append(3)
print(A)
>>> 1
# the relation of A and B is removed when we assign the name A to something else
# Now B is a independent variable of hisown.

the Equal sign is a statesment of clear brand new name,

this was the concused part of mine

 A = [1, 2, 3]

# No equal sign, we are working on the origial object,
A.append(4)
>>> [1, 2, 3, 4]

# This would create a new A
A = A + [4]  
>>> [1, 2, 3, 4]

and the function

def test(B):
    B = [1, 2, 3]   # B is a new name now, not an alias of A anymore
    B.append(4)  # so this operation won't effect A
    
A = [1, 2, 3]
test(A)
print(A)
>>> [1, 2, 3]

# ---------------------------

def test(B):
    B.append(4)  # B is a nickname of A, we are doing A
    
A = [1, 2, 3]
test(A)
print(A)
>>> [1, 2, 3, 4]

the first problem is

  1. the left side of and equation is always a brand new name, new variable,

  2. unless the right side is a name, like B = A, this create an alias only

The second problem, there are something would never be changed, we cannot modify the original, can only create a new one.

This is what we call immutable.

When we do A= 123 , we create a dict which contains name, value, and adress.

When we do B = A, we copy the adress and value from A to B, all operation to B effect the same adress of the value of A.

When it comes to string, numbers, and tuple. the pair of value and adress could never be change. When we put a str to some adress, it was locked right away, the result of all modifications would be put into other adress.

A = 'string' would create a protected value and adess to storage the string 'string' . Currently, there is no built-in functions or method cound modify a string with the syntax like list.append, because this code modify the original value of a adress.

the value and adress of a string, a number, or a tuple is protected, locked, immutable.

All we can work on a string is by the syntax of A = B.method , we have to create a new name to storage the new string value.

please extend this discussion if you still get confused. this discussion help me to figure out mutable / immutable / refetence / argument / variable / name once for all, hopely this could do some help to someone too.

##############################

had modified my answer tons of times and realized i don't have to say anything, python had explained itself already.

a = 'string'
a.replace('t', '_')
print(a)
>>> 'string'

a = a.replace('t', '_')
print(a)
>>> 's_ring'

b = 100
b + 1
print(b)
>>> 100

b = b + 1
print(b)
>>> 101

def test_id(arg):
    c = id(arg)
    arg = 123
    d = id(arg)
    return

a = 'test ids'
b = id(a)
test_id(a)
e = id(a)

# b = c  = e != d
# this function do change original value
del change_like_mutable(arg):
    arg.append(1)
    arg.insert(0, 9)
    arg.remove(2)
    return
 
test_1 = [1, 2, 3]
change_like_mutable(test_1)



# this function doesn't 
def wont_change_like_str(arg):
     arg = [1, 2, 3]
     return


test_2 = [1, 1, 1]
wont_change_like_str(test_2)
print("Doesn't change like a imutable", test_2)

This devil is not the reference / value / mutable or not / instance, name space or variable / list or str, IT IS THE SYNTAX, EQUAL SIGN.

1
  • 1
    Maybe you can understand what is happening just seeing the code, but not why, and @FMc wants to understand why, not what.
    – DonLarry
    Aug 8, 2021 at 16:07

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.