sqlalchemy flush() and get inserted id?
PythonSqlalchemyPython Problem Overview
I want to do something like this:
f = Foo(bar='x')
session.add(f)
session.flush()
# do additional queries using f.id before commit()
print f.id # should be not None
session.commit()
But f.id
is None
when I try it. How can I get this to work?
Python Solutions
Solution 1 - Python
I've just run across the same problem, and after testing I have found that NONE of these answers are sufficient.
Currently, or as of sqlalchemy .6+, there is a very simple solution (I don't know if this exists in prior version, though I imagine it does):
session.refresh()
So, your code would look something like this:
f = Foo(bar=x)
session.add(f)
session.flush()
# At this point, the object f has been pushed to the DB,
# and has been automatically assigned a unique primary key id
f.id
# is None
session.refresh(f)
# refresh updates given object in the session with its state in the DB
# (and can also only refresh certain attributes - search for documentation)
f.id
# is the automatically assigned primary key ID given in the database.
That's how to do it.
Solution 2 - Python
Your sample code should have worked as it is. SQLAlchemy should be providing a value for f.id
, assuming its an autogenerating primary-key column. Primary-key attributes are populated immediately within the flush()
process as they are generated, and no call to commit()
should be required. So the answer here lies in one or more of the following:
- The details of your mapping
- If there are any odd quirks of the backend in use (such as, SQLite doesn't generate integer values for a composite primary key)
- What the emitted SQL says when you turn on echo
Solution 3 - Python
Thanks for everybody. I solved my problem by modifying the column mapping. For me, autoincrement=True
is required.
origin:
id = Column('ID', Integer, primary_key=True, nullable=False)
after modified:
id = Column('ID', Integer, primary_key=True, autoincrement=True, nullable=True)
then
session.flush()
print(f.id)
is ok!
Solution 4 - Python
unlike the answer given by dpb, a refresh is not necessary. once you flush, you can access the id field, sqlalchemy automatically refreshes the id which is auto generated at the backend
I encountered this problem and figured the exact reason after some investigation, my model was created with id as integerfield and in my form the id was represented with hiddenfield( since i did not wanted to show the id in my form). The hidden field is by default represented as a text. once I changed the form to integerfield with widget=hiddenInput()) the problem was solved.
Solution 5 - Python
The core solution has been mentioned in other much older answers, but this uses newer async API.
with sqlalchemy==1.4 (2.0 style), following seems to work:
from sqlalchemy.ext.asyncio import AsyncSession
from sqlalchemy.ext.asyncio import create_async_engine
engine = create_async_engine(
"postgresql+asyncpg://user:pass@localhost/db",
echo=False,
)
# expire_on_commit=False will prevent attributes from being expired
# after commit.
async_session = sessionmaker(
engine, expire_on_commit=False, class_=AsyncSession,
)
# default kwarg autoflush=True
async with async_session() as session:
async with session.begin():
f = Foo(bar='x')
session.add(f)
print(f.id)
# None
await session.flush()
print(f.id)
# not None
# commits transaction, closes session
Solution 6 - Python
I once had a problem with having assigned 0
to id before calling session.add
method. The id was correctly assigned by the database but the correct id was not retrieved from the session after session.flush()
.
Solution 7 - Python
my code works like that:
f = Foo(bar="blabla")
session.add(f)
session.flush()
session.refresh(f, attribute_names=[columns name that you want retrieve]
# so now you can access the id inserted, for example
return f.id # id inserted will be returned
Solution 8 - Python
You should try using session.save_or_update(f)
instead of session.add(f)
.