大量行的MySQLdb错误的executemany
作者:互联网
我目前正在运行一个脚本,使用execute many函数将值(元组列表)插入MySQL数据库.当我使用少量的行(`1000)时,脚本运行良好.
当我使用大约40,000行时,出现以下错误:
cursor.executemany( stmt, trans_frame)
Traceback (most recent call last):
File "C:\Python27\lib\site-packages\IPython\core\interactiveshell.py", line 2538, in run_code
exec code_obj in self.user_global_ns, self.user_ns
File "<ipython-input-1-66b44e71cf5a>", line 1, in <module>
cursor.executemany( stmt, trans_frame)
File "C:\Python27\lib\site-packages\MySQLdb\cursors.py", line 253, in executemany
r = self._query('\n'.join([query[:p], ',\n'.join(q), query[e:]]))
File "C:\Python27\lib\site-packages\MySQLdb\cursors.py", line 346, in _query
rowcount = self._do_query(q)
File "C:\Python27\lib\site-packages\MySQLdb\cursors.py", line 310, in _do_query
db.query(q)
OperationalError: (2006, 'MySQL server has gone away')
有什么建议么?
解决方法:
您可以尝试设置max_allowed_packet参数just for one session:
sql ='SET SESSION max_allowed_packet=500M'
cursor.execute(sql)
sql = ...
args = ...
cursor.executemany(sql, args)
如果这行得通,您可以将代码保持原样,或更改my.cnf文件(知道这可以解决executemany问题).
标签:executemany,python,mysql 来源: https://codeday.me/bug/20191031/1977516.html