Skip to content
Advertisement

Python MemoryError: Unable to allocate 10.8 TiB for an array with shape () and data type int64

I am trying to combine two data sets. Using codes as follows

JavaScript

It returns with error:

MemoryError: Unable to allocate 10.8 TiB for an array with shape (1483050607760,) and data type int64

How can I solve this if my laptop is a 500GB+8GB one? Thank you in advance.

Advertisement

Answer

try dask then you can convert it to pandas if you want to on other machine

JavaScript
User contributions licensed under: CC BY-SA
2 People found this is helpful
Advertisement