Matlab unable to parse a Numeric field when I use the gather function on a tall array.
So I have a CSV file with a large amount of datapoints that I want to perform a particular algorithm on. So I created a tall array from the file and wanted to import a small chunk of the data at a time. However, when I tried to use gather to get the small chunk into the memory, I get the following error.
"Board_Ai0" is the header of the CSV file. It is not in present in row 15355 as can be seen below where I opened the csv file in MATLAB’s import tool.
The same algorithm works perfectly fine when I don’t use tall array but instead import the whole file into the memory. However, I have other larger CSV files that I also want to analyze but won’t fit in memory.
UPDATE: So apparently the images were illegible but someone else edited the question to make the size of the image larger so I guess it should be fine now. Also I can’t attach the data files to this question because the data files that give me this problems are all larger than 5 GB.So I have a CSV file with a large amount of datapoints that I want to perform a particular algorithm on. So I created a tall array from the file and wanted to import a small chunk of the data at a time. However, when I tried to use gather to get the small chunk into the memory, I get the following error.
"Board_Ai0" is the header of the CSV file. It is not in present in row 15355 as can be seen below where I opened the csv file in MATLAB’s import tool.
The same algorithm works perfectly fine when I don’t use tall array but instead import the whole file into the memory. However, I have other larger CSV files that I also want to analyze but won’t fit in memory.
UPDATE: So apparently the images were illegible but someone else edited the question to make the size of the image larger so I guess it should be fine now. Also I can’t attach the data files to this question because the data files that give me this problems are all larger than 5 GB. So I have a CSV file with a large amount of datapoints that I want to perform a particular algorithm on. So I created a tall array from the file and wanted to import a small chunk of the data at a time. However, when I tried to use gather to get the small chunk into the memory, I get the following error.
"Board_Ai0" is the header of the CSV file. It is not in present in row 15355 as can be seen below where I opened the csv file in MATLAB’s import tool.
The same algorithm works perfectly fine when I don’t use tall array but instead import the whole file into the memory. However, I have other larger CSV files that I also want to analyze but won’t fit in memory.
UPDATE: So apparently the images were illegible but someone else edited the question to make the size of the image larger so I guess it should be fine now. Also I can’t attach the data files to this question because the data files that give me this problems are all larger than 5 GB. tall, gather MATLAB Answers — New Questions









