Re: csplit reports No space left on device

[✓ Paul Courbis de Bridiers de Villemor]

I think you should double check
Splitting a 200 GB xml file on the entry keyword will generate a lot of
files. Dis tou estimate how many and compare it to the free inodes number ?
Regards

Le mer. 17 août 2022 à 19:07, Rodolfo Aramayo <raramayo@tamu.edu> a écrit :

> Yes I did and I have plenty. I have plenty of disk space and inodes on the
> machine
>
> On Wed, Aug 17, 2022 at 12:00 PM ✓ Paul Courbis de Bridiers de Villemor <
> paul@courbis.fr> wrote:
>
>> Hi Did you check if you had enough free inodes on the partition ? df -i
>> Regarfs Le mer. 17 août 2022 à 18: 56, Rodolfo Aramayo via GNU coreutils
>> General Discussion <coreutils@ gnu. org> a écrit : Dear Coreutils
>> Maintainers, ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍
>> ZjQcmQRYFpfptBannerStart
>> This Message Is From an External Sender
>> This message came from outside your organization.
>>
>> ZjQcmQRYFpfptBannerEnd
>> Hi
>>
>> Did you check if you had enough free inodes on the partition ?
>> df -i
>>
>> Regarfs
>>
>> Le mer. 17 août 2022 à 18:56, Rodolfo Aramayo via GNU coreutils General
>> Discussion <coreutils@gnu.org> a écrit :
>>
>>> Dear Coreutils Maintainers,
>>>
>>> First, thank you for your work. I use coreutils daily both for my
>>> research
>>> and teaching. It is a great set of tools.
>>>
>>> Second, I have recently run into an "No space left on device" error when
>>> attempting to csplit a 200GB xml file.
>>>
>>> The command I am using is:
>>>
>>> csplit --quiet --elide-empty-files --digits=12 --prefix=zz_
>>> 00_founder_file
>>> /"<entry id="/ {*};
>>>
>>> I should say that this command works like a charm with 2GB and with 20GB
>>> test files, but when scaled to the target file (200GB), csplit reports
>>> the
>>> error and stops there, despite the fact that I have plenty of disk space
>>> and memory available on the machine.
>>>
>>> I should also say that I am running this process on an Ubuntu machine
>>> (default ulimit parameters):
>>>
>>> Linux digitalbiology01 5.15.0-46-generic #49~20.04.1-Ubuntu SMP Thu Aug 4
>>> 19:15:44 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
>>>
>>> I am using: csplit (GNU coreutils) 8.30
>>>
>>> Any advice/comments on how to proceed will be gratefully appreciated
>>>
>>> Rodolfo
>>>
>>> --
>>> Dr. Rodolfo Aramayo, PhD
>>> Faculty of Biology and Genetics
>>> Department of Biology, Texas A&M University
>>> PeerJ
>>> PeerJ - the Journal of Life & Environmental Sciences
>>> <https://peerj.com/
>>> <https://urldefense.com/v3/__https://peerj.com/__;!!KwNVnqRv!ArufV4UYUW0G6m8fx8_OW4QHK_XhstRVdUC9C7dKNBBXQHLOqrjSoF8-GZ5T4tE0GzKTkSq4UOEtPOg$>>
>>> Academic
>>> Editor peerj.com/RodolfoAramayo
>>> <https://urldefense.com/v3/__http://peerj.com/RodolfoAramayo__;!!KwNVnqRv!ArufV4UYUW0G6m8fx8_OW4QHK_XhstRVdUC9C7dKNBBXQHLOqrjSoF8-GZ5T4tE0GzKTkSq4SQpa-O8$>
>>>
>> --
>>
> --
>> Paul Courbis de Bridiers de Villemor
>>
>
>
> --
> Dr. Rodolfo Aramayo, PhD
> Faculty of Biology and Genetics
> Department of Biology, Texas A&M University
> PeerJ
> PeerJ - the Journal of Life & Environmental Sciences <https://peerj.com/> 
> Academic
> Editor peerj.com/RodolfoAramayo
>
-- 
-- 
Paul Courbis de Bridiers de Villemor