Re: csplit reports No space left on device

[Rodolfo Aramayo]

The result of df -T is:
Type       1K-blocks       Used   Available Use% Mounted on
ext4        60782776   10993500    49772892  19% /
ext4     10401954720 4945781880  4931868456  51% /media/volume/sdb

I am able to create more files in the same directory and in any other
directory on that drive

And again, the result of the df -i is:

Inodes     IUsed     IFree      IUse%   Mounted on
  7741440    312627    7428813  5%      /
327680000  23300224  304379776  8%      /media/volume/sdb

I do not see any evidence of having run out of inodes on '/media/volume/sdb'
where the process was run
Unless csplit requires the 'root' partition inodes??

Thanks

Rodolfo


On Thu, Aug 18, 2022 at 11:41 AM Pádraig Brady <P@draigbrady.com> wrote:

> On 18/08/2022 16: 17, Rodolfo Aramayo wrote: > All right, this is what I
> did: > > First, I am running: > > Distributor ID: Ubuntu > Description:
> Ubuntu 20. 04. 4 LTS > Release: 20. 04 > Codename: focal > > Second,
> ZjQcmQRYFpfptBannerStart
> This Message Is From an External Sender
> This message came from outside your organization.
>
> ZjQcmQRYFpfptBannerEnd
>
> On 18/08/2022 16:17, Rodolfo Aramayo wrote:
> > All right, this is what I did:
> >
> > First, I am running:
> >
> > Distributor ID: Ubuntu
> > Description: Ubuntu 20.04.4 LTS
> > Release: 20.04
> > Codename: focal
> >
> > Second, I have:
> > Size  Used Avail Use% Mounted on
> > 58G   11G   48G  19% /
> > 9.7T  4.7T  4.6T  51% /media/volume/sdb
> >
> > Third, I have re-run the process using the following command:
> > strace -o zzSTRACE_Error.log csplit --keep-files --quiet 
> > --elide-empty-files --digits=12 --prefix=zz_ uniref50.xml /"<entry id="/ {*}
> >
> > Fourth, the file I am trying to split (uniref50.xml ) is 201G in size
> >
> > Fifth, the resulting directory, after the job failed, is 162G in size
> >
> > Sixth, the name of the last file written before Exit 1 was : zz_000017876562
> >
> > Last, the tail of the zzSTRACE_Error.log is printed below (the log is 8GB 
> > in size...)
>
> You didn't say what the file system type was (df -T).
> This would mainly help us minimize the possible issues
> (consider limits, quotas etc.).
>
> You didn't say whether you could create any more files in the directory
> after the csplit run.
>
> open() is returning ENOSPC, which at first glance seems like
> you might be running out of inodes.
>
> cheers,
> Pádraig
>
>

-- 
Dr. Rodolfo Aramayo, PhD
Faculty of Biology and Genetics
Department of Biology, Texas A&M University
PeerJ
PeerJ - the Journal of Life & Environmental Sciences
<https://peerj.com/> Academic
Editor peerj.com/RodolfoAramayo