RE: [Bug-wget] using wget to mirror based on filesize only not timestamp

[Tim Lam]

The ftp server is actually a data logger which has a Compact Flash card and an 
ftp style structure.

When I download the files they look like this:

Name                    Size    Type            Date Modified
01-00001.NDF    19kb    NDF File        1/11/2010 12:00AM
02-00001.NDF    19kb    NDF File        2/11/2010 12:00AM
03-00001.NDF    5kb     NDF File        3/11/2010 12:00AM

As data is written to the file eg. 03-00001.NDF the file size grows throughout 
the day reach a size of 19kb but the "Date Modified" date remains at when it 
was created 3/11/2010 12:00AM

I have used wget -m
Wget -r with various options but I can't seem to get it right

My other option I though of is if I can't get it to work is to delete the 
latest file in the folder each day.

I plan to run wget everyday to update this folder.

I am using wget-1.11.4-1 runnings from windows command prompt (I've been having 
trouble using cygwin to run a batch file without it automatically opening up 
command prompt- and not working)

Hope someone can help.

Tim

-----Original Message-----
From: Giuseppe Scrivano [mailto:address@hidden 
Sent: Friday, 19 November 2010 7:15 AM
To: Tim Lam
Cc: address@hidden
Subject: Re: [Bug-wget] using wget to mirror based on filesize only not 
timestamp

Hello,

the filesize should be considered as well.  Can you please give us more
information about the ftp server and the wget version you are using?

Thanks,
Giuseppe



Tim Lam <address@hidden> writes:

> Is there a way I can make wget retrieve the file based purely on filesize and 
> not on timestamp.
>
> I've tried all sorts of commands in addition to wget -m
>
> The ftp site I want to access creates a new file everyday and gradually 
> updates that file throughout the day (increasing in filesize)
>
> Unfortunately the timestamp on the file is set to when the file was created, 
> not modified
>
> Hence whenever I use wget to mirror it see's a file that is say 6kb and 
> downloads its
>
> The next day it will see the same file and won't "redownload" the
> complete file but just skips over it, even though the file is now 19kb
> but the same timestamp.
>
> Hope someone can help
>
> Tim