Re: [Bug-wget] Need help using --spider option

[Avinash]

wget -r -np -l0 -S --spider
http://172.20.241.206/HTTP_Share/performance_data/mixed/rtf/

--22:35:10--  http://172.20.241.206/HTTP_Share/performance_data/mixed/rtf/
           => `
172.20.241.206/HTTP_Share/performance_data/mixed/rtf/index.html'
Connecting to 172.20.241.206:80... connected.
HTTP request sent, awaiting response...
  HTTP/1.1 200 OK
  Content-Length: 3510
  Content-Type: text/html
  Server: Microsoft-IIS/6.0
  X-Powered-By: ASP.NET
  Date: Wed, 21 Jul 2010 22:31:22 GMT
  Connection: keep-alive
Length: 3,510 (3.4K) [text/html]
200 OK

172.20.241.206/HTTP_Share/performance_data/mixed/rtf/index.html: No such
file or directory

FINISHED --22:35:10--
Downloaded: 0 bytes in 0 files


See I am not able to recursively SPIDER through the URL.

Whereas if I remove --spider option, wget recursively downloads all files
referred by URL including index.html.

My requirement is to spider recursively through a given URL.

On Wed, Jul 21, 2010 at 7:04 PM, Giuseppe Scrivano <address@hidden>wrote:

> I couldn't reproduce this problem, can you please give me more
> information?
>
> Can you use the -d flag to wget and see what happens?
>
> Thanks,
> Giuseppe
>
>
>
> Avinash <address@hidden> writes:
>
> > Hi All,
> >
> > I am trying to use --spider option with an URL ending with '/'.
> > The error I am getting is, index.html not found.
> >
> > Whereas, when I remove the --spider option, I can see wget automatically
> > downloads index.html and rest of the files referenced by the same URL.
> >
> > Then, why can't wget automatically download index.html when --spider
> option
> > is specified ?
>



-- 
-Avinash