[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
lynx-dev Traversal Problem!
From: |
Jeff Crane |
Subject: |
lynx-dev Traversal Problem! |
Date: |
Wed, 16 Feb 2000 07:42:24 -0800 (PST) |
Reading from CRAWL.announce in lynx/docs...
TRAVERSE_FILE (traverse.dat):
Contains a list of all URLs that
were traversed. Note
that if a URL appears in this file
it will not be
traversed again (important if runs
are started and
stopped). Placing an entry in this
file BEFORE the
run will block traversal of that
URL. Unlike reject.dat
a final * has no effect (see below).
Note that Lynx
internal client-side image MAP URLs
will be included in
this file (e.g.,
LYNXIMGMAP:http://server/foo.html#map1),
in addition to the "real" (external)
http URLs.
but when I run...
lynx -error_file=lynx.err -anonymous -cookies
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/
I find my traverse.dat to look like this (note the
last 3 entries ARE IDENTICAL)...
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/S_S__Leopoldville/
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/S_S__Leopoldville/
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/S_S__Leopoldville/
... this entry repeats forever and ever...
HOW/why does this loop occur? Or, simply, how can I
prevent it from trying to hit this link over n over n
over...ad nauseum?
__________________________________________________
Do You Yahoo!?
Talk to your friends online with Yahoo! Messenger.
http://im.yahoo.com
- lynx-dev Traversal Problem!,
Jeff Crane <=