[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Lynx-dev] Viewing Dave's Trailer page with Lynx 2.8.7dev.5: error

From: Chuck Houpt
Subject: Re: [Lynx-dev] Viewing Dave's Trailer page with Lynx 2.8.7dev.5: error
Date: Thu, 16 Apr 2009 08:29:27 -0400

Hi Patrick,

It looks like the website is browser sniffing, and rejecting anything with 'libwww' or 'libcurl' in the User-Agent field. Here are some tests with curl that show the blocking of libwww/libcurl, but not 'foobar':

$ curl -A 'libwww' -I
HTTP/1.1 406 Not Acceptable

$ curl -A 'libcurl' -I
HTTP/1.1 406 Not Acceptable

$ curl -A 'foobar' -I
HTTP/1.1 200 OK

Possibly the site is trying to deter rogue robots and scrapers, but filtering based on the User-Agent field won't be very effective, since it is easily changed (for example from the Lynx options page).

Cheers - Chuck

On Apr 16, 2009, at 4:06 AM, Patrick Vervoorn wrote:


My apologies for sending this 'out of the blue', since I did not subscribe to the lynx-dev list.

However, I'm seeing a problem which is rather Lynx-specific, since viewing the same URL, on the same machine, but using Lynx, works rather ok.

The full story is in the email below which I sent to Dave, but since w3m works fine, I'm not sure it's a problem with the site...



---------- Forwarded message ----------
Date: Sun, 12 Apr 2009 17:01:51 +0200 (CEST)
From: Patrick Vervoorn <address@hidden>
To: address@hidden
Subject: Viewing Trailer page with Lynx: error

Hi there,

When I try to view your site after the latest move with Lynx, I invariably get the following error-message:

(This is when viewing both the main site at: but also happens when I try to view one of the sub-pages directly, like:

                                Not Acceptable

An appropriate representation of the requested resource / could not be
  found on this server.

Additionally, a 404 Not Found error was encountered while trying to use
  an ErrorDocument to handle the request.

When using something like w3m, it is displayed. Using a graphical browser like Firefox also works fine.

Is there anything you can do from your side to be able to view your Trailer page using Lynx?

Best regards,


Lynx-dev mailing list

reply via email to

[Prev in Thread] Current Thread [Next in Thread]