Create an Account
username: password:
  MemeStreams Logo

MemeStreams Discussion


This page contains all of the posts and discussion on MemeStreams referencing the following web page: Getting around that nasty NYT registration thingy. You can find discussions on MemeStreams as you surf the web, even if you aren't a MemeStreams member, using the Threads Bookmarklet.

Getting around that nasty NYT registration thingy
by Acidus at 12:37 am EST, Feb 24, 2004

So I was talking with Decius the other day about the NYT. If you folks haven't noticed you can access NYT articles through google news without needing an account. Google simply adds a parameter "partner=google" to the end of the NYT URL. I figured Decius and I could could write a script that checks for recommended memes for NYT stories and insert this at the end, not allow for people without accounts to read stories.

However this is not what NYT checks for. If you go to a NYT article through a standard google search, the "partner=google" is not added to the URL, but you can still access the story So how does NYTs do this? With the "referer" field on a standard HTTP GET request.

So tonight I had an idea. WGET! it has a nice litte option "--referer=". Sure enough, you can grab NYT stories using WGET.

Thus to read for example the Theory-vs-reality story, using:


will save the login screen but

wget --referer=

will grab the page. Yes yes yes, I know, as Decius told me: "Just get a freaky account dude."

There is a redundant post from Shannon not displayed in this view.
Powered By Industrial Memetics