• Posts
  • RSS
  • ◂◂RSS
  • Contact

  • See Raw Headers with Netcat

    October 5th, 2015
    tech  [html]
    Getting response headers is easy: run curl -D- -o/dev/null -sS [url] or load the site in a browser with the networking tab open. Getting request headers is harder, because webservers don't have a way to dump this exactly as they received it. Yes, you can set them to log specific headers, but logging all headers exactly as they came over the wire isn't something I see in nginx or apache. Netcat can help here. Start it up on some unused port:
        nc -lp 8070
    
    Now make the thing you're debugging visit yoursite:8070. Netcat will print out what headers you got:
        GET / HTTP/1.1
        Host: www.jefftk.com:8070
        Referer: http://www.jefftk.com/...
        Accept-Encoding: gzip,deflate
        Cache-Control: no-store, no-cache
        Accept-Language: en-US
        Connection: Keep-alive
        Accept: */*
        Accept-Encoding: gzip,deflate
        ...
    
    See the duplicate Accept-Encoding header? It turned out that A was adding an extra encoding header which then made B disable gzip. [1] Once I had the raw headers as sent it was pretty clear what the problem was.

    (Because the problem was a duplicated header I'm glad I didn't go with a higher level tool that might have masked that problem by storing headers in hashtable or something.)


    [1] Sniffing the traffic would have been ideal, but I wasn't in a position to get in between them.

    Comment via: google plus, facebook

    Recent posts on blogs I like:

    What I've been doing instead of writing

    I’ve been too busy with work to write much recently, but in lieu of that, here’s a batch of links to other stuff I’ve been doing elsewhere. The thing I’m most excited about: Wave raises $200m from Sequoia, Stripe, Founders Fund and Ribbit at a $1.7b valuati…

    via benkuhn.net September 11, 2021

    Some reasons to measure

    A question I get asked with some frequency is: why bother measuring X, why not build something instead? More bluntly, in a recent conversation with a newsletter author, his comment on some future measurement projects I wanted to do (in the same vein as ot…

    via Posts on Dan Luu August 27, 2021

    Songs about terrible relationships

    [Spoilers for several old musicals.] TV Tropes lists dozens of examples of the “I want” song (where the hero of a musical sings about their dream of escaping their small surroundings). After watching a bunch of musicals on maternity leave, I’m wondering h…

    via The whole sky July 17, 2021

    more     (via openring)


  • Posts
  • RSS
  • ◂◂RSS
  • Contact