• Posts
  • RSS
  • ◂◂RSS
  • Contact

  • See Raw Headers with Netcat

    October 5th, 2015
    tech
    Getting response headers is easy: run curl -D- -o/dev/null -sS [url] or load the site in a browser with the networking tab open. Getting request headers is harder, because webservers don't have a way to dump this exactly as they received it. Yes, you can set them to log specific headers, but logging all headers exactly as they came over the wire isn't something I see in nginx or apache. Netcat can help here. Start it up on some unused port:
        nc -lp 8070
    
    Now make the thing you're debugging visit yoursite:8070. Netcat will print out what headers you got:
        GET / HTTP/1.1
        Host: www.jefftk.com:8070
        Referer: http://www.jefftk.com/...
        Accept-Encoding: gzip,deflate
        Cache-Control: no-store, no-cache
        Accept-Language: en-US
        Connection: Keep-alive
        Accept: */*
        Accept-Encoding: gzip,deflate
        ...
    
    See the duplicate Accept-Encoding header? It turned out that A was adding an extra encoding header which then made B disable gzip. [1] Once I had the raw headers as sent it was pretty clear what the problem was.

    (Because the problem was a duplicated header I'm glad I didn't go with a higher level tool that might have masked that problem by storing headers in hashtable or something.)


    [1] Sniffing the traffic would have been ideal, but I wasn't in a position to get in between them.

    Comment via: google plus, facebook

    Recent posts on blogs I like:

    Be less scared of overconfidence

    deferring to markets • deferring to experts • deferring to low-information heuristics • why they fail • blindness to outliers • what to do instead

    via benkuhn.net November 30, 2022

    Corncob Dolls

    I went to a farm and at the farm I got to see a corncrib and the corn that had fell out of the corncrib that no one wanted I got to use my fingers to take off the corn kernels and once the cobs were empty I put them in a bag and then once I got back to the…

    via Anna Wise's Blog Posts November 7, 2022

    Light Switch

    When I got my loft bed it was just so annoying every morning to have to get out of bed, climb down the ladder, turn the light on, and climb back up, just so I could see stuff. I decided to make a string for my light switch because I really wanted to be abl…

    via Lily Wise's Blog Posts November 7, 2022

    more     (via openring)


  • Posts
  • RSS
  • ◂◂RSS
  • Contact