::  Posts  ::  RSS  ::  ◂◂RSS  ::  Contact

See Raw Headers with Netcat

October 5th, 2015
tech  [html]
Getting response headers is easy: run curl -D- -o/dev/null -sS [url] or load the site in a browser with the networking tab open. Getting request headers is harder, because webservers don't have a way to dump this exactly as they received it. Yes, you can set them to log specific headers, but logging all headers exactly as they came over the wire isn't something I see in nginx or apache. Netcat can help here. Start it up on some unused port:
    nc -lp 8070
Now make the thing you're debugging visit yoursite:8070. Netcat will print out what headers you got:
    GET / HTTP/1.1
    Host: www.jefftk.com:8070
    Referer: http://www.jefftk.com/...
    Accept-Encoding: gzip,deflate
    Cache-Control: no-store, no-cache
    Accept-Language: en-US
    Connection: Keep-alive
    Accept: */*
    Accept-Encoding: gzip,deflate
    ...
See the duplicate Accept-Encoding header? It turned out that A was adding an extra encoding header which then made B disable gzip. [1] Once I had the raw headers as sent it was pretty clear what the problem was.

(Because the problem was a duplicated header I'm glad I didn't go with a higher level tool that might have masked that problem by storing headers in hashtable or something.)


[1] Sniffing the traffic would have been ideal, but I wasn't in a position to get in between them.

Comment via: google plus, facebook

Recent posts on blogs I like:

Assume Nordic Costs: London Edition

A month ago I made maps proposing some subway and regional rail extensions in New York and noting what they would cost if New York could build as cheaply as the Scandinavian capitals. Here is the same concept, but with London rather than New York. Here is…

via Pedestrian Observations June 25, 2019

Instead of “I’m anxious,” try “I feel threatened”

cw: teaching to learn I have a long history with anxiety, and I’m pretty good at noticing when it’s happening. The problem is that I’m always anxious. Noticing anxiety doesn’t snap me out of anxiety– in fact, it often produces meta-anxiety, anxiety about …

via Holly Elmore June 20, 2019

Checkmate on blackmail?

It has been argued that blackmail should be legal if gossip is legal, and even that there are no good consequentialist counterarguments (!). I think this isn’t obvious because the disclosures incentivized by blackmail are systematically worse than gossip.…

via The sideways view June 2, 2019

more     (via openring)

More Posts:


  ::  Posts  ::  RSS  ::  ◂◂RSS  ::  Contact