Parsing HTTP response String / Buffer

Question

I'm trying to parse an HTTP response in the form of a String or Buffer into an Object.

The result would be an Object like the native http module's response.

I tried to import the native HTTP parser, but the results were too raw for my use-case :

var HTTPParser = process.binding('http_parser').HTTPParser;

var parser = new HTTPParser(HTTPParser.RESPONSE);

parser.onHeadersComplete = function(res) {
    console.log('onHeadersComplete');
    console.log(res);
};

parser.execute(data, 0, data.length);

which would return something like this :

onHeadersComplete
{
   headers: 
   [ 'X-Powered-By',
     'Express',
     'Content-Type',
     'text/plain',
     'Content-Length',
     '2',
     'Date',
     'Sat, 19 Apr 2014 20:16:45 GMT',
     'Connection',
     'keep-alive' ],
  statusCode: 200,
  versionMajor: 1,
  versionMinor: 1,
  shouldKeepAlive: true,
  upgrade: false 
}

Two things are lacking for my use-case :

map of header names associated with header values
parsing the response body
- Does anyone know how to achieve this ?

Thank you in advance for your help !

Because I'm writing a fuzzer which uses Node.js's net module to send mis-constructed HTTP requests to test HTTP servers. — m_vdbeek
– m_vdbeek, Commented Apr 20, 2014 at 8:35

Eric · Accepted Answer · 2015-05-12 02:08:15Z

4

You have to fill all the callbacks.

var HTTPParser = require('http-parser-js').HTTPParser;
var parser = new HTTPParser(HTTPParser.RESPONSE);
parser.onHeadersComplete = function(res) {
    console.log(res.headers);
};
parser.onBody = function(chunk, offset, length) {
    console.log("body", chunk.toString(), offset, length)
}
parser.onMessageComplete = function() {

}
parser.execute(new Buffer('HTTP/1.1 200 OK\r\nContent-Type: text/plain; xya\r\nContent-Length: 11\r\n\r\nhello world'))

answered May 12, 2015 at 2:08

Eric

1,1031 gold badge9 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Fr0sT · Accepted Answer · 2017-02-02 15:39:12Z

For headers transform you can use private method http.IncomingMessage(socket)._addHeaderLines(headersArr, headersNumber)

var msg=new http.IncomingMessage()

msg._addHeaderLines(['X-Powered-By',
     'Express',
     'Content-Type',
     'text/plain',
     'Content-Length',
     '2',
     'Date',
     'Sat, 19 Apr 2014 20:16:45 GMT',
     'Connection',
     'keep-alive' ], 10);
console.log(msg);

Result:

IncomingMessage {
  ...
  headers:
   { 'x-powered-by': 'Express',
     'content-type': 'text/plain',
     'content-length': '2',
     date: 'Sat, 19 Apr 2014 20:16:45 GMT',
     connection: 'keep-alive' },
  rawHeaders:
   [ 'X-Powered-By',
     'Express',
     'Content-Type',
     'text/plain',
     'Content-Length',
     '2',
     'Date',
     'Sat, 19 Apr 2014 20:16:45 GMT',
     'Connection',
     'keep-alive' ],
  ...
 }

Usage sample from Node sources: https://github.com/nodejs/node/blob/master/lib/_http_common.js

Alvin · Accepted Answer · 2014-08-03 06:26:48Z

-1

I'm also trying to study node.js and I just started yesterday. Since it's a javascript thing, here's my suggested solution.

I assume the object being parsed here is 'res' argument.

var headers = {};
for (index = 0; index < res.headers.length; index++) {
    headers[res.headers[index].replace('-', '')] = res.headers[++index];
}

// or this
for (index = 0; index < res.headers.length; index+=2) {
    var headerName = res.headers[index].replace('-', '');
    headers[headerName] = res.headers[index + 1];
}

// Note that we removed the '-' in the name since it's an invalid character for property name.

// Access sample.
console.log(headers.ContentType);
console.log(headers['ContentType']);

I hope it helped you out.

answered Aug 3, 2014 at 6:26

Alvin

1

1 Comment

m_vdbeek Over a year ago

Sorry, but I'm not trying to remodel the Express objects. What I want to do is parse HTTP protocol "packets" from a TCP stream result buffer.

Collectives™ on Stack Overflow

Parsing HTTP response String / Buffer

3 Answers 3

Comments

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related