nodejs get file character encoding

Question

How can I find out what character encoding a given text file has?

var inputFile = "filename.txt";
var file = fs.readFileSync(inputFile); 
var data = new Buffer(file, "ascii");
var fileEncoding = some_clever_function(file);
if (fileEncoding !== "utf8") {
    // do something
}

Thanks

RidgeA · Accepted Answer · 2016-04-21 18:34:54Z

6

You can try to use external module, such as https://www.npmjs.com/package/detect-character-encoding

answered Apr 21, 2016 at 18:34

RidgeA

1,5661 gold badge10 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

6bytes Over a year ago

that's exactly what I've been looking for, thanks :)

Falaen · Accepted Answer · 2021-04-21 11:13:39Z

2

The previously mentioned module works for me too. Alternatively you could have a look at detect-file-encoding-and-language which I'm using at the moment.

Installation:

$ npm install detect-file-encoding-and-language

Usage:

// index.js

const languageEncoding = require("detect-file-encoding-and-language");

const pathToFile = "/home/username/documents/my-text-file.txt"

languageEncoding(pathToFile).then(fileInfo => console.log(fileInfo));
// Possible result: { language: japanese, encoding: Shift-JIS, confidence: { language: 0.97, encoding: 1 } }

edited Apr 21, 2021 at 11:13

answered Mar 24, 2021 at 14:02

Falaen

3834 silver badges13 bronze badges

Collectives™ on Stack Overflow

nodejs get file character encoding

2 Answers 2

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related