124

I'm creating a program to analyze security camera streams and got stuck on the very first line. At the moment my .js file has nothing but the import of node-fetch and it gives me an error message. What am I doing wrong?

Running Ubuntu 20.04.2 LTS in Windows Subsystem for Linux.

Node version:

user@MYLLYTIN:~/CAMSERVER$ node -v
v14.17.6

node-fetch package version:

user@MYLLYTIN:~/CAMSERVER$ npm v node-fetch

node-fetch@3.0.0 | MIT | deps: 2 | versions: 63
A light-weight module that brings Fetch API to node.js
https://github.com/node-fetch/node-fetch

keywords: fetch, http, promise, request, curl, wget, xhr, whatwg

dist
.tarball: https://registry.npmjs.org/node-fetch/-/node-fetch-3.0.0.tgz
.shasum: 79da7146a520036f2c5f644e4a26095f17e411ea
.integrity: sha512-bKMI+C7/T/SPU1lKnbQbwxptpCrG9ashG+VkytmXCPZyuM9jB6VU+hY0oi4lC8LxTtAeWdckNCTa3nrGsAdA3Q==
.unpackedSize: 75.9 kB

dependencies:
data-uri-to-buffer: ^3.0.1 fetch-blob: ^3.1.2         

maintainers:
- endless <jimmy@warting.se>
- bitinn <bitinn@gmail.com>
- timothygu <timothygu99@gmail.com>
- akepinski <npm@kepinski.ch>

dist-tags:
latest: 3.0.0        next: 3.0.0-beta.10  

published 3 days ago by endless <jimmy@warting.se>

esm package version:

user@MYLLYTIN:~/CAMSERVER$ npm v esm

esm@3.2.25 | MIT | deps: none | versions: 140
Tomorrow's ECMAScript modules today!
https://github.com/standard-things/esm#readme

keywords: commonjs, ecmascript, export, import, modules, node, require

dist
.tarball: https://registry.npmjs.org/esm/-/esm-3.2.25.tgz
.shasum: 342c18c29d56157688ba5ce31f8431fbb795cc10
.integrity: sha512-U1suiZ2oDVWv4zPO56S0NcR5QriEahGtdN2OR6FiOG4WJvcjBVFB0qI4+eKoWFH483PKGuLuu6V8Z4T5g63UVA==
.unpackedSize: 308.6 kB

maintainers:
- jdalton <john.david.dalton@gmail.com>

dist-tags:
latest: 3.2.25  

published over a year ago by jdalton <john.david.dalton@gmail.com>

Contents of the .js file (literally nothing but the import):

user@MYLLYTIN:~/CAMSERVER$ cat server.js 
import fetch from "node-fetch";

Result:

user@MYLLYTIN:~/CAMSERVER$ node -r esm server.js 
/home/user/CAMSERVER/node_modules/node-fetch/src/index.js:1
Error [ERR_REQUIRE_ESM]: Must use import to load ES Module: /home/user/CAMSERVER/node_modules/node-fetch/src/index.js
require() of ES modules is not supported.
require() of /home/user/CAMSERVER/node_modules/node-fetch/src/index.js from /home/user/CAMSERVER/server.js is an ES module file as it is a .js file whose nearest parent package.json contains "type": "module" which defines all .js files in that package scope as ES modules.
Instead rename index.js to end in .cjs, change the requiring code to use import(), or remove "type": "module" from /home/user/CAMSERVER/node_modules/node-fetch/package.json.

    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1089:13) {
  code: 'ERR_REQUIRE_ESM'
}
user@MYLLYTIN:~/CAMSERVER$ 
11
  • 6
    They are two types of module syntax for nodejs. The commonJS syntaxe, that uses require and module.exports, and the ES syntax, that use import * from "path" style of module. By default, nodejs will try to load modules with the CommonJS syntax. If you want to use the ES syntax, you must specify "type":"module" in your package.json. But you can't mix them up. You can use one syntax, but not both. Sep 3, 2021 at 8:06
  • @Ariart I am using ES syntax in my code and node-fetch does have "type": module in it's package.json Sep 3, 2021 at 8:11
  • 1
    Yes, you can run node with a flag. From memory, it's something like --input-type=module Sep 3, 2021 at 8:30
  • 2
    This ES Module stuff is such unnecessary drama. There's no silver bullet solution. I'm already using type: "module" and import for other libs, but p-limit in particular has this issue regardless. I'm sure it has something to do with my project setup, but you know, this is supposed to be easy. Just let me require -_-
    – sudo
    Mar 18, 2022 at 19:18
  • 3
    I found the best solution was to just use axios. Libraries that cause me to yak shave are candidates for the trash.
    – garryp
    Mar 28, 2022 at 9:31

14 Answers 14

62

From the Upgrade Guide

node-fetch was converted to be a ESM only package in version 3.0.0-beta.10. node-fetch is an ESM-only module - you are not able to import it with require.

Alternatively, you can use the async import() function from CommonJS to load node-fetch asynchronously:

// mod.cjs
const fetch = (...args) => import('node-fetch').then(({default: fetch}) => fetch(...args));

or you stay on v2 as they say in the README

node-fetch is an ESM-only module - you are not able to import it with require. We recommend you stay on v2 which is built with CommonJS unless you use ESM yourself. We will continue to publish critical bug fixes for it.

EDIT

I saw that in the doc, used it, and the script crashes with :

error TS2556: A spread argument must either have a tuple type or be passed to a rest parameter.

Since you are using typescript you should do something like this

import { RequestInfo, RequestInit } from "node-fetch";

const fetch = (url: RequestInfo, init?: RequestInit) =>  import("node-fetch").then(({ default: fetch }) => fetch(url, init));
9
  • I saw that in the doc, used it, and the script crashes with : error TS2556: A spread argument must either have a tuple type or be passed to a rest parameter. Node.js 14.17.1 Nov 10, 2021 at 9:05
  • @JeremyThille I have updated my answer. I haven't tested it yet, so please let me know if it works.
    – René Link
    Nov 10, 2021 at 13:35
  • Thank you very much. I tried exactly that, but I'm getting Error [ERR_REQUIRE_ESM]: Must use import to load ES Module. require() of ES modules is not supported. index.ts is an ES module file as it is a .js file whose nearest parent package.json contains "type": "module" which defines all .js files in that package scope as ES modules. Instead rename index.js to end in .cjs, change the requiring code to use import(), or remove "type": "module" from node_modules/node-fetch/package.json. It keeps saying I'm using require, but I'm using import. Running my TS file with ts-node-dev index.ts. Nov 10, 2021 at 16:37
  • 2
    @JeremyThille did you ever find out why? I have the same as you - I'm already using import.
    – Tiago
    Nov 23, 2021 at 10:08
  • 6
    It doesn't work because of the "import nodeFetch..." statement. You should only import types not the implementation. this should work: import { RequestInfo, RequestInit } from 'node-fetch'; const fetch = (url: RequestInfo, init?: RequestInit) => import('node-fetch').then(({ default: fetch }) => fetch(url, init));
    – SergeL
    Nov 28, 2021 at 13:57
31

To fix this, I downgraded node-fetch to the latest version 2, which right now is 2.6.6. This is the script I ran:

yarn add node-fetch@^2.6.6

or

npm install node-fetch@^2.6.6

I also added these compiler options:

{
  "compilerOptions": { "allowJs": true, "outDir": "./dist" },
}
2
  • didnt work for me, using node-fetch 3.x May 30, 2022 at 10:08
  • 1
    Where exactly did you add compiler options?
    – parsecer
    Jun 8, 2022 at 0:55
15

node-fetch v3 is ESM-only: https://github.com/node-fetch/node-fetch#loading-and-configuring-the-module. The esm module you’re adding is for adding ESM compatibility, but it’s unnecessary now that Node 12+ supports ESM natively; and it doesn’t work with ESM-only packages like node-fetch 3+.

To fix your issue:

  1. Remove the esm package.
  2. Add "type": "module" to your package.json.

And that’s it. Then when you run node server.js it should work.

4
  • I think it's still suggested to use the .mjs extension when you're writing ESM code for Node, but I'm having trouble finding a reference.
    – Coderer
    Oct 28, 2021 at 12:26
  • .mjs is an option, but not required. nodejs.org/api/packages.html#determining-module-system Nov 2, 2021 at 3:30
  • after adding that line its telling me it doesn't recognize the .ts file extension
    – LJD
    Aug 6, 2022 at 15:15
  • .ts is the extension for a TypeScript file, which Node doesn’t support out-of-the-box. Look into ts-node to add support for TypeScript to Node. Aug 8, 2022 at 18:15
12

I always had errors with previous solutions, this is what worked every single time for me

npm i -D node-fetch

const _importDynamic = new Function('modulePath', 'return import(modulePath)');

export const fetch = async function (...args: any) {
    const {default: fetch} = await _importDynamic('node-fetch');
    return fetch(...args);
}
7

Use ESM syntax, also use one of these methods before running the file.

  1. specify "type":"module" in package.json
  2. Or use this flag --input-type=module when running the file
  3. Or use .mjs file extension
  4. Otherwise load the package using dynamic import()
3
  • In what file?sss
    – parsecer
    Jun 8, 2022 at 0:56
  • This seems to taint my code. If I want to use a new package and it is ESM, it seems to not work unless I make my module ESM. But then all my other modules that use it throw the same error, which requires that I make them all ESM. This can't be right... I'm not going to change all my modules to ESM just to use one new ES module, there has to be a better way.
    – Michael
    Feb 24 at 21:55
  • You could technically use the dynamic import
    – GmBodhi
    Feb 26 at 0:56
3

Since the question was really about requiring node-fetch and there are definitely reasons that a developer might need to use require vs import, the answer to import the module using import() is somewhat accurate but isn't complete, because it ignores the fact that using import is async and if you're using node-fetch in your code in multiple places you're going to have a bit of an async mess all over the place whenever you want to use node-fetch, so the answer is very incomplete IMHO. A more complete answer would include a better how-to. Something like the following:

You need to use import() rather than require because this is an ES module. To avoid an async mess, you'll want to await the importing of this module once and then be able to use it wherever else you need it. To do that, create a module that imports any of your ES-only modules something like this:

"use strict";

let got;
let fetch;

module.exports.load = async function() {
    queueMicrotask(function() {
        // any ESM-only module that needs to be loaded can be loaded here, just add import for each using specific structure of each
        import("got").then(({default: Got}) => got = Got );
        fetch = (...args) => import('node-fetch').then(({default: fetch}) => fetch(...args));
    });

    while(
        // check each module to see if it's been loaded here
        !got || !got.get || !fetch || typeof fetch !== "function"
         ) {
        // waiting for modules to load
        console.log("Waiting for ES-Only modules to load...");
        await new Promise((resolve)=>setTimeout(resolve, 1000));
    }
    module.exports.got = got;
    module.exports.fetch = fetch;
    console.log("ES-Only modules finished loading!");
}

This then allows you to call the await the loading of the ES-Only modules once and then use the module later by grabbing it from your intermediary module like this:

"use strict";

const esmModules = require("esm_modules"); // or whatever you called the intermiary module
async function doMyFetching(url, options) {
   const fetch = esmModules.fetch;
   const result = await fetch(url, options)
}

The nice part of doing it this way is that you know that your ES-Only modules are loaded and you know that once they're loaded you can use them at will throughout the rest of your code in a simple and clean way that doesn't force you to add additional async logic all over the place whenever you need the module.

1
  • The question was not about requiring node-fetch, I did not use require and did not want to. Thanks for the informative reply tho might help someone Nov 30, 2022 at 13:09
2

Many times that error happens through the current version of fetch what we can do to solve it, is to install a previous version I tried it and it worked for me.

to install the previous version: npm i node-fetch@2.6.1 or whatever you prefer.

enter image description here

1
2

In case someone is solving this issue in 2022:

Recent versions of nodejs already includes global fetch api. It is still an experimental feature and may be not ready to be used in production, but if you are writing some basic script or doing some sandbox project, you should definitely try it. Works without issues for me.

This is an official announcement and some examples here and here

2

So far, the offered solutions to this question are:

  1. downgrade to an earlier version of the installed package.
  2. convert your project to a pure esm project.
  3. use dynamic import.

There is another solution not yet mention -- install a hook called esm-hook.

npm install esm-hook

This solution does not require you to change any of your code; you simply require the hook at the top of your javascript file:

require("esm-hook");  // <--- add this to the top of your file.

const fetch = require('node-fetch').default

fetch("https://hacker-news.firebaseio.com/v0/item/8863.json?print=pretty")
  .then(res => res.json())
  .then(json => console.log(json))
  .catch(console.error);

A quick look at the code shows that it uses esbuild to transpile the esm module to commonjs. This might impact performance if the module you consume is large.

1

Here is in Typescript, this will install to the global scope, just import the file and fetch ready to use:

/* filename: fetch.ts */

if (!globalThis.fetch) {
  import('node-fetch').then(({ default: fetch, Headers, Request, Response }) => {
    Object.assign(globalThis, { fetch, Headers, Request, Response })
  })
}
1

If you use typescript in yout project, you can now use tsx package. tsx is a CLI command (alternative to node) for seamlessly running TypeScript & ESM, in both commonjs & module package types.

1
  • 1
    Your answer could be improved with additional supporting information. Please edit to add further details, such as citations or documentation, so that others can confirm that your answer is correct. You can find more information on how to write good answers in the help center.
    – Community Bot
    Jun 28 at 4:43
0

As said others this error because the node-fetch package has been converted to be an ESM-only package in version 3,so to solve the node-fetch error

  1. use a dynamic import to import the node-fetch package
  2. downgrade the version of the package

This link is a comprehensive explanation about Error [ERR_REQUIRE_ESM]: require() of ES [node-fetch Module ] not supported.

node-fetch Error [ERR_REQUIRE_ESM]: require() of ES Module not supported

According to nodejs v18 doc in node v18 fetch package is built in so if upgrade node to v18 you do not need to install node-fetch separately.

1
0

@Cizia's answer worked for me. With TypeScript, I wanted a bit more type safety, so I merged it with @René Link's answer.

import { RequestInfo, RequestInit, Response } from 'node-fetch'

const _importDynamic = new Function('modulePath', 'return import(modulePath)')

export const nodeFetch = async function (url: URL | RequestInfo, init?: RequestInit): Promise<Response> {
  const { default: fetch } = await _importDynamic('node-fetch')
  return fetch(url, init)
}
0

The best option is to use something else like gaxios https://github.com/googleapis/gaxios .

For example:

console.log('downloading using gaxios')
/** @type {import('gaxios').GaxiosResponse<ArrayBuffer>} */
// called inside an async function
const result = await request({
            url: downloadUrl,
            responseType: 'arraybuffer',
            // avoid error saying failed to verify first certificate
            agent: new https.Agent({ rejectUnauthorized: false })
});
const arrayBuff = result.data
const buff = Buffer.from(arrayBuff)

But if you really must use node-fetch, then you have two other options:

  1. You can install a module that works like fetch but supports commonjs eg isomorphic-fetch

  2. You can install a lower-version of node-fetch.

First uninstall the node-fetch version that is only allowing ESM modules:

npm uninstall node-fetch

Then install the old node-fetch version that supports commonjs:

npm i node-fetch@2.6.6  

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.