Instead of implementing XMLHttpRequest in Node.js to run browser-specific Fetch polyfill, why not go from native http to fetch API directly? Hence, node-fetch, minimal code for a window.fetch compatible API on Node.js runtime.
See Matt Andrews' isomorphic-fetch or Leonardo Quixada's cross-fetch for isomorphic usage (exports node-fetch for server-side, whatwg-fetch for client-side).
Features
Stay consistent with window.fetch API.
Make conscious trade-off when following WHATWG fetch spec and stream spec implementation details, document known differences.
Use native promise but allow substituting it with [insert your favorite promise library].
Use native Node streams for body on both request and response.
Decode content encoding (gzip/deflate) properly and convert string output (such as res.text() and res.json()) to UTF-8 automatically.
Useful extensions such as timeout, redirect limit, response size limit, explicit errors for troubleshooting.
NOTE: 3xx-5xx responses are NOT exceptions and should be handled in then(); see the next section for more information.
Adding a catch to the fetch promise chain will catch all exceptions, such as errors originating from node core libraries, network errors and operational errors, which are instances of FetchError. See the error handling document for more details.
It is common to create a helper function to check that the response contains no client (4xx) or server (5xx) error responses:
function checkStatus(res) { if (res.ok) { // res.status >= 200 && res.status < 300 return res; } else { throw MyCustomError(res.statusText); }}fetch('https://httpbin.org/status/400') .then(checkStatus) .then(res => console.log('will not get here...'))
Advanced Usage
Streams
The "Node.js way" is to use streams when possible:
fetch('https://assets-cdn.github.com/images/modules/logos_page/Octocat.png') .then(res => { const dest = fs.createWriteStream('./octocat.png'); res.body.pipe(dest); });
In Node.js 14 you can also use async iterators to read body; however, be careful to catch
errors -- the longer a response runs, the more likely it is to encounter an error.
In Node.js 12 you can also use async iterators to read body; however, async iterators with streams
did not mature until Node.js 14, so you need to do some extra work to ensure you handle errors
directly from the stream and wait on it response to fully close.
url should be an absolute url, such as https://example.com/. A path-relative URL (/file/under/root) or protocol-relative URL (//can-be-http-or-https.com/) will result in a rejected Promise.
Options
The default values are shown after each option key.
{ // These properties are part of the Fetch Standard method: 'GET', headers: {}, // request headers. format is the identical to that accepted by the Headers constructor (see below) body: null, // request body. can be null, a string, a Buffer, a Blob, or a Node.js Readable stream redirect: 'follow', // set to `manual` to extract redirect headers, `error` to reject redirect signal: null, // pass an instance of AbortSignal to optionally abort requests // The following properties are node-fetch extensions follow: 20, // maximum redirect count. 0 to not follow redirect timeout: 0, // req/res timeout in ms, it resets on redirect. 0 to disable (OS limit applies). Signal is recommended instead. compress: true, // support gzip/deflate content encoding. false to disable size: 0, // maximum response body size in bytes. 0 to disable agent: null // http(s).Agent instance or function that returns an instance (see below)}
Default Headers
If no values are set, the following request headers will be sent automatically:
In addition, the agent option accepts a function that returns http(s).Agent instance given current URL, this is useful during a redirection chain across HTTP and HTTPS protocol.
const httpAgent = new http.Agent({ keepAlive: true});const httpsAgent = new https.Agent({ keepAlive: true});const options = { agent: function (_parsedURL) { if (_parsedURL.protocol == 'http:') { return httpAgent; } else { return httpsAgent; } }}
Class: Request
An HTTP(S) request containing information about URL, method, headers, and the body. This class implements the Body interface.
Due to the nature of Node.js, the following properties are not implemented at this moment:
type
destination
referrer
referrerPolicy
mode
credentials
cache
integrity
keepalive
The following node-fetch extension properties are provided:
follow
compress
counter
agent
See options for exact meaning of these extensions.
new Request(input[, options])
(spec-compliant)
input A string representing a URL, or another Request (which will be cloned)
options [Options][#fetch-options] for the HTTP(S) request
Constructs a new Request object. The constructor is identical to that in the browser.
In most cases, directly fetch(url, options) is simpler than creating a Request object.
Class: Response
An HTTP(S) response. This class implements the Body interface.
The following properties are not implemented in node-fetch at this moment:
Constructs a new Response object. The constructor is identical to that in the browser.
Because Node.js does not implement service workers (for which this class was designed), one rarely has to construct a Response directly.
response.ok
(spec-compliant)
Convenience property representing if the request ended normally. Will evaluate to true if the response status was greater than or equal to 200 but smaller than 300.
response.redirected
(spec-compliant)
Convenience property representing if the request has been redirected at least once. Will evaluate to true if the internal redirect counter is greater than 0.
Class: Headers
This class allows manipulating and iterating over a set of HTTP headers. All methods specified in the Fetch Standard are implemented.
new Headers([init])
(spec-compliant)
init Optional argument to pre-fill the Headers object
Construct a new Headers object. init can be either null, a Headers object, an key-value map object or any iterable object.
// Example adapted from https://fetch.spec.whatwg.org/#example-headers-classconst meta = { 'Content-Type': 'text/xml', 'Breaking-Bad': '<3'};const headers = new Headers(meta);// The above is equivalent toconst meta = [ [ 'Content-Type', 'text/xml' ], [ 'Breaking-Bad', '<3' ]];const headers = new Headers(meta);// You can in fact use any iterable objects, like a Map or even another Headersconst meta = new Map();meta.set('Content-Type', 'text/xml');meta.set('Breaking-Bad', '<3');const headers = new Headers(meta);const copyOfHeaders = new Headers(headers);
Interface: Body
Body is an abstract interface with methods that are applicable to both Request and Response classes.
The following methods are not yet implemented in node-fetch at this moment:
Data are encapsulated in the Body object. Note that while the Fetch Standard requires the property to always be a WHATWG ReadableStream, in node-fetch it is a Node.js Readable stream.
body.bodyUsed
(spec-compliant)
Boolean
A boolean property for if this body has been consumed. Per the specs, a consumed body cannot be used again.
body.arrayBuffer()
body.blob()
body.json()
body.text()
(spec-compliant)
Returns: Promise
Consume the body and return a promise that will resolve to one of these formats.
body.buffer()
(node-fetch extension)
Returns: Promise<Buffer>
Consume the body and return a promise that will resolve to a Buffer.
body.textConverted()
(node-fetch extension)
Returns: Promise<String>
Identical to body.text(), except instead of always converting to UTF-8, encoding sniffing will be performed and text converted to UTF-8 if possible.
(This API requires an optional dependency of the npm package encoding, which you need to install manually. webpack users may see a warning message due to this optional dependency.)
Class: FetchError
(node-fetch extension)
An operational error in the fetching process. See ERROR-HANDLING.md for more info.
Class: AbortError
(node-fetch extension)
An Error thrown when the request is aborted in response to an AbortSignal's abort event. It has a name property of AbortError. See ERROR-HANDLING.MD for more info.
Acknowledgement
Thanks to github/fetch for providing a solid implementation reference.