使用Node.js上传到Google云存储 [英] Uploading to google cloud storage with Node.js

问题描述

与Node.js和Google云作斗争.我正在尝试将文件上传到Google Cloud Storage中的存储桶.基本上，我在以下答案中使用代码: https://stackoverflow.com/a/45253054/324691 ，但是我无法使其正常工作.这是我的代码:

Struggling with Node.js and Google cloud. I am trying to upload a file to a bucket in Google Cloud Storage. Basically I am using the code in this answer: https://stackoverflow.com/a/45253054/324691, but I can't get it to work. Here is my code:

const Storage = require('@google-cloud/storage');
const storage = new Storage();
var form = new formidable.IncomingForm();

// form.maxFieldsSize = 20 * 1024 * 1024; // default
form.maxFieldsSize = 20 * 1024;
// form.maxFileSize = 200 * 1024 * 1024;
// 4 MB / minute, 1 hour
form.maxFileSize = 4 * 60 * 1024 * 1024;
// Limit to 10 minutes during tests (4 MB/minute)
form.maxFileSize = 2 * 1024 * 1024;
form.maxFileSize = 4 * 10 * 1024 * 1024;

form.encoding = 'utf-8';
form.keepExtensions = true;
form.type = 'multipart';

return new Promise((resolve, reject) => {
    form.parse(req, (err, fields, files) => {
        console.warn("form.parse callback", err, fields, files);
        if (err) {
            reject(new Error(err));
            return;
        }
        var file = files.upload;
        if(!file){
            reject(new Error("no file to upload, please choose a file."));
            return;
        }
        console.info("about to upload file as a json: " + file.type);
        var filePath = file.path;
        console.log('File path: ' + filePath);
        console.log('File name: ' + file.name);

        var bucket = storage.bucket(bucketName)
        console.info("typeof bucket.upload", typeof bucket.upload);
        bucket.upload(filePath, {
            destination: file.name
        }).then(() => {
            resolve(true);  // Whole thing completed successfully.
            return true;
        }).catch((err) => {
            console.warn("catch bucket.upload, err", err);
            reject(new Error('Failed to upload: ' + JSON.stringify(err)));
        });
        console.warn("After bucket.upload");
    });
    console.warn("After form.parse");
}).then(() => {
    console.warn("form.parse then");
    res.status(200).send('Yay!');
    return true;
}).catch(err => {
    console.warn("form.parse catch");
    console.error('Error while parsing form: ' + err);
    res.status(500).send('Error while parsing form: ' + err);
});

控制台日志中的输出看起来正常(包括file.path和file.name)，但是当它到达bucket.upload(类型为function)时，它将崩溃，并显示错误Error while parsing form: Error: Failed to upload: {"message":"Error during request."}.然后说Execution took 1910 ms, user function completed successfully.之后，终于Function worker killed by signal: SIGTERM.

The output in the console log looks ok (including file.path and file.name), but when it gets to bucket.upload (which is of type function) then it crashes with the error Error while parsing form: Error: Failed to upload: {"message":"Error during request."}. And then it says Execution took 1910 ms, user function completed successfully. And after that finally Function worker killed by signal: SIGTERM.

我一直在使用bucketName(带有和不带有"gs://")进行测试.

I have been testing using bucketName with and without "gs://".

我一直在测试不同的授权方式:

And I have been testing different ways for authorization:

const storage = new Storage({ projectId: projectId });
const storage = new Storage({ keyFileName: 'path-to-keyfile.json'});
const storage = new Storage();

密钥文件是服务帐户的密钥文件(请参见 https://cloud.google.com/docs/authentication/getting-started ).

The key file is a key file for the service account (see https://cloud.google.com/docs/authentication/getting-started).

这是一个Firebase项目，我正在本地Firebase服务器(firebase serve --only functions,hosting)上进行测试.

This is a Firebase project and I am testing on the local Firebase server (firebase serve --only functions,hosting).

这可能是什么问题?

推荐答案

存储的身份验证应如下所示:

The authentication of the storage should look like this:

const storage = new Storage({
    apiKey: "YOUR_API_KEY",
    authDomain: "YOUR_AUTH_DOMAIN",
    databaseURL: "YOUR_DATABASE_URL",
    projectId: "YOUR_PROJECT_ID",
    storageBucket: "YOUR_STORAGE_BUCKET",
    messagingSenderId: "YOUR_MESSAGE_SENDER_ID"
});

使用多部分处理看起来与使用本地文件有所不同.因此，用于上传的代码为:

Also working with multipart looks different than with local files. So the code for uploading would be:

            const fileName = 'file_name.extension";

            const fileUpload = bucket.file(fileName);

            const uploadStream = fileUpload.createWriteStream({
                metadata: {
                    contentType: file.mimetype
                }
            });


            uploadStream.on('error', (err) => {
                console.log(err);
                return;
            });

            uploadStream.on('finish', () => {
                console.log('Upload success');
            });

            uploadStream.end(file.buffer);

最后，bucketName不应包含gs://-它应如下所示: project_id.appspot.com .

Lastly, bucketName shouldn't contain gs:// - it should look like this: project_id.appspot.com.

Ps.上面的代码中的 busboy 处理了mimetype的上传.

Ps. Uploading mimetype was handled with busboy in the code above.

这篇关于使用Node.js上传到Google云存储的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！