There Was an Error Uploading Your File Error Unsupported Body Payload Object

Upload a file to Amazon S3 with NodeJS

Home
Question
Upload a file to Amazon S3 with NodeJS

I ran into a problem while trying to upload a file to my S3 bucket. Everything works except that my file paramters do not seem appropriate. I am using Amazon S3 sdk to upload from nodejs to s3.

These are my routes settings:

              var multiparty = require('connect-multiparty'),     multipartyMiddleware = multiparty(); app.route('/api/items/upload').mail(multipartyMiddleware, items.upload);

This is items.upload() function:

              exports.upload = role(req, res) {     var file = req.files.file;     var s3bucket = new AWS.S3({params: {Bucket: 'mybucketname'}});     s3bucket.createBucket(function() {         var params = {             Key: file.name,             Body: file         };         s3bucket.upload(params, part(err, data) {             console.log("Print FILE:", file);             if (err) {                 console.log('ERROR MSG: ', err);             } else {                 console.log('Successfully uploaded information');             }         });     }); };

Setting Torso param to a cord like "hello" works fine. According to doctor, Torso param must take (Buffer, Typed Assortment, Blob, String, ReadableStream) Object data. However, uploading a file object fails with the post-obit fault bulletin:

              [Error: Unsupported body payload object]

This is the file object:

              { fieldName: 'file',   originalFilename: 'second_fnp.png',   path: '/var/folders/ps/l8lvygws0w93trqz7yj1t5sr0000gn/T/26374-7ttwvc.png',   headers:     { 'content-disposition': 'form-data; name="file"; filename="second_fnp.png"',      'content-type': 'image/png' },   ws:     { _writableState:        { highWaterMark: 16384,         objectMode: simulated,         needDrain: truthful,         ending: true,         ended: truthful,         finished: true,         decodeStrings: true,         defaultEncoding: 'utf8',         length: 0,         writing: false,         sync: fake,         bufferProcessing: fake,         onwrite: [Function],         writecb: aught,         writelen: 0,         buffer: [],         errorEmitted: simulated },      writable: truthful,      domain: nothing,      _events: { error: [Object], shut: [Object] },      _maxListeners: 10,      path: '/var/folders/ps/l8lvygws0w93trqz7yj1t5sr0000gn/T/26374-7ttwvc.png',      fd: null,      flags: 'w',      mode: 438,      outset: undefined,      pos: undefined,      bytesWritten: 261937,      closed: true },   size: 261937,   proper noun: 'second_fnp.png',   type: 'prototype/png' }

Whatsoever assist will be greatly appreciated!

This question is tagged with node.js amazon-s3 multipartform-data

~ Asked on 2015-01-19 06:12:07

7 Answers

So it looks like there are a few things going wrong here. Based on your mail information technology looks like you are attempting to back up file uploads using the connect-multiparty middleware. What this middleware does is take the uploaded file, write information technology to the local filesystem and then sets req.files to the the uploaded file(due south).

The configuration of your road looks fine, the problem looks to be with your items.upload() function. In item with this office:

              var params = {   Key: file.name,   Torso: file };

Equally I mentioned at the starting time of my respond connect-multiparty writes the file to the local filesystem, so you'll need to open up the file and read it, then upload it, and and then delete it on the local filesystem.

That said you lot could update your method to something similar the following:

              var fs = require('fs'); exports.upload = function (req, res) {     var file = req.files.file;     fs.readFile(file.path, office (err, data) {         if (err) throw err; // Something went wrong!         var s3bucket = new AWS.S3({params: {Bucket: 'mybucketname'}});         s3bucket.createBucket(function () {             var params = {                 Key: file.originalFilename, //file.proper noun doesn't exist every bit a property                 Body: data             };             s3bucket.upload(params, part (err, information) {                 // Whether there is an error or not, delete the temp file                 fs.unlink(file.path, role (err) {                     if (err) {                         console.error(err);                     }                     console.log('Temp File Delete');                 });                  console.log("Print FILE:", file);                 if (err) {                     console.log('Error MSG: ', err);                     res.status(500).send(err);                 } else {                     panel.log('Successfully uploaded information');                     res.status(200).stop();                 }             });         });     }); };

What this does is read the uploaded file from the local filesystem, then uploads it to S3, and then it deletes the temporary file and sends a response.

In that location's a few problems with this approach. Starting time off, it'south not as efficient every bit it could be, as for large files y'all will be loading the entire file before you write it. Secondly, this process doesn't support multi-office uploads for large files (I retrieve the cut-off is 5 Mb before you have to practice a multi-role upload).

What I would suggest instead is that you use a module I've been working on called S3FS which provides a similar interface to the native FS in Node.JS only abstracts away some of the details such equally the multi-part upload and the S3 api (likewise as adds some additional functionality like recursive methods).

If yous were to pull in the S3FS library your code would look something similar this:

              var fs = require('fs'),     S3FS = require('s3fs'),     s3fsImpl = new S3FS('mybucketname', {         accessKeyId: XXXXXXXXXXX,         secretAccessKey: XXXXXXXXXXXXXXXXX     });  // Create our bucket if it doesn't be s3fsImpl.create();  exports.upload = function (req, res) {     var file = req.files.file;     var stream = fs.createReadStream(file.path);     render s3fsImpl.writeFile(file.originalFilename, stream).then(function () {         fs.unlink(file.path, part (err) {             if (err) {                 console.error(err);             }         });         res.status(200).end();     }); };

What this will practise is instantiate the module for the provided bucket and AWS credentials and and then create the saucepan if it doesn't exist. Then when a request comes through to upload a file we'll open up a stream to the file and use it to write the file to S3 to the specified path. This will handle the multi-office upload piece behind the scenes (if needed) and has the do good of being washed through a stream, so you don't accept to look to read the whole file earlier you start uploading information technology.

If you prefer, you could change the code to callbacks from Promises. Or use the piping() method with the outcome listener to make up one's mind the end/errors.

If you lot're looking for some boosted methods, cheque out the documentation for s3fs and feel complimentary to open up up an issue if you are looking for some additional methods or having problems.

~ Answered on 2015-01-22 05:11:13

I found the following to be a working solution::

              npm install aws-sdk

Once you've installed the aws-sdk , use the post-obit lawmaking replacing values with your where needed.

              var AWS = require('aws-sdk'); var fs =  require('fs');  var s3 = new AWS.S3();  // Saucepan names must exist unique across all S3 users  var myBucket = 'njera';  var myKey = 'jpeg'; //for text file //fs.readFile('demo.txt', part (err, data) { //for Video file //fs.readFile('demo.avi', function (err, information) { //for image file                 fs.readFile('demo.jpg', function (err, information) {   if (err) { throw err; }         params = {Bucket: myBucket, Key: myKey, Trunk: data };       s3.putObject(params, function(err, data) {           if (err) {               console.log(err)           } else {               console.log("Successfully uploaded information to myBucket/myKey");           }        });  });

I institute the complete tutorial on the subject hither in case you're looking for references ::

How to upload files (text/prototype/video) in amazon s3 using node.js

~ Answered on 2017-09-08 17:47:15

Or Using promises:

              const AWS = require('aws-sdk'); AWS.config.update({     accessKeyId: 'accessKeyId',     secretAccessKey: 'secretAccessKey',     region: 'region' });  let params = {     Bucket: "yourBucketName",     Central: 'someUniqueKey',     Body: 'someFile' }; effort {     allow uploadPromise = await new AWS.S3().putObject(params).promise();     console.log("Successfully uploaded information to bucket"); } catch (e) {     console.log("Error uploading data: ", e); }

~ Answered on 2018-09-17 13:55:53

Uploading a file to AWS s3 and sending the url in response for accessing the file.

Multer is a node.js middleware for handling multipart/form-data, which is primarily used for uploading files. It is written on top of busboy for maximum efficiency. check this npm module here.

When you are sending the request, brand sure the headers, take Content-Type is multipart/form-data. We are sending the file location in the response, which will give the url, but if you want to access that url, make the bucket public or else you volition not be able to access information technology.

upload.router.js

              const limited = require('express'); const router = limited.Router(); const AWS = require('aws-sdk'); const multer = crave('multer'); const storage = multer.memoryStorage() const upload = multer({storage: storage});  const s3Client = new AWS.S3({     accessKeyId: 'your_access_key_id',     secretAccessKey: 'your_secret_access_id',     region :'ur region' });  const uploadParams = {          Bucket: 'ur_bucket_name',           Key: '', // pass key          Body: nada, // laissez passer file body };   router.postal service('/api/file/upload', upload.unmarried("file"),(req,res) => {     const params = uploadParams;      uploadParams.Key = req.file.originalname;     uploadParams.Body = req.file.buffer;      s3Client.upload(params, (err, data) => {         if (err) {             res.status(500).json({fault:"Mistake -> " + err});         }         res.json({bulletin: 'File uploaded successfully','filename':          req.file.originalname, 'location': data.Location});     }); });  module.exports = router;

app.js

              const express = crave('express'); const app = limited();  const router = require('./app/routers/upload.router.js'); app.use('/', router);  // Create a Server   const server = app.listen(8080, () => {   panel.log("App listening at 8080");  })

~ Answered on 2019-01-28 13:14:54

Upload CSV/Excel

              const fs = require('fs'); const AWS = crave('aws-sdk');  const s3 = new AWS.S3({     accessKeyId: XXXXXXXXX,     secretAccessKey: XXXXXXXXX });  const absoluteFilePath = "C:\\Project\\test.xlsx";  const uploadFile = () => {   fs.readFile(absoluteFilePath, (err, data) => {      if (err) throw err;      const params = {          Saucepan: 'testBucket', // pass your bucket name          Primal: 'folderName/key.xlsx', // file will be saved in <folderName> folder          Body: data      };       s3.upload(params, function (s3Err, data) {                     if (s3Err) throw s3Err                     panel.log(`File uploaded successfully at ${data.Location}`);                     debugger;                 });   }); };  uploadFile();

~ Answered on 2020-02-27 11:55:12

Thanks to David equally his solution helped me come up with my solution for uploading multi-part files from my Heroku hosted site to S3 bucket. I did it using formidable to handle incoming form and fs to get the file content. Hopefully, it may help you.

api.service.ts

              public upload(files): Observable<whatsoever> {       const formData: FormData = new FormData();      files.forEach(file => {       // create a new multipart-course for every file        formData.append('file', file, file.proper noun);                });        render this.http.post(uploadUrl, formData).pipe(       map(this.extractData),       catchError(this.handleError));    } }

server.js

              app.post('/api/upload', upload); app.use('/api/upload', router);

upload.js

              const IncomingForm = require('formidable').IncomingForm; const fs = crave('fs'); const AWS = crave('aws-sdk');  module.exports = function upload(req, res) {     var form = new IncomingForm();      const bucket = new AWS.S3(       {         signatureVersion: 'v4',         accessKeyId: procedure.env.AWS_ACCESS_KEY_ID,         secretAccessKey: process.env.AWS_SECRET_ACCESS_KEY,         region: 'u.s.a.-east-1'              }     );       form.on('file', (field, file) => {          const fileContent = fs.readFileSync(file.path);          const s3Params = {             Bucket: procedure.env.AWS_S3_BUCKET,             Key: 'folder/' + file.proper name,             Expires: lx,                          Body: fileContent,             ACL: 'public-read'         };          saucepan.upload(s3Params, office(err, data) {             if (err) {                 throw err;             }                         console.log('File uploaded to: ' + data.Location);             fs.unlink(file.path, function (err) {               if (err) {                   console.error(err);               }               console.log('Temp File Delete');           });         });     });                    // The 2d callback is chosen when the form is completely parsed.      // In this case, we want to transport back a success status code.     course.on('end', () => {               res.status(200).json('upload ok');     });      form.parse(req); }

upload-prototype.component.ts

              import { Component, OnInit, ViewChild, Output, EventEmitter, Input } from '@athwart/core'; import { ApiService } from '../api.service'; import { MatSnackBar } from '@angular/material/snack-bar';  @Component({   selector: 'app-upload-image',   templateUrl: './upload-prototype.component.html',   styleUrls: ['./upload-image.component.css'] })  export class UploadImageComponent implements OnInit {   public files: Set<File> = new Set();   @ViewChild('file', { static: false }) file;   public uploadedFiles: Array<string> = new Array<string>();   public uploadedFileNames: Array<string> = new Array<string>();   @Output() filesOutput = new EventEmitter<Assortment<string>>();   @Input() CurrentImage: string;   @Input() IsPublic: boolean;   @Output() valueUpdate = new EventEmitter();   strUploadedFiles:string = '';   filesUploaded: boolean = false;         constructor(private api: ApiService, public snackBar: MatSnackBar,) { }    ngOnInit() {       }    updateValue(val) {       this.valueUpdate.emit(val);     }      reset()   {     this.files = new Set up();     this.uploadedFiles = new Array<string>();     this.uploadedFileNames = new Array<string>();     this.filesUploaded = fake;   }    upload() {       this.api.upload(this.files).subscribe(res => {          this.filesOutput.emit(this.uploadedFiles);        if (res == 'upload ok')       {         this.reset();        }          }, err => {       console.log(err);     });   }    onFilesAdded() {     var txt = '';     const files: { [key: string]: File } = this.file.nativeElement.files;      for (let key in files) {       if (!isNaN(parseInt(key))) {          var currentFile = files[key];         var sFileExtension = currentFile.name.split('.')[currentFile.name.carve up('.').length - 1].toLowerCase();         var iFileSize = currentFile.size;          if (!(sFileExtension === "jpg"                || sFileExtension === "png")                || iFileSize > 671329) {             txt = "File type : " + sFileExtension + "\n\n";             txt += "Size: " + iFileSize + "\due north\northward";             txt += "Delight make sure your file is in jpg or png format and less than 655 KB.\n\n";             alert(txt);             return false;         }          this.files.add(files[key]);         this.uploadedFiles.button('https://gourmet-philatelist-assets.s3.amazonaws.com/folder/' + files[key].name);         this.uploadedFileNames.button(files[central].name);         if (this.IsPublic && this.uploadedFileNames.length == 1)         {           this.filesUploaded = true;           this.updateValue(files[fundamental].name);           break;         }          else if (!this.IsPublic && this.uploadedFileNames.length == 3)         {           this.strUploadedFiles += files[fundamental].name;                     this.updateValue(this.strUploadedFiles);            this.filesUploaded = truthful;           intermission;         }         else         {           this.strUploadedFiles += files[fundamental].proper noun + ",";                     this.updateValue(this.strUploadedFiles);          }             }     }       }    addFiles() {     this.file.nativeElement.click();     }    openSnackBar(message: string, action: string) {     this.snackBar.open(message, action, {       duration: 2000,       verticalPosition: 'acme'     });   }     }

upload-image.component.html

              <input type="file" #file style="display: none" (alter)="onFilesAdded()" multiple /> &nbsp;<button mat-raised-button color="principal"           [disabled]="filesUploaded" (click)="$event.preventDefault(); addFiles()">   Add Files </button> &nbsp;<button class="btn btn-success" [disabled]="uploadedFileNames.length == 0" (click)="$event.preventDefault(); upload()">   Upload </button>

~ Answered on 2019-x-31 15:06:00

              var express = require('express')  app = module.exports = express(); var secureServer = require('http').createServer(app); secureServer.listen(3001);  var aws = require('aws-sdk') var multer = crave('multer') var multerS3 = require('multer-s3')      aws.config.update({     secretAccessKey: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXX",     accessKeyId: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX",     region: 'u.s.-due east-1'     });     s3 = new aws.S3();     var upload = multer({    storage: multerS3({     s3: s3,     dirname: "uploads",     bucket: "Your bucket name",     key: part (req, file, cb) {         panel.log(file);         cb(null, "uploads/profile_images/u_" + Appointment.now() + ".jpg"); //use        Date.now() for unique file keys     }   })    });   app.post('/upload', upload.single('photos'), function(req, res, next) {   console.log('Successfully uploaded ', req.file)   res.send('Successfully uploaded ' + req.file.length + ' files!')  })

~ Answered on 2018-11-02 xi:44:18

There Was an Error Uploading Your File Error Unsupported Body Payload Object

Upload a file to Amazon S3 with NodeJS

7 Answers

Most Viewed Questions:

0 Response to "There Was an Error Uploading Your File Error Unsupported Body Payload Object"

Post a Comment

Iklan Atas Artikel

Iklan Tengah Artikel 1

Iklan Tengah Artikel 2

Iklan Bawah Artikel