I have a rails-api conected to an angular app with the main purpose of uploading different files to the server and make copies of them, until now it works perfectly but the biggest files i've had to upload so far are 500ish mb, and now i have to uploas arrays of files that tend to be more than 20 gb of data.
I use angular np-upload to upload my files with http method and carrierwave gem to manage file and folder creation on the server side but i don't want to do the same when the payload is this big, So now my question is there a way to make this differently?? like google drive folders that synchronize constantly and the user doesn't even realize, Iwant to acomplish something like tis with my aplication so that when the really big files are uploading the app doesn't freeze and the user can upload several things at once and keep interacting with the app even though is uploading or synchronizing files to the server.
Thanks in advance for any advice
Related
Well I'm sorry for the confused question title but let me explain it better in here.
I have a Nest.js application that I want to upload to Vercel free servers,and in this application users can upload files and it stores in the file system of the application ( I searched and it is accordingly to some programmers better than storing files directly in database ), and I have a question,when a user uploads his files,will Vercel store it ?
And also...if I want to migrate to some paid server (Digital Ocean,Azure,AWS,etc) can I get these files to make the migration?
I'm playing around making a video platform (for fun), I currently have 3 big pieces: a front end written in ReactJS, a backend written in NodeJS and a filesystem to store user media in digital ocean spaces (s3 bucket).
I want to keep this project lightweight and as it is practice for me I don't want to use a library that does everything for me. It's just an architecture question.
I already implemented a way for a user to upload an image on the backend (it uploads binaries from FE to the BE and in there it checks that everything is ok and then uploads to the filesystem). I also have an endpoint to stream the video from the filesystem, which works fine.
Now I am trying to do it for videos, but I have a dilemma, if I do the same as I do for images I will have to upload it first to the BE and then to the filesystem and AFAIK that's really inefficient.
Would it be a better idea to put the video upload directly on the Front end and then store the uploaded URL of the video into the DB? And if that is the case how can I make the S3 connection secure? Not exposing S3 bucket information.
I am looking at a CSV file hosted on an open government portal with daily updates, and would like to build a web app around it. Looking for the best approach, please advise. Current options I am looking at:
Reading CSV directly into a web app - seems to be a bad idea because it's a sizeable file over 70 Mb, likely will make it too long to load on the first user touch or even with each query
Schedule a task with something like AWS to read the file once a day and send its contents to a database such as Mongodb by either overwriting the db completely or pre-reading it and updating with newer entries, and then query this db from the web app
Am I missing any better approaches?
Ive developed an app which needs to upload a small .xml file to a web server, there will be around 15 devices running this app uploading around 15 .xml files each per day. The files need to be uploaded to the same directory.
What would be the best way to achieve this? Im assuming i cant use the same login details for the server on every device, is there any hosting out there that allows multiple different logins?
Thanks.
Paul.
Take a look at Parse.com's data solution. You can set up a free account and have your devices post the data a database using their API. Pretty easy to set up with iOS and for basic services it's free.
AppHarbor (like Heroku) doesn't allow you to save uploaded files or images. I need to offload this somewhere and I have no idea what services exist for this purpose.
I've looked into FilePicker.io but they display a tacky branding image in their uploader and to remove that branding you have to pay a large sum of money.
Any suggestions on how to approach this problem? What is the modus operandi with applications that need file uploads that are hosted on PaaS?
We recommend that you use Amazon S3 to store files like this. An AppHarbor user has written a guide on how to get started with S3 on the support forums.