Data Science and Data Lake Use Case Recommendations [closed] - snowflake-cloud-data-platform

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
I am looking to connect and ingest raw data files from various services that my business uses to see how we can improve our customer experience.
Internal Data
Location information based on delivery updates and gps units on transportation devices
Service and repair information on unique transportation units (varying 1000 at a time)
4 main WANS and ~40k usernames
External Data
Transportation part suppliers
Finance and expense reporting for transportation devices and usernames
Most of the information can be avro, json, xml and csv information
I have began setting up the export of this data from the 5 separate services generating the information, and have found Fivetran to be very helpful. What have you used for building your main analytics, that I only want to give access to a few analysts on my team?

As Suzy commented, this question is very broad and more philosophical than most questions here on Slack. Here's a link on "asking a good question" on StackO - https://stackoverflow.com/help/how-to-ask
That said, I think the most appropriate answer at this junction would be to point you in the direction of our "Data Piplelines" document, which can be found at this link:
https://docs.snowflake.net/manuals/user-guide/data-pipelines-intro.html
The workflow and data loading framework documented there is robust, and can get you heading in the right direction.
I hope this helps...Rich

Related

Packaged application for CRUD operations on a database [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 1 year ago.
Improve this question
I know that there are many tools for the visualization of databases such as metabase, grafana, tableau, superset ...
But I don't know of any packaged software that allows CRUD operations (crete, read, update and delete) on a database.
This problem has been presented to me several times in several of my projects, wanting to make a table available to a user and that does not merit custom development. I bet a lot of people must have this same situation
But I have not found any packaged software that provides crud operations on a database table. So it seems extremely strange to me and I wanted to see why, is there a design problem in this functionality? Or am I just doing the wrong google search and these softwares have another name?
Do you mean something like a Database Management Tool?
You have plenty of them, personally I use DBeaver.
If you mean about frameworks which generate a boilerplate API with CRUD operations, you have Loopback, from IBM.
And if you mean something you could access as a web-application, then you have PHPMyAdmin if you're focused into MySQL/MariaDB.

Possible options for generating reports with/in Angular JS [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 6 years ago.
Improve this question
I would like to know how can I generate reports from Angular JS as front end development language. Nature of the reports are monthly sale reports, monthly order reports, monthly employee performance reports etc
I am using ASP.NET MVC web API as backend development tool.
Note: I have searched online few paid software tools like Syncfusion, ag-grid etc. but my management is finding these tools expensive and is not in the mood to use paid tools. So I would like to know how can I perform the reporting operation in Angular JS without buying any expensive external tool.Kindly provide helpful suggestions for generating reports in Angular JS .
Previously asked questions on this topic were more than 2 years old, so I am inclined to ask for the fresh opinions from experts here.
You can use Angular Ui-Grid(http://ui-grid.info) for tabular representations.
For Graphs, i will recommend using D3 or Highcharts

Where to get a climate database for all places of the world? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 1 year ago.
Improve this question
I want to show some climate graphs and historical weather data for specific places around the world.
My current database has city names, countries, longitude, latitude possible to query a search in a climate database. There are a lot of weather api's but I search for static climate information, can't find anything on the internet. Database doesn't have to be updated, I don't expect the climate too change so fast.
XML, json even api is fine. Hope anyone can help me with this.
Format with max / min temperature per month, maybe average rainfall and sun hours would be great.
NOAA keeps global climate data, Did you look at:
http://www.ncdc.noaa.gov/oa/ncdc.html
There seems to be an API:
http://www.ncdc.noaa.gov/cdo-web/webservices
For very detailed climate Canada data I have only had luck w/ a
"URL based procedure to automatically download data in bulk from Climate Website".
You must then find the "station" you are interested in first here is the station list.
https://drive.google.com/uc?authuser=0&id=1egfzGgzUb0RFu_EE5AYFZtsyXPfZ11y2&export=download
One you have that you can request the data:
format:
https://climate.weather.gc.ca/climate_data/bulk_data_e.html?format=csv&stationID={STATION}&Year={YEAR}&Month={MONTH}&Day={DAY}&timeframe=1
Here is an example:
https://climate.weather.gc.ca/climate_data/bulk_data_e.html?format=csv&stationID=10183&Year=2018&Month=3&Day=31&timeframe=1
You can find information on the columns here:
https://climate.weather.gc.ca/glossary_e.html#weather
And some general data information here:
https://climate.weather.gc.ca/about_the_data_index_e.html
https://drive.google.com/drive/folders/1WJCDEU34c60IfOnG4rv5EPZ4IhhW9vZH

Credit card processing system for static website [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 6 years ago.
Improve this question
Is there a website or a service that handles all the credit card processing stuff for a basic static website and sends over the payment to an account? Except for paypal ?
Rbs worldpay has equivalent services of what Paypal offers.
You have the option of junior invisible and junior, one of it provides a form for filling up cc information on your behalf, the other allows you to capture cc information on your site and pass over to rbs. That's what I recall.
Stripe was built for website credit card processing.
From their site https://stripe.com/
Payments for developers - Stripe makes it easy to start accepting
credit cards on the web today.
You can find additional documentation at https://stripe.com/docs
Disclaimer: I have no business relationship with Stripe. They just seem like a good fit for what your asking.

US city, state and zip in XML, JSON or comma delimited? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 5 years ago.
Improve this question
I'm looking for any kind of flat file that contains every US city, state and zip code. I've searched high and low and can only find databases - which I'm fine using to create the flat file - but I thought I'd check here first.
If nobody else has a ready-made solution I'll parse through a database and post the flat file as the answer.
The reason I need this is for ajax auto-suggest. YQL and other free remote solutions are proving to be inconsistent and at worst, unreliable. I also do not want to make that many database calls.
You could farm these JSON sets:
http://gomashup.com/json.php?fds=geo/usa/zipcode/state/IL&jsoncallback=?
http://gomashup.com/json.php?fds=geo/usa/zipcode/state/CA&jsoncallback=?
etc
Why not just load the data from a database into a javascript object in one ajax call and hook that into your autosuggest?
EDIT: agreed with #elusive, 20,000+ municipalities is a LOT of data to load to each client

Resources