Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 1 year ago.
Improve this question
I want to show some climate graphs and historical weather data for specific places around the world.
My current database has city names, countries, longitude, latitude possible to query a search in a climate database. There are a lot of weather api's but I search for static climate information, can't find anything on the internet. Database doesn't have to be updated, I don't expect the climate too change so fast.
XML, json even api is fine. Hope anyone can help me with this.
Format with max / min temperature per month, maybe average rainfall and sun hours would be great.
NOAA keeps global climate data, Did you look at:
http://www.ncdc.noaa.gov/oa/ncdc.html
There seems to be an API:
http://www.ncdc.noaa.gov/cdo-web/webservices
For very detailed climate Canada data I have only had luck w/ a
"URL based procedure to automatically download data in bulk from Climate Website".
You must then find the "station" you are interested in first here is the station list.
https://drive.google.com/uc?authuser=0&id=1egfzGgzUb0RFu_EE5AYFZtsyXPfZ11y2&export=download
One you have that you can request the data:
format:
https://climate.weather.gc.ca/climate_data/bulk_data_e.html?format=csv&stationID={STATION}&Year={YEAR}&Month={MONTH}&Day={DAY}&timeframe=1
Here is an example:
https://climate.weather.gc.ca/climate_data/bulk_data_e.html?format=csv&stationID=10183&Year=2018&Month=3&Day=31&timeframe=1
You can find information on the columns here:
https://climate.weather.gc.ca/glossary_e.html#weather
And some general data information here:
https://climate.weather.gc.ca/about_the_data_index_e.html
https://drive.google.com/drive/folders/1WJCDEU34c60IfOnG4rv5EPZ4IhhW9vZH
Related
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
I am looking to connect and ingest raw data files from various services that my business uses to see how we can improve our customer experience.
Internal Data
Location information based on delivery updates and gps units on transportation devices
Service and repair information on unique transportation units (varying 1000 at a time)
4 main WANS and ~40k usernames
External Data
Transportation part suppliers
Finance and expense reporting for transportation devices and usernames
Most of the information can be avro, json, xml and csv information
I have began setting up the export of this data from the 5 separate services generating the information, and have found Fivetran to be very helpful. What have you used for building your main analytics, that I only want to give access to a few analysts on my team?
As Suzy commented, this question is very broad and more philosophical than most questions here on Slack. Here's a link on "asking a good question" on StackO - https://stackoverflow.com/help/how-to-ask
That said, I think the most appropriate answer at this junction would be to point you in the direction of our "Data Piplelines" document, which can be found at this link:
https://docs.snowflake.net/manuals/user-guide/data-pipelines-intro.html
The workflow and data loading framework documented there is robust, and can get you heading in the right direction.
I hope this helps...Rich
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 4 years ago.
Improve this question
I am creating an attendance website using Reactjs.
I want teachers to upload their student details as an excel file and then I want that to be uploaded to firebase so that I can compare the students ID from firebase and the Students who signed up and sort them out accordingly.
Is there any react component that would allow me to do that. Anything is helpful.
It really depends on the format you are outputting the Excel file in.
Currently i'm working a react project, with both Firbase realtime-db and storage, where we have to parse CSV files, and map the data from those. If you export your Excel file as CSV, i recommend looking at Papa Parse. That was fairly easy to use, with easy to read documentation. I know this won't solve your entire issue, but i hope it can help you in the right direction.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 5 years ago.
Improve this question
I'm looking for any kind of flat file that contains every US city, state and zip code. I've searched high and low and can only find databases - which I'm fine using to create the flat file - but I thought I'd check here first.
If nobody else has a ready-made solution I'll parse through a database and post the flat file as the answer.
The reason I need this is for ajax auto-suggest. YQL and other free remote solutions are proving to be inconsistent and at worst, unreliable. I also do not want to make that many database calls.
You could farm these JSON sets:
http://gomashup.com/json.php?fds=geo/usa/zipcode/state/IL&jsoncallback=?
http://gomashup.com/json.php?fds=geo/usa/zipcode/state/CA&jsoncallback=?
etc
Why not just load the data from a database into a javascript object in one ajax call and hook that into your autosuggest?
EDIT: agreed with #elusive, 20,000+ municipalities is a LOT of data to load to each client
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 5 years ago.
Improve this question
Not sure if this is the proper place to post this question, but I've seen questions regarding ISBN databases, so I thought it would be appropriate.
In my website, I intend allow my users to choose between all the US college/universities (community or 4 year institutes). I would then store their selection in a database.
At first I thought about allowing them to input the name themselves, but saw some issues with that. I tried to look for a database of some sort, but all I found were search engines to find a specific university.
I was hoping to find a database can I export to my own database (SQL Server) and have users search my own database.
Has anyone come across this issue and found a reasonable solution?
This is an old question, but I wanted to post the answer for those who find this page.
This should do the trick: http://ope.ed.gov/accreditation/GetDownloadFile.aspx
It's a csv and xls file of all the accredited universities in the US. It's about 22,800 rows and narrowing it uniquely by name brings it down to about 9,000.
Enjoy!
This question was posted in 2011, but luckily data is getting easier to come by!
Department of Education now has an API (also CSV) available to get a variety of data about universities as well as public elementary and high schools.
Their Directory Listing CSV under 'Colleges and Universities' contains about 7,700 rows which matches up pretty well with NCES data (from 2012) putting the number of post-secondary institutions in the US around 7,000.
Disclaimer before you go write academic research with that database: Considering that NCES number is a couple years out of date, it seems reasonable to assume this Dept of Ed listing is reasonably accurate though I havent tested it rigorously
You can combine these two by having a search box with auto complete, if the input query does not match, indicate if they want to add this into database. You can create a table in database to hold all these contributions and they won't get added to the list before you or someone approve it.
googling for 'list of us universities' gives me a lot of hits.
you could have a textbox which allows them to enter the name themselves but offers autocomplete functionality which aids them in inputing a string which is an exact match to one in your database (sort of like how facebook autocompletes the friend search on the top right)
if the user ignores this and specifies an unknown string, you could either add this new string to your database or refuse, saying that they should ask the admin to add it for them and then try again
The most complete resource is the IPEDS, you need to click on download survey, and download the year data you like. I have called them to see if they have an API, but no luck there, so it's all in excel format. bummer....
http://nces.ed.gov/ipeds/datacenter/Default.aspx
Here is the free database of the major worldwide universities:
https://github.com/turalus/openDB
It's 9498 Universities from all over the world.
Their names are translated into 3 languages: English, Russian, Azerbaijani.
3072 of them have logos.
organized by countries
you get complete list from
http://www.webometrics.info/
complete world univerity names and ranks. now just scrap them .
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 8 years ago.
Improve this question
I'm working on a web application that is globalized. The development process is agile style, with several sprints already completed. Our globalization framework is good and localization efforts have been successful so far. However, we continue to run into questions during requirements development, particularly in data storage and validation requirements. I'm certain the questions we are wrestling with have been researched and solved many times and the answers are likely well known and documented somewhere. So far, I have been unable to find the compendium of information I'm looking for.
Here are some sample questions I'd like to find answers for:
What are the best practices for input, validation, storage and display of address information for a global application?
number of characters to store for address fields (Did you know there is a city name that contains 163 characters?)
validation of address data
What are the best practices for input, validation, storage and display of phone numbers for a global application?
Same question for a person's name?
So far, our approach to these issues has been to allow ample storage for the various fields and to perform minimal input validation, relying on the user to get it right. This approach is working OK at this stage in the project, but the various project stakeholders are not satisfied using this approach for the long term. There is a strong desire for clean data, efficient storage and attractive data presentation for all locales.
Any recommendations out there for books, papers or websites that have a fairly complete handling of these and related topics?
Lots of good information here.