I am currently designing a reviews site for video games similar to gamespot am wondering where and if there is an online database that contains information such as name, publisher, release date etc with an API. I dont really want to have to enter each title manually or let users enter the title manually.
Where do these large sites get information like this? I wouldn't think it would be manually. I know for movies IMDB exists.
How would I go about adding it to my database?
Thanks
May I point you to web scraping?
Be sure to read the section legal issues and on well-behaved bots.
There's always Amazon and their product advertising API. Some older, but interesting code snippets can be found on this page.
If you know Perl, there is an amzing module called WWW::Mechanize
Pretty much you can write a script to get to any website and grab any data you need.
So for example you can go to www.gamespot.com, get list like the one below and put them in your database.
http://www.gamespot.com/games.html?platform=1029&mode=all&sort=views&dlx_type=all&sortdir=asc&official=all&tag=games%3Bfooter%3Bmore
Related
I want to build a similar post recommendation system that a user sees after performing some activity on the news feed. For example: If he/she spends more time on sports posts, giving him/her sports recommended post so I would like to get help on what kind of dataset do I need to build a post recommendation system that a user likes to see. I am confused on should I build a dataset of my own if yes how can I build these recommendation posts? Thank you in advance!!
Hello and welcome to the forum! I recommend against building a dataset of your own as real world datasets have certain properties (distribution, missing data, noise) which are quite hard to replicate artificially.
You included Kaggle in your tags. Why don't you use it? It looks perfect for the job. Here's a list of options with the #recommender-systems tag.
This one and this one are about films. This other one is about user interactions with a news platform.
If this answered your question, please don't forget to accept it by clicking on the Tick button at the left of the answer. Have fun!
I'm trying to search some guidelines to create my first app for a price list. If I search on Google I find only ready system but I'd like to make something customized. My needs are to import a 3-4000 lines excel sheet for products with different measures and give to customers the possibility to make a quotation with their personal discount and place an order our make only a quotation for logged users. Instead for not logged user to see only product without prices. Then I don't know if it's better to make contents downloadable or to load all contents inside the app. I think it's better to download contents, so I can update prices directly without make them download each time an app update. Then a possibility to show some pop-up with products news, sometimes in a month. I'm yet practice with magento, WordPress and sql queries. I think The best for me is to find some kind of cms, for phone app, if they exist. Cross platform maybe the best. To understand something like wish or geek. I wait for your replies. Thank you guys!
Hi guys im brand new and not a developer but I need a way for users when they go to my site they can upload there video and there would be a option for them to add there first name and email so when the video is uploaded the database can keep all the data together.
Ideally I want this as easy as possible for the user and this would just go to our youtube channel or any video platform will work.Any advice would be great!
Please provide more information like what platform are you using ?.
There's more than one way to skin a cat.
The simple way to achieve with web technologies like (Php,node,jave) is maintain the basic user information into the sessions, and whenever it's necessary use this information.
You need to get some knowledge about the system you are using. You particularly need:
access to the server
to know the server type
access to the database
to know the database type
where the relevant files are
After you have gathered all these information, you at least know what you do not know. The next step is to gather information about how you can implement the feature you need. Look at it like at a puzzle with many small pieces. If you are patient-enough, at the end you will resolve the puzzle.
I have a site that I'm looking to transfer to Volusion. Importing tabled content into Volusion's a breeze, it's getting it tabled that's an issue. The old site has no real ability to export, nor do I know how to get at it's database. I'm thinking there must be some sort of script I can write to take the content from the frontend and download it in some sort of list that I can put into a CSV, and put into Volusion.
www.twincitygreetings.com
Any suggestions? I'm hoping to get in the image directory as well and download all them for upload to the new site.
You are going to need at the very least a file with product code, product name, weight and price.
Looking at the URL you provided it doesn't appear that the products their follow any type of orderly structure where you can target the images folder or products based on a known piece of information like a products code. Unless the back-end has some type of product export function you may have no choice but to recreate it from scratch.
I don't know if you solved this yet or not, but I would suggest scraping the data providing you have the information on the old site currently. This can be done easily using vbscript and excel, or if you aren't very savvy at coding you could look at a piece of software called mozenda. There are a whole variety of methods that can be used to scrape data, all of them pretty easy to learn with a bit of research. Basically you write a script that will crawl your dom and extract the data (to xml works best in my experience)
Hope this helps.
I need a database of interests for a coming project.
By saying "interests" I mean like:
Sports - Football, Basketball and so on...
Is somebody know something like this?
I just don't want start writing thousands (or even millions) of interests.
Try to google on "interests list" or "hobbies list" and the write simple parcer to extract all (based on neko-html for example). Examples of useful links:
http://www.notsoboringlife.com/list-of-hobbies/
http://www.buzzle.com/articles/list-types-of-hobbies/
Also it is possible to ask admins of any dating sites to make a simple DB-query to get relevant result.
There is an API from google called Freebase. I allows you suggest to the user what input he should give the same way google search suggests you what to look for.
Freebase