Extracting data using screenscrapers [closed] - screen-scraping

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
I am looking for recommendations for a screenscraper I need to extract "Contact Us" information from certain web sites.
Any ideas where I can get a good (pref free) screenscarper?

Write your own -- it isn't hard. if you aren't familiar with programming or have a choice for programming languages: use Python the library support for doing scraping great.
As for how to attack the problem their are two popular techniques: use regular expressions, they work best for ad-hoc screen scraping. If your target web-sites are well structured -- read: not ad-hoc -- then use a framework that allows you to work with the DOM.
Navigation and Extraction
These are the two phases of writing a spider. Your spider needs to navigate a website to visit different pages, and it needs to extract information of interest. Both these phases can be driven by either the DOM or RE's
p.s., Since your name indicates .NET -- I should mention that I have written scrapers in C-Sharp -- it's a doddle.

Related

Small YAML/JSON parser in C [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
I've been looking for a small YAML/JSON parser, preferably a single-file solution, so i can easily embed it on my application. I'm looking for a small and simple solution since i intend to use it on different platforms, and building libyaml and other solutions will be a huge pain in the ass.
Also, is TinyXML a good alternative? What is fastest to parse?
I was looking for something similar sometime last year. This is the one I settled on:
YAJL
It's not a single file solution, but it's not very big either. I has some features like JSON formatting and syntax checking that you might see as feature bloat, but they don't bother me.

Which is the best database for windows phone [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 8 years ago.
Improve this question
I have around 10 tabs, each tab would be having all the four operations of CRUD(Create,Read,Update,Delete).
In all the tab while getting the list from server, I have planned to save them in the Database(as I am building a native app).
I read about isolated storage(files and also Local Database) and SQLite.
Regarding SQLite, as it is a third party database,I think it will affect the performance.
So what shall I use??
I heard some recommendations about Sterling DB, but i didn't make a crash-tests for DB yet.
I guess, you should decide more exact, what would be the most often operations. Take a look at performance tests here:
http://www.jayway.com/2010/11/17/performance-of-sterling-database-for-windows-phone-7/
http://www.maxpaulousky.com/blog/archive/2011/07/27/windows-phone-mango-db-engines-performance-testing.aspx

What options for analytics dashboards are out there besides leftronic.com? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
We have analytics coming from several different services and need a place to combine all the data in a single display. Does anyone have experience with other services besides leftronic.com?
There are tons of options. Try InfoCaptor, it is free https://my.infocaptor.com
huge visualization library and connects to social analytics as well as databases
PS: I am the developer
We've used Leftronic and were quite satisfied with the product, but have since moved onto Geckoboard because the UI is much more elegant. You might also want to checkout Boarrd.

Where to find practical well-designed database schema examples to learn from? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
I am new to database schema design and I want to learn more about how a well-designed database scheme is implemented in the real world?
Is there any places to find those schemes? Or is there any book focused on explanation over examples.
DatabaseAnswers.org (unfortunately now defunct) but well-preserved in the Wayback Machine is a great source of example database schemas.
I can also recommend Beginning Database Design, published by Apress. I own this book and can confirm that it is of high quality. The book looks at a number of real world scenarios and explains the impact a certain design decision could have on the way the database works and the quality of the data and its output.
Finally I would advise building some small databases (E.G. contact management, Task list etc). Start by specifying some basic requirements and create some tables and queries. You WILL make some mistakes which is the best way of learning.
Here is a nice library of schemas to browse through.
http://www.databaseanswers.org/data_models

Is there a good reference card that compares T-SQL and PL/SQL side-by-side? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
I'm looking for a good reference card / cheat sheet that compares T-SQL and PL/SQL data manipulation language commands side-by-side.
I've previously searched SO but there isn't any older thread covering this particular subject so I thought it'd be a good idea to start one, given that such reference is almost mandatory if you happen to work in an environment where both technologies coexist.
Thanks much in advance!
This is pretty good. In ye olde paper and inke, SQL in a nutshell is also useful.
I found this PDF which goes into detail about syntax examples between the two:
Note: The PDF is from 2003 so it may not be update to date with new features from SQL Server 2005 or 2008 (such as the RowNum() function).

Resources