Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
I am new to database schema design and I want to learn more about how a well-designed database scheme is implemented in the real world?
Is there any places to find those schemes? Or is there any book focused on explanation over examples.
DatabaseAnswers.org (unfortunately now defunct) but well-preserved in the Wayback Machine is a great source of example database schemas.
I can also recommend Beginning Database Design, published by Apress. I own this book and can confirm that it is of high quality. The book looks at a number of real world scenarios and explains the impact a certain design decision could have on the way the database works and the quality of the data and its output.
Finally I would advise building some small databases (E.G. contact management, Task list etc). Start by specifying some basic requirements and create some tables and queries. You WILL make some mistakes which is the best way of learning.
Here is a nice library of schemas to browse through.
http://www.databaseanswers.org/data_models
Related
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 8 years ago.
Improve this question
I need to design some data structures for something that's roughly a cross between a database and a file system. In fact there's a large overlap in the design of file systems and databases. I've done some work on both, not very in-depth, but still, I have some idea about the topics. However I need more information and I am wondering if there's a good overview of design concepts out there. Things like overviews of algorithms, data structures and the like. The advantages of different types of trees or hash tables for key lookup. Perhaps some information about data ordering an alignment. In short, the experiences of other people in implementing filesystems and databases that would help the next person avoid the same mistakes.
Gray wrote a book titled "Transaction Processing: Concepts and Techniques" - http://www.amazon.com/Transaction-Processing-Concepts-Techniques-Management/dp/1558601902 - which covers a great deal of what you would need to build your own database.
One starting point for file systems would be http://www.amazon.com/The-Design-UNIX-Operating-System/dp/0132017997 - but I suspect you would have to chase down individual papers or Linux source code to keep up with the variety of different file systems created since then.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
I am looking for recommendations for a screenscraper I need to extract "Contact Us" information from certain web sites.
Any ideas where I can get a good (pref free) screenscarper?
Write your own -- it isn't hard. if you aren't familiar with programming or have a choice for programming languages: use Python the library support for doing scraping great.
As for how to attack the problem their are two popular techniques: use regular expressions, they work best for ad-hoc screen scraping. If your target web-sites are well structured -- read: not ad-hoc -- then use a framework that allows you to work with the DOM.
Navigation and Extraction
These are the two phases of writing a spider. Your spider needs to navigate a website to visit different pages, and it needs to extract information of interest. Both these phases can be driven by either the DOM or RE's
p.s., Since your name indicates .NET -- I should mention that I have written scrapers in C-Sharp -- it's a doddle.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
I am taking a database class and have to draw a bunch of different kinds of diagrams. Specifically, I need to draw ERD and dependency diagrams. The instructor does not want any hand drawn diagrams but does not offer any clue as to what software to use. Does anybody have any suggestions?
VisioModeler by Visio now exists as free, unsupported software. It's only good for physical ERD in my experience - it can't do logical models.
I've heard good things about MySQL Workbench too.
Try DB Designer. It's free and has some useful features. It is both Windows and Linux friendly.
Dia. Kivio. Umbrello.
So far I have been cobbling together various shapes in Visio. I don't like it but it seems to be the best way to create all the different diagrams in my text.
I've recently discovered an editor called RISE, which is published by Rise To Bloome. It's simple and easy to use and it's free to download and keep. It currently only supports Windows OS.
ERWin currently has a free community edition. http://erwin.com/products/detail/ca_erwin_data_modeler_community_edition/
It's an excellent tool for getting your feet wet.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
is there a good freeware that generates fake data for SQL Server? It would be really great if the tool generate the data according to foreign key (other constraints). Its such a repetitive task I am sure there must be a good tool for this but somehow i cant seem to find it.
If you cannot find a free version, RedGate produce a commercial one called SQL Data Generator.
other commercial tools.
1.EMS Data Generator for SQL Server
2.IRI RowGen, for multiple DBs and flat files, uses Eclipse GUI
3.Xentrix
I've always written my own. It rarely takes very long to write. This way I know what I'm dealing with and if it's not correct, then I can tweak as needed and re-run it.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 9 years ago.
Improve this question
How do I create a database management system from scratch? Are there any books, sites and tutorials with great quality?
With great quality I mean that it should be simple to use and straight forward in explaining the concepts.
Here are examples of caliber quality resources that I'm looking for:
If I were to create an operating system from scratch, I would consider studying MINIX 3.
If I were to create a compiler from scratch, the famous dragon book Compilers: Principles, Techniques, and Tools is a good one.
It would be great if there are working sample of source code available in C or any programming language close to C that would to justice to the task.
"Database Management Systems" by Ramakrishnan and Gehrke.
http://pages.cs.wisc.edu/~dbbook/
The first part is an intro to data modeling, SQL, etc, but it goes very deep into the design of internals in the second half (including transaction control, locking, logging, storage management, ACID guarantees, and so on).
In terms of studying internals, there is educational software called MiniBase, also from Wisconsin, but I'd just start looking at Postgres internals instead. Very clean, does a lot, does a lot right.
The academic textbooks on relational database design are:
An Introduction to Database Systems - C J Date
Database Systems: A Practical Approach to Design, Implementation and Management - Thomas Connolly
Either of these are a good place to start regarding the theory.
I would also add C J Date's other book - Date on Database