I am doing a DB Full Text Search Project, I need little assistance to start. The Database which I am going to use is SQL Server 2014 and ORACLE DB, we have huge amounts of data in our disks. I have collected some information regarding the DB full text search and ranking through sql server documentation, but now my guide says why don't you go for Learning to Rank of Machine learning concepts. I have no idea about it, so I need information about it and does it has any ranking algorithms and which can I go for and how to do as well
Thanks in advance!
Related
I am a developer and performance tester but not a DBA. My team is working on a performance testing tool that is specific to our software. One of the features we want it to have is the ability to generate a database report immediately after the test. Our software is database agnostic. For Oracle, I can easily create a snapshot id before and after the test and programmatically create an AWR report for those snapshots, write to a file and save with other artifacts we gather. Works great.
For SQL Server, however, there is no AWR equivalent (that I know of). I know the MDW as part of the SSMS has a UI for getting things like top 10 slow SQL and things like that. But, I have not yet found a way to programmatically create and extract a SQL performance report (preferably similar to Oracle's AWR) for SQL Server.
I am even willing to create the report myself if I can find a way to extract the raw data.
Any ideas would be greatly appreciated because searching online is not getting me anywhere.
P.S. I'm trying to do this in Java, by the way, but will accept help in any language. Thanks again!
Good news! In SQL Server 2016, you can use Query Store. This is like your flight recorder blackbox.. finding long running queries and waits. Capture baseline built in to SQL Server. You can compare before and after hardware changes and/or upgrades on queries. Maybe this similar to Oracle AWR.
Only available SQL Server 2016 and up.
Im new here and i hope i can make my question clear so that you guys can help me with some advise.
Im working with a client who wants to push its data on a regular basis from Oracle to MS SQL 2010 (effectively an ETL).
However, they've asked for a store procedure rather than ETL which was my initial idea.
i've written the store procedure ( almost there) which runs on SQL developer, asks user for input and based on the input parameters display a fact table with list of values and columns.
Now this values need to go into MS SQL Server and this is where i need help.
Bear in mind, the data in around 50-70,000 rows.
any idea of how best i should take this? I was thinking of creating a connection to MS SQL server in sql developer but i've never done that and I'm struggling there.
any advise is highly appreciated.
thanks
Mo
if stored procedure is your only option, you can create a linked server to connect to the Oracle server. The basic steps:
Quick summary:
1.Install the Oracle client
2.Install the tnsnames.ora file
3.Restart the SQL Server engine
4.Create a linked server
There are actually multiple different ways to do this, it depends on the OS, SQL Server version, Oracle version, and process architecture (32 bit vs 64 bit). Best thing to do is search the net until you find an article that matches your environment.
Working on migrating documents out of the document library and into a different system and I want to export out of the SQL server the metadata associated with the documents into the new system.
I'm using SQL Management Studio and HIEDISQL to look and find these records but I cant find them anywhere via searching.
This is SQL server 2008 running Sharepoint 2010.
Any help would be greatly appreciated.
I have googled a lot for the last week and have not been able to come up with anything since Google is trying to be smarter than my "exact phrase" searches so its been pretty frustrating :(
I had this same issue, but ended up using the .Net Client Side Object Model. Pluralsight has some excellent training videos on this. I'm not certain but I think the actual storage structure for the metadata is in a varbinary or some other sort of blob field, so it might not even be feasible to access by direct query. Also, direct querying of the sharepoint database could void your support agreement with MS.
Hope this helps...
I have installed Oracle XE. I build small database every day to practice from command prompt, but now I want to have more. I want to have a bigger database with a lot of different data to practice and make exercises.
So, is possible to get a big data file from somewhere and upload to XE database?
You can't get 'big' data for Oracle Express edition as it is limited to 4GB (10g) or 10GB (11g ).
That said, there are public datasets available. Personally I like the FAA data on registered aircraft owners/operators
As you are practicing with Oracle, perhaps a good solution (which will also generate exactly the data you need) would be to write your own stored procedures to generate your data in a loop (or similar construct).
You could then generate as much as you like whilst also practicing your handling of large datasets and writing of efficient PL/SQL and SQL code.
This way your data will match your current database structure too without having to build a new database matching whichever dataset you download from the web.
IIRC there are sample schemas as HR that can be enabled. See this.
ColdFusion 9's full text search is now based on Apache Lucene Solr (or Verity, but it has too much limitations). We also use SQL Server.
Which one's better? Which one's easier?
UPDATE: going to use for... searching against the name & description fields of the Products table.
Thanks!
Here's my 2 cents tested with ~ 3 000 000 of images with captions (primary key + image caption text from 100 to 500 chars):
CF9's Solr implementation is fast in returning results, really easy to setup, fairly fast during building index.
SQL Server 2005 FTS wasn't good enough, tried it some time ago and didn't put it in production. SQL Server 2008 FTS is much better though, currently using it on our application. But basic setup had to be adjusted in order to get high level results.
Based on experiences of other colleagues working with huge data sets and applications mostly based on search and finding things I made my top list:
Lucene
Tuned SQL Server 2008 FTS
Solr
SQL Server 2005
Of course CF9's Solr is winner here if you are chasing fast setup since you need 3 tags to finish the job and get awesome results.
The important question: What are you going to use it for?
Can't pick the right tool for the job when you don't know what the job is ;)