Data Mining Query in Data Flow - sql-server

I have created a package using SSIS 2012 that uses data mining query & runs perfectly well in SQL Server Data Tools.
The problem is that it does not finish running when scheduled on SQL Agent. The package runs about 60 seconds in data tools and it never finishes when scheduled.
I have enabled logging but nothing is logged while running as a job.
Please advise.
Update 1:
Error message: To run a SSIS package outside of SQL Server Data Tools you must install Pivot of Integration Services or higher.
Update 2:
Package ran by setting delay validation to true on data mining query.
However, the job on sql agent runs in funny way every second job takes 12 minutes to run while every other one takes 1 minute to run.

You do not have the SSIS bits installed on that machine. Find your installation media and click back through the install process. Ensure that you have selected the SQL Server Integration Services Service (isn't that a mouthful).
https://dba.stackexchange.com/questions/49786/error-to-run-a-ssis-package-outside-of-sql-server-data-tools-you-must-install
https://dba.stackexchange.com/questions/36915/ssis-recordset-destination-error

Related

SSIS package / SQL Server Agent job maximum execution time

I have 2 SSIS packages started by a single SQL Server Agent Job.
The first package took approximatively 2h30 and the second failed after 0:50.
Unfortunately, I don't know where or why it failed but I want to first check if there are some limitations regarding the maximum execution time allotted to an SSIS package or to a SQL Server Job.
Is there anything like that?

Package in Sql Server agent job fails while in Integration Services Catalogs succeeds

I'm facing some weird problem. I have a package which I made in SSIS, the package executes successfully from SSIS.
Deployed the solution into Integration Services Catalogs, Validated and executed the package successfully too, but when I create a new job in the SQL server agent and trying to start this package I keep getting the same error
ORA 12154: TNS: could not resolve the connect...
BTW This connection manager works well in other jobs that I execute.
Any help would be appreciated.
P.S the error IMG
You need to run the package as 32-bit since the Oracle driver you've installed is in 32-bit. Go to edit package step and simply check the Run as 32-bit checkbox.

SQL Server 2014 always goes down every midnight (12 AM)

We have an SQL Server 2014 with a lot of Jobs that are scheduled every 12AM. They are around 70-80 jobs that will run at 12 AM. All jobs run successfully, then we just noticed that we can no longer access the SQL server on a client workstation, nor telnet the port of the SQL. The services are still running but when we try to restart the SQL Service, it does not restart successfully. The only way to make this work again is to restart the server.
This is now happening for 3 days straight and we cannot isolate what may be causing this.
We have checked all the logs in SQL and even the event logs of the windows but there is nothing to show about any error that may cause this.
There is no any scheduled task outside SQL Job that are scheduled at midnight.
Hope you can help me as this is a big issue on us since this is a production server and we cannot avail to have the server to restart every day.

Execution Within SQL Server Agent vs Package Execution Utility

Simple question: how does the execution of a ssis package differ when using the SQL Server 2012 Integration Package Utility versus when using the 2012 SQL Server Agent to execute a package? (holding all else constant within deployment- ie using the local file system in both cases)
Thank you.
I am asking because I have an externally referenced dll in my ssis package script that successfully executes with the package utility but not when deployed to the server agent within SQL server 2012 mgmt studio.
If you are sure that the agent service is running on an account that has proper permissions, check to ensure that you are executing the same runtime version for both instances. Your driver may be 64 bit and incompatible with 32 bit runtime and vice-versa.
There is an option in "execution options" of the agent job step that will allow you to select the 32 bit runtime, if needed.
If you are unable to get the "SQL Server Integration Services Package" job step type to work, you can change to using the "Operating system (CmdExec)" job step type and simply build a command using the utility executable (dtexec) and copying the info from the "Command line" tab of the utility. Some prefer this method of executing SSIS packages with the agent as it provides cleaner maintenance of the jobs. Searching the google for this topic will bring up articles like this: http://bi-polar23.blogspot.com/2008/06/ssis-and-sql-server-agent-choosing.html
Hope this helps.

How to go about creating a SQL Server Agent clone / customization (NOT another SQL Server Express Agent question)

I'm managing a web app featuring countless ETL (Extract, Transform & Load) processes feeding a datawarehouse (using SSIS dtsx packages + *.sql files).
At the moment, everything is governed by several SQL Agent processes monitoring "scheduling queue" tables.
I'm trying to figure out a way to develop a scheduler or scheduling "framework" of some sort that needs to do a subset of what SQL Server Agent does (executing dtsx packages, executing SQL) but with a configuration UI based on ASP.NET, as users need to be able to create & modify schedules, manually launch processes and monitor custom logs.
Configuration info, activity, execution logs, schedules, jobs, job steps and everything else needed that I'm missing should be persisted to DB.
I'm guessing a Windows Service would be flexible but development costs might skyrocket.
I appreciate any sort of input, particularly some clues on SQL Server Agent's internal workflow. I DID try searching for info, but it being PROPRIETARY software, I found zilch.
(maybe I should specify I'm more than familiar with SQL Server and C# based .NET development, I just have no idea where to start from..)
The SQL server agent database is called 'msdb'. You can attach profiler to msdb and create some scheduled jobs to see how it works.
The gist of the answer is one should use SQL Server Service Broker, coupled with SQL Server Service Broker External Activator from the Feature Pack

Resources