I have got olap cube on ssas which has all operational history data
I need a front end toll which can not only show data from cube but also sources like web crawl scribe blogs Facebook etc.
Can I leverage any open source software for building required reports which can be run in real time
Have got OBIEE but need a platform which can help devise such reports through a search screen on wrbsitw with parameter enters by user
Related
I am looking to pull site usage data from sharepoint such as daily users, click through rate, which parts of the site they are using the most, which links they are using the most, which documents are being opening the most. Is there a way to do this through excel, any programs, etc. I have been looking at Power BI, Excel, Power Query, etc. I haven't found a way to pull the data from sharepoint analytics itself though.
I am looking to pull data from the sharepoint site and display it as a chart, a Pareto chart for example.
1.The current situation that the site usage analysis page can export:
Site owners can export the 90-days site usage data in an excel file by going to the download button in the upper right corner on site usage page. Report on unique viewers, site visits, popular platforms and site traffic. For popular content on the site (news posts, documents and pages) the report will be for last 7 days.
excel_example
2.I've also tried getting data from the web in Excel, but it doesn't work. There is currently only one connector between site usage and PowerBI.
I tracked down a published post in UserVoice: Export to Excel on Site usage. You can vote and comment anytime.
3.You might try using the Office 365 Admin API to use, retrieve and store the data in a database, and then report on it with PowerBI. This requires registering with Azure AD and give it permissions to the API.
Reference: Office 365 Management Activity API reference
I want to build a system there I will store user all activity and group user to the segments based on their interest
It depents in how you will read data and how much of the work you want to do on database server or with your own application.
We use monitoring and logging with Elastic Search and have a separate service which handles logging messages posted to rabbitmq. A second service handles statistic messages and Stores it into a SQL Database so our web application can read it in realtime and Show some charts which are implemented in our backend system.
Just use the Repository/Service pattern with the use of a generic Repository and you can easy Switch your Database If you want after it dont fits your needs.
We are a SaaS product and we would like to be able have per-user data exports that will be used with various analytical (BI) tools like Tableau or PowerBI. Instead of just managing all those exports manually, we thought of using some cloud database such as AWS Redshift (which will be part of our service). But then, it is not clear how is user will access those databases naturally, unless we do some kind of SSO integration with AWS.
So - what is the best practice for exporting data for analytics use in SaaS products?
In this case you can build your security in to your backend API layer.
First you can set up processes to load your data to Redshift, then make sure that only your backend API server/cluster has access to redshift (e.g. through a vpc with no external ip access to redshift)
Now you have your data, you can validate your user as usual through your backend service, then when a user requests a download through the backend API, the backend can create a query to extract from redshift only the correct data based upon the users security role. In order to make this possible you may need to build some kind of security column into your redshift data model.
I am assuming getting data to redshift is not a problem.
What you are looking for, if I understand correctly is a OEM solutions.
The problem is how does one mimic the security model you have in place for your SaaS offering.
That depends on how complex is your security model.
If it is as simple as just authenticate the user and he has access to all tenant data or the data can be easily filtered for user. Things are simple for you. Trusted authentication will allow you to authenticate that user and user filtering will allow you to show him all that he has access to.
But here is the kicker, if your security is really complex , then it can become really difficult to mimic it within these products.
Here for integrating tableau this link will help:-
https://tableau.github.io/embedding-playbook/#
Power BI, this product am not a fan off. I tried to embed a view in one my applications and data refresh was a big issue.
Its almost like they want you to be a azure shop for real time reporting.( I like GCP more )
If you create the api's and populate datasets then they have crazy restrictions like 1MB/sec etc.
On the other instances datasets can be refreshed only 8 times.
I gave up on them.
Very recently I got a call from Sisense and they seemed promising as well from a OEM perspective. You might was to try them.
I know that it is possible to create dashboards using data studio from various data sources. My question is whether is it possible to visualize a real time data graph using data studio, as in case of data coming from IoT devices?
EDITED
I am uploading a file from my local machine now. So I think now it's not possible to visualize the changes in the data studio if I change any data within my machine.
What I am asking is however is that, is it possible to visualize any changes occured in a google sheet in data studio in real time. Say that I changed or added some new data rows into my google sheet, is it possible in data studio to see those changes in real time?
Yes, it is possible with implementing custom script for refreshing the reports.
I'm feeding in a sheet that is using data supplied by the Google Sheets Google analytics plug-in, and that is definitely updating in Data Studio as the Google sheets report updates.
Data Studio currently does not support automatic real time updates / streaming data. After you open a dashboard, the only way to re-fetch the data is to use the dashboard's refresh feature.
If you require real time updates in your dashboard, please put in feature requests / vote for them in the issue tracker.
Edit: There is a third party Chrome extension that lets users auto refresh dashboards (does not work with Viewer credentials).
We want to add tracking statistics to a web application we are building but are pretty unsure of how to go about it. (i.e. clicks, pageviews, unique visits etc)
Does anyone have any articles on the best way to go about incorporating tracking data into an application ? i.e. javascript tracking or IIS etc ?
We want to add tracking in as a ASP.NET MVC module - but we are unsure as to the best way to actually get the data and essentially 'track' this information ?
If anyone could help out - much appreciated.
Edit: just to be clear, we want to do this in-house and present the stats to our users as an additional fee module?
You can turn on the logging for IIS and then use the SQL Server Report Server Pack for IIS. It comes with many canned reports for your sites stats and then you could take it from there with your own custom reports.
You could also just use log parser to get the stats into a SQL Server DB and then you could use SQL from their to analyse and roll your own app.
Either way, you could modularize this and sell it as an add-on to your customer base.
You could use Piwik, you just need PHP version 5.1.3 or greater and MySQL version 4.1 or greater. As they say in their website, "Piwik aims to be an open source alternative to Google Analytics."
They have a demo on the official website so you can see if it's what you're looking for.
Google analytics is a popular service. You just insert a bit of javascript on every page that contains your sites name and Google tracks the data and provides all the report on a handy web based dashboard.
It's not an ASP.net MVC module like what you mentioned, but it will certain track stats for you and will be a lot simpler to set up than trying to code or integrate anything yourselves.
I'd look at analytics to begin with and only branch out to something more complex if it doesn't meet your requirements.
klabranche provided a holistic answer in terms of using logs of web server. I think using web server log is a a great way to analyse data of your web application.
That being said, depend on your web application and the scope of your analytics, just relay on web server log is not a good way to.
As you may know, web log does not record users behaviors like clicking certain tabs which may not trigger a web server request. Obviously your web log has no idea whether users clicked that tab or not, this may hurt your analyse.
Another you need to know is browser cache, this may create another black hole in your data.
RECAP
If you want to do a holistic analytics, you need to use two approaches, one is JavaScrip tag, another one is web log. Since both of them have shortages, combining them together will give you a complete picture.
Hope this helps