I'm trying to collect some info, preferably in form of whitepaper or 'best practices manual', on the topic of data management access in large organizations.
I work in on of those, the file structure is extremely complicated and it's becoming more and more challenging to manage access requests to certain folders. Data owners, ACLs inheritance, folder structure etc.
Any suggestions please, online resources or books that you know of?
Thanks
Luka
I'll answer my own question, found a good part of what I was searching for in:
Windows Administration Resource Kit: Productivity Solutions for IT Professionals
and some of that in the Technet database under Data Managment.
If anydody else has any other sources, please share.
Related
I'm writing a report about best practices for data acquisition from existing sources. However, I'm having trouble finding many articles or papers about what I need. Most of what I find is either data acquisition from the source, e.g. a weather station, or gloss over really quickly the part where you talk to a different team about getting access to their data.
Esentially, I'm looking for articles that list some good questions to ask when you talk to other teams in your orginization about getting access to their data so the BI's can use it. Even a search term I could use that would better describe what I'm looking for. At first I thought maybe data wrangling could be it, but all my searches yield articles about manipulating the data to what you need.
To recap, I'm after some pointers to articles or search terms I could use to find the articles that cover a set of best practices that you should follow when talking to other departments about getting access to their databases for BI purposes.
First of all, I recommend paying attention to your search engine, there are many more of them than just Google. In my practice, there are often cases when it was possible to find rare information that could not be found by one search engine, but managed by others.
Here are the results of the query "how the analyst communicates with other departments" from Google search:
A set of tips for a communication analyst -
https://inside.getyourguide.com/blog/2020/7/28/10-tips-on-effective-communication-in-business-intelligence
A set of tips for an analyst on interdepartmental communication -
https://www.phocassoftware.com/business-intelligence-blog/four-ways-to-promote-interdepartmental-communication
An article about communication-oriented modeling to improve the efficiency of an analyst -
https://www.crystalloids.com/news/fully-communication-oriented-information-modelling
And here are the results of the same query but in DuckDuckGo:
A set of general interdepartmental communication tips -
https://www.themuse.com/advice/how-to-communicate-better-with-other-departments
An article on effective communication for an analyst - https://www.northeastern.edu/graduate/blog/communicating-with-data/
A set of tips for an analyst to improve communication skills -
https://www.modernanalyst.com/Resources/Articles/tabid/115/ID/1994/10-Ways-to-Hone-Your-Communication-Skills-as-a-Business-Analyst.aspx
And these are only 2 search engines, and there are also Bing, Ecosia, Yandex, Startpage. With the right query and a variety of search tools, you can get any information of interest.
I'm working on a project at school where we have to create a small system for an RV retailer to track customers, vehicles, employees, inventory, and so on.
We've gotten to the point where we'll need to start coding pretty soon, but I'm having trouble figuring out the logistics of everything. For example, I know enough to build and use the website and database, but I don't have any idea on how to connect the two.
I know SQL fairly well. Enough to know what and where to look for the information, but I don't know enough about connecting my database to know what I'm looking for.
So what I'm looking for is a basic rundown on different options I can look and do some research on what would be best for our group.
I feel like there's a lot of information out there on how to do stuff, but I just don't have the basic information on why it's relevant and how and where to fully utilize it.
I hope this makes sense. Please let me know if there's anything I can do to help clear it up.
One of the options of having a database-driven website is to use PHP.
It is a server-side scripting language, which is used to generate the dynamic content on the webpages. You can connect to the database, obtain user input using for example HTML forms, perform queries and display results on the webpage.
Essentially you build an application with a web-based user interface. PHP is supported on a vast majority of web hosting platforms.
If a user is going to be uploading files to my website how should I store them. Should I just chuck it all in the server and create a folder with the user's username that contain all their files?
Are there any tutorials you would recommend that explains how to do this?
Thanks!
This is quite a vague question in my opinion and highly dependent on your infrastructure, OS, storage type and storage location and the data types you will be storing. It also depends on the amount of data that your application will be handling and the amount of I/Os to disk that you will be doing.
I'm going to continue with a vague assumption that you will be using S3 buckets to satisfy your purposes and would recommend going over this article by Jeff Bar. The article discusses a few performance tips and tricks for using Amazon S3 which can be helpful in more general scenarios/environments.
I'm designing a database and I would appreciate suggestions on maintaining data that describes the tables, attributes, etc. I will make a Database Design Document, but I want something that could be more useful for updating changes to the database schema.
I read an article that suggests using a Data Dictionary in YAML or JSON, but I haven't found much else about the subject.
My questions are: "What alternatives to data dictionaries are there for tracking this data?"
or
"From your professional experience, what is the best way to maintain this data?"
Thanks,
-N
You might find the comment functionality useful, e.g.:
comment on table foo is 'some comments go here';
Found this link about source controlling your databases recently and thought it might help someone in the future. Get your database under version control
Also this link which I mentioned earlier Data Dictionaries
I was wondering if anyone could point me in the direction of some good resources (web sites, technical articles/journals, books, etc.) related to database monitoring/performance?
I am looking to write a paper that explores what kinds of statistics are useful in database monitoring, and to whom they are useful for.
So, I figured I'd ask the experts ...
(In my research, I will be focusing mostly on a PostgreSQL database, but I am looking to gather resources on many different databases).
Any suggestions would be appreciated, thanks!
ConSol-plugins are the de-facto standard when it comes to database monitoring with Nagios:
Oracle
MySQL
MS SQL Server
DB2
Not sure about PostgreSQL, but I've found www.sql-server-performance.com to be a wonderful resource on (MS SQL Server) database tuning.
Here's a page on that site that lists links to various performance-related topics.
http://www.sql-server-performance.com/tips/all_main.aspx
You may be able to apply some of the practices discussed here to PostgreSQL.
I don't think this is a question with a proper answer because your question tries to cover entire database programming domain in one question.
In most cases the database providers release a good set of tools for monitoring analysis purposes. Example : Oracle. You may use them as well.
And a simple google search gave me a hundreds of good resources that seems to be comply with your question.
Example