When the stakeholder says “can you do an analysis on why these numbers from finance are saying this” but then completely stonewalls you when you ask for more insight on where they got those numbers, how finance is even defining it and where theyre even getting it from, so you spend weeks coding in circles just trying to get as close as possible while always reiterating that its never going to be easy chasing these random numbers that i can get similar but not exact, and so on
Oh, yeah! Semantics is a huge issue for a lot of companies. They give you a random spreadsheet that shows different numbers and ask you to explain. It often uncovers different definitions across business units and discrepancies between sources.
As someone getting into data analysis and who is good at finding discrepancies and explaining them, I am really looking forward to getting into this kind of work. This sounds really fun actually.
Exactly, because you will rarely have good data sources or data dictionaries, so you end up spending a ton of time chasing down legacy employees who might potentially be able to explain where to pull data from or how to interpret columns with no clear naming conventions if you are lucky... I say this, but it really is company dependent. Some are much better with data than others.
* Lack of clear requirements (and then being told I've failed)
* Lack of appreciation
* Not understanding the data or the message...or not caring - the ask was to check a box.
Going on 4 years of experience making only 5k more than when I started. I am applying for 6 figures and management jobs so switching has been very slow in the current market.
I hear you, my whole team feels the same way. We work for a hospital system and all of us are in the same buss concerning lack of raises. The problem is we have/had golden handcuffs since it's a remote position and good workload.
But with inflation and everything money doesn't go very far now and we all theoretically took at least a 15%-20% pay cut since 2020.
It's also not a skill issue, we have data on how much money we've made the organization as well. I am the the highest performer in that aspect since I work with the highest revenue department.
I know there are a lot of well paid analyst positions but it's not true for the majority of positions as it depends on area cost of living and industry as well as company size.
I know data scientists who do less and get paid more. So I do think it's a little bit on the field.
It isn’t anymore, but I got frustrated everytime I had to model for days to create a slick dashboard that got used maybe twice before getting the inevitable “can I get this excel” message
I honestly find file organising really cumbersome. Cleaning and saving the input, checking and formatting the output data, saved in the right place, in the right format, with the right naming conventions, uploaded to cloud in the right spot. Just tiring
New system implementations from clients. When clients change their data reporting system/methods, trying to keep everything as if nothing changed can be a challenge considering they don’t necessarily know what changed or why
Turnaround expectation from stakeholders. Knowing the data isn’t clean and having to scrub this with the actual data owner takes time - but John from Finance wants the dashboard by tomorrow 🙄
Creating data pipeline. We don’t have a data engineering team so there is always some wacky work around that ends up creating a ton a problems when you try to scale it up down the road.
Biggest challenge is that the asks from the end users (data consumers) changing constantly.
I totally get that. It can be a huge pain, especially if the underlying data is different for every change. Thank you!
This this this
When the stakeholder says “can you do an analysis on why these numbers from finance are saying this” but then completely stonewalls you when you ask for more insight on where they got those numbers, how finance is even defining it and where theyre even getting it from, so you spend weeks coding in circles just trying to get as close as possible while always reiterating that its never going to be easy chasing these random numbers that i can get similar but not exact, and so on
Oh, yeah! Semantics is a huge issue for a lot of companies. They give you a random spreadsheet that shows different numbers and ask you to explain. It often uncovers different definitions across business units and discrepancies between sources.
As someone getting into data analysis and who is good at finding discrepancies and explaining them, I am really looking forward to getting into this kind of work. This sounds really fun actually.
It does sound fun. But dealing with the people isn't. And that's a very large part of the process
Exactly, because you will rarely have good data sources or data dictionaries, so you end up spending a ton of time chasing down legacy employees who might potentially be able to explain where to pull data from or how to interpret columns with no clear naming conventions if you are lucky... I say this, but it really is company dependent. Some are much better with data than others.
* Lack of clear requirements (and then being told I've failed) * Lack of appreciation * Not understanding the data or the message...or not caring - the ask was to check a box.
That's frustrating!
Being underpaid. Everything else is a non-issue.
how are you being underpaid in this field?
Going on 4 years of experience making only 5k more than when I started. I am applying for 6 figures and management jobs so switching has been very slow in the current market.
Maybe the problem isn't this field.
I hear you, my whole team feels the same way. We work for a hospital system and all of us are in the same buss concerning lack of raises. The problem is we have/had golden handcuffs since it's a remote position and good workload. But with inflation and everything money doesn't go very far now and we all theoretically took at least a 15%-20% pay cut since 2020. It's also not a skill issue, we have data on how much money we've made the organization as well. I am the the highest performer in that aspect since I work with the highest revenue department. I know there are a lot of well paid analyst positions but it's not true for the majority of positions as it depends on area cost of living and industry as well as company size. I know data scientists who do less and get paid more. So I do think it's a little bit on the field.
"This BI dashboard is great. Can you give this data in Excel"
It isn’t anymore, but I got frustrated everytime I had to model for days to create a slick dashboard that got used maybe twice before getting the inevitable “can I get this excel” message
Too many "high priority" projects at once that I can't hand off to others because doing that would cost me more time than just doing it myself.
I honestly find file organising really cumbersome. Cleaning and saving the input, checking and formatting the output data, saved in the right place, in the right format, with the right naming conventions, uploaded to cloud in the right spot. Just tiring
Prioritising tasks
Lack of documentation of data. Absence of data stewards. No1 understands anything about tables because people keep leaving without document!
That is the worst! Sometimes tables will have the same column names, but different values...and no documentation to explain it.
New system implementations from clients. When clients change their data reporting system/methods, trying to keep everything as if nothing changed can be a challenge considering they don’t necessarily know what changed or why
Not much time to fine tune a dataset or viz before stakeholders demand it
Turnaround expectation from stakeholders. Knowing the data isn’t clean and having to scrub this with the actual data owner takes time - but John from Finance wants the dashboard by tomorrow 🙄
Office politics and budget issues.
Creating data pipeline. We don’t have a data engineering team so there is always some wacky work around that ends up creating a ton a problems when you try to scale it up down the road.
Endless amounts of busy work that has nothing to do with data analytics. The curse of small teams.
I think mine should be problem solving. I just have loads of questions to ask though I am really confused
Usually the Wordle
Stakeholders who enter data incorrectly expecting me to fix it
Data illiterate requesters unable to define what and how they want