Do we need DBAs in 2023?

Introduction :

Over the past months, people asked me more and more questions about the DBA role and the underlying question was often: Are we witnessing the end of the DBA role in IT?
My first answer, after a big laugh, was that DEVOPS didn’t get rid of sysadmins, it is not going to get rid of DBAs, especially with the rise of AIOPS, although changes occurred. For example, system administrators who are still sticking to RDP in a full Windows environment and don’t want to automate deployment are going to have more and more trouble complying to the business needs. A sysadmin has to do more than a few years back and has more responsibilities nowadays.
For DBAs it is a bit the same in my eyes. The daily work might change but the responsibilities are going to increase more and more, so is the expertise.
As a DBA consultant, I see and hear about a lot of business cases in all kinds of environments, so I witness firsthand all the tendencies and the interrogations of involved people.
But let’s take a step back and look at the evolution of IT and data management in order to put in perspective what is actually happening to organizations around the DBA.

The Evolution of IT Infrastructure and Data Management

Every company goes through various stages of IT and data management maturity. To understand this better, here’s a brief overview:

1. Startup Phase:
   At this stage, businesses often operate with minimal IT infrastructure, relying on personal computers and basic software applications. Data might be housed in simple spreadsheets.
2. Small Business Phase:
   As the company grows, there’s a shift towards more formal IT setups. This might include dedicated servers, the beginnings of a LAN, and more advanced database systems.
3. Growth Phase:
   At this point, companies are looking at data centers, cloud solutions, and enterprise software. Comprehensive database solutions become the norm, emphasizing data backups and disaster recovery.
4. Expansion Phase:
   The IT setup becomes more intricate, incorporating larger data centers, enhanced security, and advanced data management techniques like warehousing and analytics.
5. Matured/Enterprise Phase:
   Companies now explore hybrid cloud solutions, integrate AI, and have dedicated IT teams. Data governance, master data management, and big data solutions come into play.
6. Innovation and Optimization Phase:
   This phase is about embracing new paradigms, integrating AI into processes, and focusing on real-time analytics.
7. Continuous Adaptation:
   Companies continuously evaluate and adopt emerging technologies, emphasizing real-time data processing and AI-driven insights.

Across all these stages, the themes of security, compliance, scalability, and flexibility remain critical.
In my little experience, I have come across a lot of cases where the level of maturity although critical on the IT side was not aligned with most other services within a company/organization. The tricky part is to maintain the same level of maturity and capabilities across the entire company. In that sense you can have a huge company with thousands of employees but with an IT infrastructure of a small startup. The opposite is unlikely because most of the time IT is often seen as a cost rather than an investment.

So with that in mind, what is happening to the DBA role itself ?

Tendencies for a changing role

• Growing Amount of Data:
  The amount of data that companies and organizations produce, process, and store continues to grow exponentially. This proliferation of data can necessitate the need for more DBAs to ensure databases are optimized, maintained, and backed up appropriately.
• Complexity of Databases:
  As databases evolve to handle a greater variety of data types (like NoSQL databases handling unstructured data), and as distributed database systems become more common, the complexity of managing these systems grows. This can increase the demand for specialized DBAs.
• Shift to the Cloud:
  Many organizations are moving their infrastructure, including databases, to cloud platforms. This transition can reduce the need for traditional DBAs in some cases because cloud service providers handle some of the typical DBA responsibilities. However, there’s still a need for cloud-savvy DBAs to manage configurations, ensure data security, and optimize performance in cloud environments. In addition to that, costs-related issues tend to push people on hybrid infrastructure and not just on full cloud. This means a higher level of complexity.
• Automation:
  Tools and platforms are increasingly automating routine DBA tasks. Automation can reduce the need for DBAs to handle mundane tasks, but it doesn’t eliminate the need for experts to manage more complex issues, implement best practices, and make strategic decisions about data management.
  What to understand from the previous point is that people (product owners, stakeholders,…) get accustomed to automation in cloud environment and IT management is requesting the same level of automation on-premise. This is also pushing DBA and sysadmins towards automation at all levels. That’s one of the good aspects of having big tech companies proving on a daily basis that highly automated infrastructure is possible.
• Emergence of Data Engineering and DevOps:
  Some responsibilities that used to fall squarely under the DBA’s domain are now being handled by data engineers or DevOps teams. These roles focus on building data infrastructure, optimizing pipelines, and ensuring seamless deployment of database-related changes. This can influence the traditional demand for DBAs.
• Data Security Concerns:
  With increasing data breaches and stricter data protection regulations worldwide, there’s a greater emphasis on securing data. DBAs with expertise in security can be in high demand.
• Data is Essential:
  Almost every business and organization relies on data for decision-making, operations, and customer engagement. Reliable and efficient databases are crucial for these activities, so the role of the DBA remains vital.

Why Is a DBA still Essential?

• For System Administrators:
  Whenever there’s maintenance, an update, a security policy, or a performance issue, a DBA is needed. They ensure that the database’s integrity is maintained and that it performs optimally.
• For Developers:
  Crafting efficient and complex SQL Queries can be tricky. Even if in recent years frameworks helped a lot, they are often not reliable on complex business logic. A DBA helps developers navigate the intricacies of query optimization, shedding light on the workings of database optimizers. One other trending aspect is the will to implement CI/CD on the database side. With the growth of DEVOPS and the emergence of AIOPS, developers want to push further into the RDBMS world and make new mistakes 🙂
• For Security Officers:
  Security in databases is paramount. A DBA can audit environments, tighten security protocols, and advise on best practices.
• For Data Professionals:
  Data engineers, analysts, and scientists, when trying to move beyond basic CSV files, require the expertise of a DBA to optimize data flows.
• For CTOs:
  Making strategic decisions, such as selecting the right RDBMS solution or considering a move to the cloud, requires the insights and expertise of a DBA.
• For DBAs Themselves:
  The field of database administration is vast, with many specializations. Just as doctors of different specialties consult with each other, DBAs too seek peers’ insights to navigate the complexities of their field.

Wrapping Up

While certain aspects of the traditional DBA role might be diminishing or evolving due to technological advancements and changes in IT practices, there’s still a significant need for skilled professionals who understand databases deeply. The title “DBA” might evolve, and the exact responsibilities might shift, but expertise in database management remains crucial. If you’re considering a career as a DBA or related role, focusing on continuous learning and adapting to industry changes will be key.
In a world that’s increasingly data-driven, the role of the DBA is more important than ever. They’re not just gatekeepers of data; they’re instrumental in ensuring that data drives business growth, innovation, and success.
Whether you’re a startup or an established enterprise, if you’re dealing with data (and who isn’t?), you need a DBA.
If you are a DBA, changes will arrive with highly automated infrastructures based on DEVOPS and AIOPS logic, which is a good thing because we might stop playing around with those backup scripts and maybe try to tackle some more valuable issues. We will grow with our organization’s needs as always and SQL will still be valuable 30 years from now.
Change is coming…

An Oracle DBA in his shiny armor :