Senior Data Engineer
AI in this role
Senior data engineer focusing on database architecture, ETL pipelines, and supporting AI/ML initiatives with data infrastructure.
About Gartner IT:
Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients. We make a broad organizational impact by delivering cutting-edge technology solutions that power Gartner. Gartner IT values its culture of nonstop innovation, an outcome-driven approach to success, and the notion that great ideas can come from anyone on the team.
About the role:
We are seeking a highly experienced Senior Data Engineer to join our team, with a primary focus on database architecture, optimization, and management. The ideal candidate will have at least 4+ years of robust, hands-on experience in PostgreSQL (preferably AWS RDS), advanced SQL, and database development, as well as deep expertise in designing and managing ETL data pipelines. Experience with both batch and event-driven data processing is essential. Strong Python skills for data engineering, and familiarity with AWS Glue, AWS Batch, AWS S3, CI/CD tools (Jenkins, Git), and AI-related technologies are also required.
What you will do:
- Architect, develop, and maintain robust database structures (tables, views, procedures, functions, packages) with a focus on PostgreSQL (AWS RDS).
- Optimize database performance, write and debug complex SQL queries, and ensure reliability and scalability of the database layer.
- Design, build, and manage ETL pipelines using Python and AWS Glue/Batch, integrating with AWS S3 for data storage and retrieval.
- Develop and maintain procedures, packages, and scripts for data migration and processing large volumes of structured and unstructured data.
- Implement both batch and event-driven data processing architectures.
- Collaborate with stakeholders to deliver secure, high-quality data solutions that meet business requirements.
- Implement and maintain CI/CD pipelines, automate deployments with Jenkins, and manage code repositories using Git.
- Support AI and machine learning initiatives by preparing, processing, and managing data for model training and inference.
- Monitor, troubleshoot, and resolve data engineering and database issues as they arise.
What you will need :
Strong IT professional with 4-6 yrs of experience in software development for data engineering using Python, AWS. The candidate should have strong problem-solving skills along with high on ownership and accountability.
Must have:
- 4+ years of robust, hands-on experience in data engineering, with a strong focus on PostgreSQL (AWS RDS).
- Proven expertise in architecting, optimizing, and maintaining complex database solutions using PostgreSQL.
- Extensive experience developing and maintaining database objects (tables, views, procedures, functions, packages).
- Deep proficiency in designing and managing ETL data pipelines, leveraging Python and AWS Glue/Batch.
- Demonstrated experience with both batch and event-driven data processing architectures.
- Hands-on experience with AWS S3 for data storage and integration.
- Experience with data migration and processing of large datasets (structured and unstructured).
- Familiarity with CI/CD pipelines, Jenkins, and Git for automated deployments and version control.
- Strong problem-solving, communication, and collaboration skills.
- Experience with AI and machine learning libraries and frameworks is a plus.
Who you are:
Bachelor’s degree or foreign equivalent degree in Computer Science or a related field required
Excellent communication and prioritization skills.
Able to work independently or within a team proactively in a fast-paced AGILE-SCRUM environment.
Owns success – Takes responsibility for successful delivery of the solutions.
Strong desire to improve upon their skills in software development, frameworks, and
Don’t meet every single requirement? We encourage you to apply anyway. You might just be the right candidate for this, or other roles.
Who are we?
At Gartner, Inc. (NYSE:IT), we guide the leaders who shape the world.
Our mission relies on expert analysis and bold ideas to deliver actionable, objective business and technology insights, helping enterprise leaders and their teams succeed with their mission-critical priorities.
Since our founding in 1979, we’ve grown to 20,000 associates globally who support over 13,000 client enterprises in ~90 countries and territories. We do important, interesting and substantive work that matters. That’s why we hire associates with the intellectual curiosity, energy and drive to want to make a difference. The bar is unapologetically high. So is the impact you can have here.
What makes Gartner a great place to work?
Our vast, virtually untapped market potential offers limitless opportunities – opportunities that may not even exist right now – for you to grow professionally and flourish personally. How far you go is driven by your passion and performance.
We hire remarkable people who collaborate and win as a team. Together, our singular, unifying goal is to deliver results for our clients.
Our teams are inclusive and composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations.
We invest in great leaders who bring out the best in you and the company, enabling us to multiply our impact and results. This is why, year after year, we are recognized worldwide as a great place to work.
Gartner is the world authority on AI
At Gartner, you’ll join a company at the very center of the AI revolution. Gartner has proactive, objective guidance throughout clients’ AI journeys. We set the standard for how organizations leverage artificial intelligence to drive meaningful impact. You’ll have access to unmatched resources, expertise, and technology, and play a key role in helping Gartner and our clients innovate and grow as we leverage AI to transform business and technology landscapes.
It’s an exciting time to be at Gartner, with limitless opportunities to make a real impact, grow your skills, and build a lasting, meaningful career in a field that’s reshaping the way we operate. If you’re passionate about AI and want to be part of a team that’s guiding the leaders who shape the world, Gartner is the place for you.
What do we offer?
Gartner offers world-class benefits, highly competitive compensation and disproportionate rewards for top performers.
In our hybrid work environment, we provide the flexibility and support for you to thrive — working virtually when it's productive to do so and getting together with colleagues in a vibrant community that is purposeful, engaging and inspiring.
Ready to grow your career with Gartner? Join us.
The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status, or any other legally protected status and to seek to advance the principles of equal employment opportunity.
Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company’s career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at +1 (203) 964-0096 or by sending an email to ApplicantAccommodations@gartner.com.
Job Requisition ID:113580By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.
Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy
For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.
How we rate this
Senior Data Engineer at Gartner rates 60 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where data engineering was part of your work. What did you do?
- Tell me about a project where database architecture was part of your work. What did you do?
- Tell me about a project where etl was part of your work. What did you do?
- Tell me about a project where sql was part of your work. What did you do?
- Tell me about a project where ci cd was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Data Engineering, Database Architecture, ETL, SQL, and Ci Cd. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project — this role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get a free CV reviewGet new data engineer jobs (Works on AI ●●●○ or higher) by email
One email a week with the new data engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Data roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step