Sr. Big Data Designer

At IRI, we deliver growth to clients based on big data-our predictive analytics and forward-thinking insights help CPG, OTC, health care, retailers, and media companies remain relentlessly relevant, capture marketing share, connect with consumers, and deliver market-leading growth. The convergence of our proprietary, on-demand cloud-based technology and our client-focused colleagues leads to a seismic shift in drivers of success in all industries.

For IRI colleagues, we focus on the moments that matter. From meaningful work and impact to continuous improvement we challenge ourselves to grow both professionally and personally. You'll feel a true sense of connection and purpose in your work and will craft the direction of your career in a highly personalized way. No matter the department you join, you'll find yourself constantly growing and developing the skills of the future to deliver client growth. We believe in the undeniable strength that diverse people, culture, thought, and skill brings to our business, our clients, our people, and our communities. We are committed to nurturing a dynamic culture that embraces and celebrates growth, feedback, recognition, flexibility, belonging, and wellbeing for all.

What will I be doing?

As a Sr Big Data Engineer Designer, you will be responsible for leading the development of client-specific implementations that will run in the client's cloud environment leveraging the industry's leading BI/Analytics solutions, IRI Liquid Data (ILD). This is an end-to-end business intelligence solution that involves highly complex data transformations flowing into the ILD Whitebox-powered data layer, and the ILD Unify reporting application.

You will interface with the client to understand requirements and translate the requirements into technical design. You will then manage and co-develop complex, fully automated data ingestion processes that meet the client's needs. You will also be responsible to debugging and resolving all the data issues that arises during the course of the project.

Job Responsibilities

• Design the data loading pipeline which satisfies the business requirements and also extremely performant and fault tolerant
• Work with Product management team and client ETL teams to thoroughly understand all the datasets and ensure that it meets the business requirements
• Attend daily scrum calls with clients and provide feedback on the progress of all the ETL work
• Lead the offshore and onshore teams and explain the business requirements and design and ensure all ETL tasks are delivered on time
• Help the team in tuning the performance of the ETL jobs to ensure all jobs complete within the stipulated SLA time
• Co-develop all the complex ETL jobs and understand all the internal framework utilities and also build reusable code

• Bachelor's of Science Degree in Computer Science, Data Analytics, or equivalent
• 10+ years Business intelligence industry experience
• 5+ years of Big Data (Hadoop ecosystem) experience
• 2+ years experience leading client-facing projects
• Extensive experience in Linux or Unix OS Big Data scripting languages (Python, Spark, bash)
• Extensive experience aligning data from disparate sources with varying granularity
• 2+ years Azure cloud experience
• Experience working with third-party job schedulers (Control-M, Airflow a plus)
• Eagerness to learn and adapt to evolving Hadoop tooling advancements
• Strong track record in kick-starting, executing, and advancing client-focused projects
• Experience leading offshore development teams
• Strong communication and leadership skills required
• 25% Travel required after COVID restrictions are lifted

About Us
As one of the original innovators in Big Data, IRI integrates the world's largest set of otherwise disconnected purchase, media, social, causal and loyalty data to help CPG, retail, over-the-counter health care and media companies grow their businesses. We combine this data with predictive analytics to uncover new consumer insights and integrate them on the most technologically advanced, cloud-based visualization platform. Learn more

Our Benefits
We offer a comprehensive benefit package (health, paid time off, 401(k), etc.) with additional unconventional offerings such as volunteer time off, flexible work arrangements, virtual doctor access, etc., along with the unrivaled benefit of working with our people - the best in the business.

Our Culture
We're thrilled we get to work on the most interesting business challenges facing the CPG and retail industries. We regularly uncover new "aha moments!" by closely collaborating with our colleagues and developing competencies centered around the following values: Integrity, Servant Leadership, Inclusivity, Accountability, Discipline, Entrepreneurship, and Respect.

IRI is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics. The EEO is the Law poster is available here: DOL Poster. IRI is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process, please send an e-mail to and let us know the nature of your request and your contact information.

#LI-DNP