Data Engineering [DRAFT]

Data Engineering

Our Core Values Behaviors

PROFESSIONAL LEADERSHIP

TEAM LEADERSHIP

Enterprise Architect Data Engineering

Director of Data Engineering

TEAM LEADERSHIP

Data Engineering Sr Manager

Data Engineer Architect

OR

PROFESSIONAL LEADERSHIP

Data Engineering Manager

Date Engineer Principal

Data Engineering Team Lead

Data Engineer Technical Lead

Sr Data Engineer

Data Engineer

Junior Data Engineer

PROFESSIONAL SUPPORT

jr data engineer

Role expectations

• Responsible for collaborating with our technology team to build and maintain our suite of data pipelines, stores, and databases that power sophisticated marketing products used by many of the world's largest advertisers
• Assist in developing and maintaining data processing pipelines for the extraction, transformation, and loading of data from a variety of data sources

• Assist in developing robust and scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable end users to consume and analyze data faster and easier
• Assist in writing SQL queries to support analytics needs
• Work with tools, languages, data processing frameworks, and databases such as Python, SQL, Hadoop, Spark, Hive, Scala
• Work with structured and unstructured data from a variety of data stores, such as data lakes, relational database management systems, and/or data warehouses

Technical competencies

Behavioral competencies

• Basic knowledge of SQL
• Basic command line knowledge and Git
• Basic knowledge of MS SQL Server, PostgreSQL or MySQL
• Basic understanding of Scala, Java, Go, or Python

• Basic analytical and troubleshooting skills
• Excellent verbal and written communication skills
• Self-motivated and results focused
• Learning mindset and able to learn quickly

• Organized and detail-oriented
• Collaborative

data engineer

Role expectations

• Work within robust data systems and develop custom solutions while consulting with external customers
• Optimize and refactor existing code
• Improve the efficiency, scalability, and reliability of applications
• Work with tools, languages, data processing frameworks, and databases such as Python, SQL, Hadoop, Spark, Hive, Scala
• Assist in designing and deploying professional applications using the newest technologies to solve real business problems
• Responsible for collaborating with our technology team to build and maintain our suite of data pipelines, stores, and databases that power sofisticated marketing products used by many of the world's largest advertisers
• Collaborate with engineers, data scientists, data analysts, product teams, and other stakeholders to translate business requirements to technical specifications and coded data pipelines

Technical competencies

Behavioral competencies

• Functional knowledge of SQL, with ability to design and optimize objects
• Experience with Extract, Transform, and Load(ETL)
• Command line knowledge and Git
• Relational Databases: MS SQL Server, Postgres,
• Preferred Lanquaqes: Scala, Java, GoLang, Python
• Luxury Experience: Spark, AWS Technologies

• Strong analytical and troubleshooting skills
• Excellent verbal and written communication skills
• Self-motivated and results focused
• Learning mindset and able to learn quickly
• Organized and detail-oriented
• Able to prioritize, handle multiple projects and meet deadlines
• Collaborative

Senior Data engineer

Role expectations

• Responsible for collaborating with our technology team to build and maintain our suite of data pipelines, stores, and databases that power sophisticated Ad Tech products used by many of the world's largest advertisers
• Design and deploy professional applications using the newest technologies to solve real business problems
• Collaborate with engineers, data scientists, data analysts, product teams, and other stakeholders to translate business requirements to technical specifications and coded data pipelines
• Work within robust data systems and develop custom solutions while consulting with external customers
• Design, deliver and implement data engineering solutions for optimized downstream impact, with end-to-end input and oversight of data engineering projects
• Recommend and implement improvements to data processes and warehouses that improve supportability, usability, and scalability
• Optimize and refactor existing code
• Improve the efficiency, scalability, and reliability of applications

Technical competencies

Behavioral competencies

• Working experience with Spark and AWS technologies
• Proficient with Relational Databases such as MS
• SQL Server, Postgres, MySQL
• Proficient with tech stacks include Scala, Java, GoLang, and/or Python
• Extensive experience working within distributed architectures and building horizontally scalable infrastructure
• Strong business acumen and understanding of business strategy

• Strong analytical, troubleshooting, and problem solving skills
• Excellent verbal and written communication skills
• Self-motivated and results focused
• Learning mindset and able to learn quickly
• Organized and detail-oriented
• Able to prioritize, handle multiple projects and meet deadlines
• Collaborative
• Able to mentor and train junior team members

Data engineer Technical Lead

Role expectations

• Responsible for collaborating with our technology team to build and maintain our suite of data pipelines, stores, and databases that power sophisticated Ad Tech products used by many of the world's largest advertisers
• Lead in the design, build, implementation, and maintenance of data processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources
• Lead the development of robust and scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable end users to consume and analyze data faster and easier
• Write complex SQL queries to support analytics needs
• Evaluate and recommend tools and technologies for data infrastructure and processing
• Lead the collaboration with engineers, data scientists, data analysts, product teams, and other stakeholders to translate business requirements to technical specifications and coded data pipelines
• Nork with tools, languages, data processing frameworks, and databases such as Python, SQL, Hadoop, Spark, Hive, Scala
• Work with structured and unstructured data from a variety of data stores, such as data lakes, relational database management systems, and/or data warehouses

Technical competencies

Behavioral competencies

• Proficient in SQL with ability to design and optimize objects
• Proficient in Extract, Transform, and Load (ETL)
• Proficient in command line knowledge and Git
• Proficient in MS SQL Server, PostgreSQL or MySQL

• Proficient in Scala, Java, Go, Python
• Working knowledge of Spark, AWS Technologies
• Strong business acumen and understanding of products and business strategy

• Advanced analytical, troubleshooting, and problem solving skills
• Storytelling and contextualization
• Self-motivated and results focused
• Learning mindset and able to learn quickly
• Organized and detail-oriented
• Strong prioritization and ability to manage multiple projects and meet deadlines
• Able to train team members

data engineer principal

Role expectations

• Responsible for technical leadership with a broad skill set across data collection, data storage and data science
• Lead technical projects in design & development, and be a strong technical leader and mentor for the team
• Own in the design, deployment, and management of the organization's data architecture

• Collaborate with technology and management teams to understand structural requirements and define standards for how data will be stored, consumed, integrated, and managed across the organization and translate into a usable blueprint
• Build an inventory of data needed to implement architecture and create a vision for how data will flow through the organization
• Lead the design and build of complex data models, approve modifications, and implement systems
• Implement measures to ensure data accuracy and accessibility, constantly monitoring and refining the performance of data management systems
• Produce and enforce database development standards
• Possess strong understanding of data modeling tools and standards, ETL tools, and big data technologies (e.g., Hadoop, Spark, Pig, NoSQL)

Technical competencies

Behavioral competencies

• Experience with machine learning techniques and advanced analytics
• Experience with big data using technologies like Hadoop, Hive, and Spark

• Strong business acumen and understanding of products and business strategy

• Proficient in Spark, AWS Technologies, Python

• Expert in the following: SQL with ability to design and optimize objects

• Extract, Transform, and Load (ETL)

• Command line knowledge and Git

• MS SQL Server, PostgreSQL or MySQL

• Scala, Java, Go, Python

• Critical thinking and solution oriented
• Impactful storytelling and contextualization
• Self-motivated and results focused
• Advanced prioritization and ability to manage multiple projects and meet deadlines
• Adaptable and agile to change directions quickly
• Advanced ability to build teams and mentor and coach team members
• Curiosity and critical thinking

data engineer architect

Role expectations

• Responsible for technical leadership with a broad skill set across data collection, data storage and data science
• Lead technical projects in design & development, and be a strong technical leader and mentor for the team
• Own in the design, deployment, and management of the organization's data architecture

• Collaborate with technology and management teams to understand structural requirements and define standards for how data will be stored, consumed, integrated, and managed across the organization and translate into a usable blueprint
• Build an inventory of data needed to implement architecture and create a vision for how data will flow through the organization
• Lead the design and build of complex data models, approve modifications, and implement systems
• Implement measures to ensure data accuracy and accessibility, constantly monitoring and refining the performance of data management systems
• Produce and enforce database development standards
• Possess strong understanding of data modeling tools and standards, ETL tools, and big data technologies (e.g., Hadoop, Spark, Pig, NoSQL)

Technical competencies

Behavioral competencies

• Effective storytelling and contextualization
• Self-motivated and results focused
• Strong prioritization and ability to manage multiple projects and meet deadlines
• Adaptable and agile to change directions quickly
• Effective collaborator
• Ability to train team members
• Curiosity and critical thinking

• Experience with machine learning techniques and advanced analytics
• Experience with big data using technologies like Hadoop, Hive, and Spark

• Strong business acumen and understanding of products and business strategy

• Proficient in Spark, AWS Technologies, Python

• Expert in the following: SQL with ability to design and optimize objects

• Extract, Transform, and Load (ETL)

• Command line knowledge and Git

• MS SQL Server, PostgreSQL or MySQL

• Scala, Java, Go, Python

Enterprise architect data engineering

Role expectations

• Responsible for technical leadership with a broad skill set across data collection, data storage and data science
• Lead technical projects in design & development, and be a strong technical leader and mentor for the team

• Direct/oversee the design, deployment, and management of the organization's data architecture

• Collaborate with technology and management teams to understand structural requirements and define standards for how data will be stored, consumed, integrated, and managed across the organization and translate into a usable blueprint

• Build an inventory of data needed to implement architecture and create a vision for how data will flow through the organization

• Design and build complex data models, approve modifications, and implement systems

• Implement measures to ensure data accuracy and accessibility, constantly monitoring and refinina the performance of data management systems

• Lead meetings to present analysis, insights, and recommendations to stakeholders

• Implement data strategies and manage projects and resources; produce and enforce database development standards

• Possess strong understanding of data modeling tools and standards, ETL tools, and big data technologies (e.g., Hadoop, Spark, Pig, NOSQL)

Technical competencies

Behavioral competencies

• Deep understanding of big data using technologies like Hadoop, Hive, and Spark
• Strong coding fundamentals with experience in GoLang, C, C++, or Java
• Experience developing large scale data applications
• Expert in: Extract, Transform, and Load (ETL), Command line knowledge and Git, MS SQL Server, PostgreSQL or MySQL, Scala, Java, Go, Python, Spark, AWS Technologies, Python

• Critical thinking and solution oriented
• Impactful storytelling and contextualization
• Self-motivated and results focused
• Expert prioritization and ability to manage multiple projects and meet deadlines
• Adaptable and agile to change directions quickly
• Expert ability to train team members
• Curiosity and critical thinking

data engineering team lead

Role expectations

• Responsible for collaborating with our technology team to build and maintain our suite of data pipelines, stores, and databases that power sophisticated Ad Tecl products used by many of the world's largest advertisers
• Support of a variety of analytic solutions
• Oversee the creation and delivery of high-quality engineering, and work to grow analytics offerings
• Partner with stakeholders to understand data requirements and with internal and/or external resources to develop tools and services such as segmentation, modeling, dashboard development, decision aids, and business case analysis to support the organization
• Ensure data integrity by implementing quality assurance practices
• Lead meetings to present analysis, insights, and recommendations to stakeholders
• Implement data strategies and manage projects and resources
• Identify and define both process and data improvements
• Ensure compliance with deliverable reporting requirements by performing quality data audits and analysis
• Lead team members, including involvement with hiring and termination decisions, performance evaluations, and day-to-day coaching and training

Technical competencies

Behavioral competencies

• Advanced analytical, troubleshooting, and problem solving skills
• Demonstrated storytelling and contextualization
• Self-motivated and results focused
• Learning mindset and able to learn quickly
• Organized and detail-oriented
• Strong prioritization and ability to manage multiple projects and meet deadlines
• Adaptable and agile to change directions quickly

• Proficient in SQL with ability to design and optimize objects
• Proficient in Extract, Transform, and Load (ETL)
• Proficient in command line knowledge and Git
• Proficient in MS SQL Server, PostgreSQL or MySQL

• Proficient in Scala, Java, Go, Python
• Proficient with Spark, AWS Technologies
• Strong business acumen and understanding of products and business strategy

data engineering manager

People Leader

Role expectations

• Responsible for collaborating with our technology team to build and maintain our suite of data pipelines, stores, and databases that power sophisticated Ad Tech products used by many of the world's largest advertisers
• Support a variety of analytic solutions
• Oversee the creation and delivery of high-quality engineering, and work to grow analytics offerings
• Partner with stakeholders to understand data requirements and with internal and/or external resources to develop tools and services such as segmentation, modeling, dashboard development, decision aids, and business case analysis to support the organization
• Ensure data integrity by implementing quality assurance practices
• Lead meetings to present analysis, insights, and recommendations to stakeholders Implement data strategies and manage projects and resources Identify and define both process and data improvements
• Ensure compliance with deliverable reporting requirements by performing quality data audits and analysis
• Lead team members, including involvement with hiring and termination decisions, performance evaluations, and day-to-day coaching and training

Technical competencies

Behavioral competencies

• Advanced in SQL with ability to design and optimize objects
• Advanced in Extract, Transform, and Load (ETL)
• Advanced in command line knowledge and Git
• Advanced in MS SQL Server, PostgreSQL or MySQL
• Advanced in Scala, Java, Go, Python
• Experience with Spark, AWS Technologies
• Strong business acumen and understanding of products and business strategy

• Effective storytelling and contextualization
• Self-motivated and results focused

• Strong prioritization and ability to manage multiple projects and meet deadlines

• Adaptable and agile to change directions quickly

• Effective collaborator

• Strong mentoring, coaching, and training team members

• Curiosity and critical thinking

• Motivation and team empowerment

• Ability to identify and attract new talent

data engineering sr manager

People Leader

Role expectations

• Responsible for hands-on leadership with a broad skill set across data collection, data storage and data science
• Lead technical projects in design & development, and be a strong leader and mentor for the team
• Support of a variety of analytic solutions

• Oversee the creation and delivery of high-quality analysis, and work to grow analytics offerings

• Partner with stakeholders to understand data requirements and with internal and/or external resources to develop tools and services such as segmentation, modeling, dashboard development, decision aids, and business case analysis to support the organization

• Ensure data integrity by implementing quality assurance practices

• Lead meetings to present analysis, insights, and recommendations to stakeholders

• Implement data strategies and manage projects and resources

• Identify and define both process and data improvements

• Ensure compliance with deliverable reporting requirements by performing quality data audits and analysis

• Lead team members, including involvement with hiring and termination decisions, performance evaluations, and day-to-day coaching and training

Technical competencies

Behavioral competencies

• Experience with machine learning techniques and advanced analytics
• Experience with big data using technologies like Hadoop, Hive, and Spark
• Strong business acumen and understanding of products and business strategy
• Proficient SQL knowledge with MS SQL Server, PostgreSQL or MySQL
• Proficient in Scala, Java, Go, Python
• Proficient in Spark, AWS Technologies

• Critical thinking and solution oriented
• Impactful storytelling and contextualization
• Self-motivated and results focused
• Advanced prioritization and ability to manage multiple projects and meet deadlines
• Adaptable and agile to change directions quickly
• Advanced ability to build teams and mentor and coach team members
• Curiosity and critical thinking
• Motivation and team empowerment

director of data engineering

People Leader

Role expectations

• Responsible for hands-on leadership with a broad skill set across data collection, data storage and data science
• Lead technical projects in design & development, and be a strong leader and mentor for the team
• Collaborate with leadership to define our go forward Data strategy including new architectures and approaches to data collection, storage, retention and usage across the organization
• Oversee design and development of new and innovative data architectures to support business growth
• Ensure integration of data collection with data science requirements both for model development and real-time model execution
• Partner with peers to ensure quality data software releases
• Deploy and maintain critical applications on cloud-native microservices architecture
• Work collaboratively with multiple agile teams to help deliver end-to-end products and features, seeing them through from conception to delivery
• Lead the data team and ensure they meet all goals and objectives, providing training and mentoring where needed
• Lead team members, including involvement with hiring and termination decisions, performance evaluations, and day-to-day coaching and training

Technical competencies

Behavioral competencies

• Deep understanding of big data using technologies like Hadoop, Hive, and Spark• Strong coding fundamentals with experience in GoLang, C, C+t, or Java• Experience developing large scale data applications• Expert in: Extract, Transform, and Load (ETL), Command line knowledge and Git, MS SQL Server, PostgreSQL or MySQL, Scala, Java, Go, Python, Spark, AWS Technologies, Python)

• Critical thinking and solution oriented
• Impactful storytelling and contextualization
• Expert prioritization and ability to manage multiple projects and meet deadlines
• Adaptable and agile to change directions quickly as needed

• Expert ability to build teams and mentor and coach team members

• Curiosity and critical thinking
• Motivation and team empowerment