About the Opportunity
The AWS Data Engineer is responsible for designing, implementing, and managing the Data pipelines for moving on-premise data to Amazon S3 and Redshift using AWS toolsets for replication and ingestion in order to support the Data, Visualization, and Analytics platform needs of the System Office and partnering institutions. Primary job duties include the following:

Design, Architect, and Develop Data Pipelines:

• Design and Architecture: Collaborate with stakeholders to understand data requirements and design efficient ETL pipelines using AWS toolsets such as AWS Glue, AWS Data Pipeline, or other relevant services.
• Data Extraction: Develop strategies for extracting data from various on-premise sources such as databases, files, and APIs, ensuring data integrity and performance.
• Transformation: Implement data transformation logic to cleanse, enrich, and structure data according to business needs, utilizing tools like AWS Glue, Apache Spark, or custom scripts.
• Data Loading: Configure and optimize data loading processes into Amazon S3 and Redshift, leveraging AWS services like Amazon Kinesis, AWS Database Migration Service (DMS), or other suitable solutions.
• Automation and Orchestration: Build automated ETL workflows and orchestration mechanisms using AWS services like AWS Step Functions or AWS Lambda to ensure seamless data movement and processing.
• Collaboration and Support: Work closely with cross-functional teams including Data Analysts, Data Scientists, and Business Intelligence Engineers to support their data needs and enable data-driven decision-making.
  

Optimizing Performance & Security:

• Utilize CI/CD DataOps approaches to building and scaling data products.
• Performance Tuning: Monitor and optimize ETL pipeline performance, identifying bottlenecks and implementing optimizations to enhance throughput, reliability, and scalability.
• Data Governance and Security: Implement data governance policies and security controls to ensure compliance with regulatory requirements and protect sensitive data during transit and storage.
• Documentation and Maintenance: Maintain comprehensive documentation for ETL processes, including data mappings, transformations, and pipeline configurations. Conduct regular maintenance activities to ensure the reliability and efficiency of ETL workflows.

This position may be eligible for a hybrid or remote work arrangement, consistent with System Office policy. This position is eligible for the System Office's performance-based bonus award program, which is offered annually contingent upon budgetary resources pursuant to UNC System's non-base salary compensation policy for EHRA employees.

About the UNC System Office
The UNC System Office includes the offices of the President and other senior administrators of the multi-campus University of North Carolina System. The UNC System is a treasured public institution dedicated to serving the people of North Carolina through world-class teaching, research, and community engagement. Today, nearly 250,000 students are enrolled in our 16 universities across the state and at the NC School of Science and Mathematics. System Office staff is responsible for executing the policies of the UNC Board of Governors and providing University-wide leadership in the areas of academic affairs, business and financial management, long-range planning, student affairs, research, legal affairs, and government relations. The UNC System Office also has administrative oversight of a number of University affiliates, including PBS North Carolina, the North Carolina Arboretum, the NC State Education Assistance Authority, and University of North Carolina Press.

About the Team
The Information Technology division works collaboratively with UNC constituent institutions to help ensure efficient and cost-effective integration of new technologies that meet common and unique needs of the 17 institutions. The division is also charged with managing the highly complex enterprise-wide data modernization efforts that will enable the System to better monitor, evaluate, and manage our enterprise; as well as facilitate timely comparisons across the 17 institutions and create better data-sharing capabilities for smarter and more efficient data-driven decisions.

Minimum Education, Experience, and Skills
Master's or Bachelors and 0-2 years' experience; or will accept a combination of related education and experience in substitution.

Required Competencies
*Advanced AWS training desired *Proven experience in designing and implementing Data pipelines using AWS toolsets such as AWS Glue, AWS Data Pipeline, AWS Kinesis, etc. *Strong proficiency in SQL and scripting languages (e.g., Python, Bash) for data manipulation and automation *Hands-on experience with AWS services including Amazon S3, AWS Lambda, AWS Step Functions, etc. *Data Modeling in Amazon Redshift, provisioning accounts, managing delineation of access with multitenant data sharing approaches in mind *Familiarity with data warehousing concepts and best practices, particularly in the context of AWS Redshift *Excellent problem-solving skills with the ability to troubleshoot complex ETL issues and performance optimizations *Strong communication and collaboration skills with the ability to work effectively in a team environment

Preferred Education, Experience, and Skills
*AWS certification(s) such as AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect *Experience with data modeling techniques and data visualization tools (e.g., Tableau, Power BI) *Knowledge of other ETL technologies and platforms outside of the AWS ecosystem *Familiarity with Agile development methodologies and DevOps practices *Knowledge of other cloud providers (e.g., Azure, Google Cloud Platform) and multi-cloud architecture best practices

• Classification: IT Architect/Engineer I
• Appointment Type: Permanent
• Full-Time/Part-Time: Full-Time
• Employment Type: EHRA
• EHRA Category: Exempt Professional Staff (EPS)
• Location: Raleigh, NC USA
• Position Number: 20064047
• Special instructions to applicants: The position remains open until filled, but applications received by May 31, 2024 will be given priority consideration.

Equal Employment Opportunity and Other Information
The UNC System Office (includes PBS NC, NCSEAA, and NC Arboretum) is an equal opportunity and affirmative action employer. All qualified applicants will receive consideration for employment without regard to age, color, disability, gender identity, genetic information, national origin, race, religion, sex, sexual orientation, or status as a protected veteran.
The UNC System Office (includes PBS NC, NCSEAA, and NC Arboretum) is a VEVRAA Federal Contractor.
To claim veteran's preference, all eligible persons must indicate their eligibility as requested on the application. A DD Form 214, Certificate of Release or Discharge from Active Duty, may be required later in the selection process.
The UNC System Office (includes PBS NC, NCSEAA, and NC Arboretum) participates in E-Verify. Federal law requires all employers to verify the identity and employment eligibility of all persons hired to work in the United States.

Human Resources Contact Information
Applicants needing assistance with the application process are asked to contact: recruiter@northcarolina.edu.