Data Analyst
Issaquah, WA
Contracted to Full Time
Experienced
Location: Remote during contracting period; onsite 3x/week in Issaquah, WA or Dallas, TX upon conversion to FTE
Job Type: 3 Month CTH
Job Description:
The Data Engineer is responsible for developing and maintaining data pipelines and/or data integrations across the In Warehouse Manufacturing stack. This includes data ingestion, data transformation, data validation/quality, data pipeline optimization, orchestration; and engaging with DevOps Engineer during CI/CD. This is a new team and will be fast paced, highly visible, supporting the business goals by being an industry leader in this space. This role is focused on data engineering to build and deliver automated data pipelines to and from various data sources, primarily iSeries to and from Microsoft Dynamics 365. The Data Engineer will partner with product owners, engineering and data platform teams as needed to design, build, test and automate data pipelines that are relied upon across the company as the single source of truth.
Job Duties/Essential Functions:
Job Type: 3 Month CTH
Job Description:
The Data Engineer is responsible for developing and maintaining data pipelines and/or data integrations across the In Warehouse Manufacturing stack. This includes data ingestion, data transformation, data validation/quality, data pipeline optimization, orchestration; and engaging with DevOps Engineer during CI/CD. This is a new team and will be fast paced, highly visible, supporting the business goals by being an industry leader in this space. This role is focused on data engineering to build and deliver automated data pipelines to and from various data sources, primarily iSeries to and from Microsoft Dynamics 365. The Data Engineer will partner with product owners, engineering and data platform teams as needed to design, build, test and automate data pipelines that are relied upon across the company as the single source of truth.
Job Duties/Essential Functions:
- Build or extend data models in Dynamics365
- Integration architecture and performance optimization
- Integration Platform Engineering, Admin. and support
- Azure DevOps component to build VMs for Secure Agents (i.e. Gateways)
- Data mapping (Source to D365 & D365 to source)
- Upstream/downstream data flows architecture and design (mainly iSeries, AS400 IBMi as source and destination for data)
- Develops data pipelines to store data in defined data models and structures to be useable within applications or by other business reporting application or dashboards
- Identifies ways to improve data reliability, efficiency and quality of data management.
- Assesses the integrity of data from multiple sources.
- Manages database configuration including installing and upgrading software and maintaining relevant documentation.
- Develops and operationalizes data pipelines to create enterprise certified data sets that are made available for consumption.
- Designs, develops, & implements ETL/ELT processes
- Uses Azure services such as Azure SQL DW (Synapse), ADLS, Azure Event Hub, Cosmos, Databricks, Delta-Lake to improve and speed up delivery of our data products and services.
- Implements big data and NoSQL solutions by developing scalable data processing platforms to drive high-value insights to the organization.
- Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery.
- Identifies ways to improve data reliability, efficiency and quality of data management.
- Communicates technical concepts to non-technical audiences both in written and verbal form.
- Regular and reliable workplace attendance at your assigned location.
- Ability to operate vehicles, equipment or machinery.
- Computer, phone, printer, copier, fax
- 4+ years’ experience engineering and operationalizing data pipelines with large and complex datasets.
- 2+ years’ hands-on experience with iSeries / IBMi integration
- 3+ years’ experience working with Cloud technologies such as ADLS, Azure Databricks, Spark, Azure Synapse, Cosmos DB and other big data technologies.
- Extensive experience working with various data sources (DB2, SQL,Oracle, flat files (csv, delimited), APIs, XML, JSON.
- Middleware solutions, such as IBM ACE
- Advanced SQL skills required. Solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
- 3+ years’ experience with Data Modeling and ETL
- Strong understanding of database storage concepts (data lake, relational databases, NoSQL, or Realm)
- Azure Certifications
- Graph QL
- D365 data entity models
- Experience implementing data integration techniques such as event/message based integration (Azure Event Hub, ), ETL
- Experience with Git / Azure DevOps
- Experience delivering data solutions through agile software development methodologies
- Exposure to the retail industry
- Excellent verbal and written communication skills
- Successful internal candidates will have spent one year or more on their current team
Apply for this position
Required*