25
Mar 2022
Azure Data Engineer
Azure Data Engineer
Phenologix
Lahore
For job details please visit and apply at the following link:
https://hiredroid.com/#/shareJob/25/1
Below is the summary of the job:
==============================
Responsibilities
- Work collaboratively and creatively with other data engineers to develop scalable and maintainable data pipelines using the latest Microsoft Azure technologies and leading industry practices
- Develop patterns and build data pipelines that ingest enterprise-wide data into the Enterprise Data Lake and make it available for consummation for both data analytics and data science
- Define and build data management solutions through maintaining secure and compliant data processing pipelines by using different tools and techniques
- Ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints
- Use various Azure data services and languages to store and produce cleansed and enhanced datasets for analysis
- Publish artifacts for warehousing and business insight/reporting platforms and assist stakeholders through exploration
- Understand requirements and business drivers and provide precise and concise data to support data-driven decision making
- Map data sources, data movement and interfaces with the goal of ensuring data quality, awareness, visibility and re-use
- Assess the state of master and reference data management and propose investment focus to address issues/opportunities
- Partner with a variety of internal stakeholders across the organization to deliver creative, cutting-edge, high-quality engineering solutions that meet business requirements in a fast-paced, ever-changing business environment
- Deal with unanticipated issues swiftly and minimize data loss
- Create and maintain data flow and architecture diagrams
- Ensure all data solutions are adhering to recommended best practices and standards
- Work with team lead and BA in the process of discovery, design solutions and estimate the work involved in the delivery of different projects and tasks.
Required skills:
- 3-5 years of proven experience in Data Engineering and Azure Cloud technologies(Azure Data Factory, Azure Data lake, Blob Storage, MySQL)
- Data Warehouse, SQL, Analysis Services, Data Factory & ETL.
- Power BI, DAX, Data Modeling and Transformation
- Experience with a variety of structured and unstructured data
- Experience in Ingestion of batch and Streaming data with complex transformations
- Work directly with Business users and convert use cases into solutions independently.
- Experience in working with a very large volume of data and building analytical insights based on user requirements using Power BI
- Experience in handling Semi-structured data in various data formats (Parquet, JSON, Avro, Orc) and manipulating data in complex data types.
Nice to have skills:
- Knowledge of DevOps tools and experience in building CI/CD pipelines on Azure.
- Knowledge of NoSQL database types like Document and Graph DB is a plus.
- Has worked in Agile methodologies
Job Type: Full-time
Ability to commute/relocate:
- Lahore: Reliably commute or planning to relocate before starting work (Required)
Expected Start Date: 23/03/2022