Job Title - Azure Data Engineer
Location - Raleigh NC
Duration - 12+ Months
***This is an onsite position. - Pay: $60-65/hr on C2C****
*****Candidate with prior state government expeirence will get first preference*****
****Direct in-person interview*****
Job Title: Data Engineer - Azure Platform - 10+ Years of overall expeirence required with 6+ with Azure
Overview:
We are looking for an experienced Data Engineer to join our team. You will use various methods to import raw data into AzureCloud. You will analyze data and create rules for the ETL process. The importprocess will also include identifying the business rules and apply them to thefiles stored in staging area before moving the files to processed area.
The ideal candidate will have a strong background indata engineering, along with expertise in cloud computing. This role offers anexciting opportunity to play a key role in modernizing our technology stack anddriving our organization's digital transformation journey.
Responsibilities:
Collaborate with cross-functional business teams tounderstand requirements, analyze, and organize raw data import by identifyingthe ETL rules.
Identify and apply transformation rules for legacydata migration from mainframe systems to the Azure cloud platform.
Develop and implement data pipelines, ETL processes,and data integration solutions to facilitate the conversion of data.
Develop and maintain documentation, best practices,and standards for data engineering processes and procedures.
Provide technical leadership and mentorship to teammembers, guiding them in best practices for data engineering and cloudmigration projects.
Explore ways to enhance data quality and reliability.
Requirements and Skills
1. **DataModeling and Database Design:**
- Proficiency in designing and implementing relational and non-relationaldatabases.
- Knowledge of data modeling techniques and tools.
2.**Azure Data Services:**
- Deep understanding and hands-on experience with Azure data servicessuch as Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, AzureBlob Storage, etc.
3. **ETL(Extract, Transform, Load) Processes:**
- Expertise in designing and implementing ETL processes using tools likeAzure Data Factory or Azure Databricks.
- Knowledge of data integration and transformation techniques.
4. **SQLand T-SQL:**
- Proficient in writing complex SQL queries and stored procedures.
- Familiarity with Transact-SQL (T-SQL) for managing and querying SQLServer databases.
5. **DataSecurity and Compliance:**
- Knowledge of data security best practices and experience implementingsecurity measures for data storage and processing on Azure.
- Awareness of compliance requirements and ability to implement solutionsthat adhere to NC DPI and DIT regulations.
6. **DataMonitoring and Optimization:**
- Ability to set up monitoring and logging for data pipelines anddatabases.
- Skills in optimizing data storage and processing for performance andcost-effectiveness.
7.**Scripting and Automation:**
- Proficiency in scripting languages like Python or PowerShell forautomating data engineering tasks.
- Knowledge of Azure Resource Manager (ARM) templates for infrastructureas code.
Additionally, obtaining relevant certifications, such as theMicrosoft Certified: Azure Data Engineer Associate, can further validate andenhance these skills.
Qualifications:
Bachelor's degree in computer science, Engineering, ora related field
Proven experience as a data engineer, with a strongfocus on data migration, ETL, and data integration.
Hands-on experience with data warehousing concepts,database technologies (SQL on Azure)
Strong problem-solving skills, attention to detail,and the ability to work effectively in a fast-paced environment.
Excellent communication and interpersonal skills, withthe ability to collaborate effectively with cross-functional teams andstakeholders.
--
All Job Openings : http://groups.google.com/group/jobjunction/topics?hl=en
You received this message because you are subscribed to the Google Groups "Job Junction" group.
If you are a job seeker please join the group using the link http://groups.google.com/group/jobjunction/subscribe or you can join group or add Job Junction as your friend in Facebook (Search for Job Junction) or you can also follow my blog http://jobjunctionglobal.blogspot.com/
If you have any requirement to share please send the same with all job details, email ID to which the resume has to be sent to jobjunction@googlegroups.com and jobjunctionglobal@groups.facebook.com
To unsubscribe from this group, send email to jobjunction+unsubscribe@googlegroups.com
For more options, visit this group at http://groups.google.com/group/jobjunction?hl=en
---
You received this message because you are subscribed to the Google Groups "Job Junction" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jobjunction+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jobjunction/CAHEEoWTqWc%3DNoX6W%3D9ye1vEEDLjqnp_%3D7iANKoknmbz5k1XU1w%40mail.gmail.com.
No comments:
Post a Comment