Job Description
Technical / Functional Skills:
•AzureSQL Database, Cosmos (No SQL),
•Python,Scala
•StrongHands-on in T-SQL
•Experiencewith Azure, REST API
•Creatingdistributed data pipelines for batch and real-time applications
•ApacheSpark,
•AzureData Factory,
•AzureDatabricks
•JupiterNotebook
•AzureSynapse Analytics
•AzureData Lake/ Analytics
Roles and Responsibilities:
•Design,develop and build real-time data pipelines from a variety of sources(streaming data, APIs, data warehouse, messages etc.)
•Leveragethe understanding of software architecture and software designpatterns to write scalable, maintainable, well-designed and future-proofsoftware
•Manageexisting pipelines and create new pipelines from a variety of sources(relational, XML, etc.)
•Actively applybest practices within CI/CD
•Proposeand implement solutions for data pipeline stabilization and data qualitychecks
•Coordinationwith other teams to design optimal patterns for data ingest and egress, aswell as lead and coordinate data quality initiatives and troubleshooting
•Designand build solutions to track data quality, stabilize data pipeline, etc.to ensure reliable operations
•Ensurebest practices are followed across architecture, codebaseand configuration
•Eliminatewaste
•
Job Tags
Similar Jobs
Everbrook Academy
Join a strong community where all we do is care-for the children and families we serve every day, as well as for our dedicated team members. Our people are our best asset. We listen and we know what you're looking for: You want benefits. We support you with a minimum...
United Rentals
Great company. Great people. Great opportunities. Si vous souhaitez avoir la chance de faire votre marque auprs du plus grand fournisseur de location d'quipement au monde, venez construire votre avenir avec United Rentals! En tant que conducteur avec permis de...
Cementir Holding N.V.
...Job Description Summary Reporting to the Logistics Manager, this position is responsible for coordination of logistics activities within assigned region for Lehigh White Cement. Oversees imports, rail, and truck transportation, as well as Terminal & Supply Chain...
BayCare
...respect, responsibility and clinical excellence. Summary: As defined by the American College of Surgeons, Surgical Assistants (SAs) are trained individuals who are able to participate in, and actively assist the surgeon in, completing the operation safely and expeditiously...
Activate Talent
...Content & Podcast Production Specialist Work from any corner of the world and be a part of the #remoteworkrevolution!! Role Overview: We are looking for a creative and organized Content & Podcast Production Specialist to support the growth of our YouTube channel...