Job Description
Technical / Functional Skills:
•AzureSQL Database, Cosmos (No SQL),
•Python,Scala
•StrongHands-on in T-SQL
•Experiencewith Azure, REST API
•Creatingdistributed data pipelines for batch and real-time applications
•ApacheSpark,
•AzureData Factory,
•AzureDatabricks
•JupiterNotebook
•AzureSynapse Analytics
•AzureData Lake/ Analytics
Roles and Responsibilities:
•Design,develop and build real-time data pipelines from a variety of sources(streaming data, APIs, data warehouse, messages etc.)
•Leveragethe understanding of software architecture and software designpatterns to write scalable, maintainable, well-designed and future-proofsoftware
•Manageexisting pipelines and create new pipelines from a variety of sources(relational, XML, etc.)
•Actively applybest practices within CI/CD
•Proposeand implement solutions for data pipeline stabilization and data qualitychecks
•Coordinationwith other teams to design optimal patterns for data ingest and egress, aswell as lead and coordinate data quality initiatives and troubleshooting
•Designand build solutions to track data quality, stabilize data pipeline, etc.to ensure reliable operations
•Ensurebest practices are followed across architecture, codebaseand configuration
•Eliminatewaste
•
Job Tags
Similar Jobs
Butterfly Pavilion
...Job Description Job Description Title: Community Engagement Educator Reports to: Community Engagement Manager About Butterfly Pavilion: At Butterfly Pavilion, we transform the way people think about invertebrates. These small but mighty animals that surround...
Insightful Minds
...Join Our Event Team Make an Impact & Have Fun! Looking for a job thats exciting, social, and meaningful? Were hiringoutgoing, self-motivated individualsto join ourEvent Team! No experience? No problem! We provide hands-on training to help you developnew skills...
SeaBreeze Homes and Living
...into the travel and hospitality industry with us! Work remotely, enjoy flexible hours, and transform your... ...outs.Why This Opportunity is Perfect for You:Work Anywhere: All you need is reliable internetwork from home or any location of your choice.Set Your Schedule:...
Fusion Medical Staffing
...Travel Occupational Therapist (OT) at Fusion Medical Staffing summary: As a Travel Occupational Therapist at Fusion Medical Staffing, you will positively impact the lives of patients by providing high-quality care, particularly in the neonatal specialty. This role involves...
Maxion Research
Hiring: Part-time Research Study Personnel (Pay up to $790/wk.) Due to demand, we are now accepting applications for personnel to participate in our local in-person and nationwide remote research studies. Description This gig is perfect for those looking for temporary...