Databricks Engineer Job at QSS
Job Title: Databricks Engineer
Location: Corning, NY
Duration: Full Time
Skills Required:
- Designing and implementing highly performant data ingestion pipelines from multiple sources using Databricks on AWS
- Developing scalable and re-usable frameworks for ingesting large data sets and moving them from Bronze to silver and from Silver to Gold layer in data bricks.
- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
- Working with event based / streaming technologies to ingest and process data
- Proficient in writing Spark code in below languages: Scala, Python, or SQL
- Pro-code skills
- Experience with cloud-based architectures in AWS, Azure
- Experience in Big Data components such as Kafka, Spark SQL, Data frames, HIVE DB
- Experience with databases and data warehousing
- Read and write data in AWS Databricks
- Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints
- Experience working with large scale data processing services (Hadoop)
Job Type: Full-time
Work Location: One location
Please Note :
epokagency.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, epokagency.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.