Data Engineer Job at Boston Pioneer Solutions
Data Engineer
Remote
Responsibilities:
Key Skills:
- Data Engineer
- AWS services like lambda
- Python
- Data Engineer is responsible for managing, validating, and transforming vast volumes of data to provide measurable and automated solutions. This role is best suited to someone that is an expert at processing large volumes of data using Python and cloud computing technologies. You will be working on complex problems and must have an appetite for finding creative and innovative solutions.
*
- Duties and Responsibilities:
- Implement, deploy, and maintain replication, ETL, and data validation pipelines.
- Write Python libraries that provide easier access to data and construction of pipelines to process data at scale
- Evaluate, deploy, and scale cloud native data management infrastructure including data storage and processing systems
- Write and maintain documentation on data storage and processing systems
- Collaborate with the broader Algorithms group to advise on use cases and create repeatable patterns for data processing pipelines that the team can implement to support modeling and analysis use cases
*
- Required skills:
- 5+ years’ working experience engineering data intensive applications
- Expert-level SQL, high proficiency with Python (especially the Pandas/NumPy data stack)
- Expertise with Python in a production environment
- Experience with AWS services, especially S3, Lambda, and Batch
- Experience working with large amounts of data in a variety of formats
- Experience building automated validation and processing pipelines
- Experience supporting ML pipelines and applications
- Expertise with SQL, database design.
*
Job Type: Full-time
Pay: $75.00 - $80.00 per hour
Benefits:
- 401(k)
- 401(k) matching
- Dental insurance
- Employee discount
- Flexible schedule
- Flexible spending account
- Health insurance
- Life insurance
- Paid time off
- Referral program
- Retirement plan
- Tuition reimbursement
- Vision insurance
Schedule:
- 8 hour shift
- Monday to Friday
Experience:
- Data Engineer: 10 years (Preferred)
- AWS/lambda/AWS Services: 6 years (Preferred)
- Python/Pandas/NumPy: 10 years (Preferred)
Work Location: Remote
Please Note :
epokagency.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, epokagency.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.