Big Data Engineer Roles and Responsibilities:

• Collect and process raw data at scale for a variety of projects and initiatives.
• Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects.
• Read, extract, transform, stage, and load data to selected tools and frameworks as required and requested.
• Perform tasks such as writing scripts, web scraping, calling APIs, writing SQL queries, etc.
• Work closely with the engineering team to integrate your work into our production systems.
• Process unstructured data into a form suitable for analysis.
• Analyze processed data.
• Support business decisions with ad hoc analysis as needed.
• Monitoring data performance and modifying infrastructure as needed.
• Define data retention policies.

Big Data Engineer Skills/Requirements:

• 2 to 7 years of recent experience in data engineering.
• Bachelor’s Degree or more in Computer Science or a related field.
• A solid track record of data management shows your flawless execution and attention to detail.
• Strong knowledge of and experience with statistics.
• Programming experience, ideally in Python, Spark, Kafka, or Java, and a willingness to learn new programming languages to meet goals and objectives.
• Experience in C, Perl, Javascript, or other programming languages is a plus.
• Knowledge of data cleaning, wrangling, visualization, and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
• Experience in MapReduce is a plus.
• Deep knowledge of data mining, machine learning, natural language processing, or information retrieval.
• Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
• Experience with machine learning toolkits including, H2O, SparkML, or Mahout
• A willingness to explore new alternatives or options to solve data mining issues, and utilize a combination of industry best practices, data innovations, and your experience to get the job done.
• Experience in production support and troubleshooting.
• You find satisfaction in a job well done and thrive on solving head-scratching problems.

Job Type: Contract

Schedule:

• 8 hour shift

Experience:

• Informatica: 1 year (Preferred)
• SQL: 1 year (Preferred)
• Data warehouse: 1 year (Preferred)

Work Location: Remote

Please Note :
epokagency.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, epokagency.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.