Big Data Architect Job at Propelsys Technologies LLC
More than 10+ years of technical experience in data migration with design of Big Data systems Experience in Data processing in Batch and Real time with design and implementation using Pyspark/Spark Scala. Experience in event driven architecture design/solutioning using Kafka. Experience in Big Data technologies including SQL and NoSQL (HIVE, Hadoop, Couchbase DB, PostgreSQL) and Snowflake. Experience working in large complex transformation or migration programs from initiation to implementation, preferable in travel & transportation hospitality domain Experience in Data ingestion from on premise, cloud, structured, semi-structured and unstructured data Experience in modeling, design and mapping of data from different systems Experience in ODS, Data warehouse, staging, data lake and data mart implementation Experience in data architecture on AWS and Azure cloud (S3, SNS, SQS, Lambda, Azure data lake, SQL Data warehouse, DynamoDB) 10+ years of Bigdata technologies, handling large amounts of data, hundreds of Terabytes or more Experience in legacy technologies Netteza, Oracle, DB2 Knowledge with data governance and best practices Propose and establish framework for necessary contributions from various development and program initiatives Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline with experience in software design and development Provide detailed specifications for proposed solutions Advanced programming skills with Python, Java, Scala. Advanced understanding of software development and collaboration, including experience with tools such as Git. Excellent written and verbal communication skills, comfortable presenting in front of non- technical audiences. Experience is orchestration tools like Airflow, Jenkins Experience in Apache Ni-Fi process
Job Type: Full-time
Pay: $160,000.00 - $180,000.00 per year
Schedule:
- 8 hour shift
Experience:
- Data modeling: 1 year (Preferred)
Work Location: Remote
Please Note :
epokagency.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, epokagency.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.