Description
 

Sidero have a fantastic opportunity for Cloud Data Engineers who want to explore the world of innovative software product development within a next generation enterprise platform. The project involves both transformation and building new services to be offered to customers. We are looking for team players who wants to be part of this challenging project working in a high-performance Agile Engineering team.

Opportunity
 

You have the opportunity to join a small team focused on the firm’s cloud Data Architecture. You are a passionate visionary and technologist with a focus on Data Architectures, cloud solutions and implementations. In your role, you will be given great latitude to flex your skillset while benefiting from the support of our many AWS Certified team members. As a data engineer, your efforts will advance the firm’s capabilities to deliver the strategy for cost and performance optimized solution architectures as relates to data lakes, analytics, and machine learning, ensuring our technology solutions safeguard the security, privacy, and integrity of our firm. You will collaborate with our Data Science, Engineering and Product teams to anticipate future challenges and to provide hands on support to ensure their projects are brought to completion in accordance to industry wide best practices. Please note this is a Hands-On position whereby you will be responsible for solution architecture, implementation, IaC, and support.

Key Responsibilities
 

Engineering Responsibilities

• Implement solutions using Infrastructure as Code to ensure repeatable, consistent, and deterministic outcomes. Develop fully automated solutions using AWS Cloud Native Services that enable performance and cost optimized solutions.
• Developing / Debugging ETLs using Python & PySpark as well as developing Redshift queries.
• Partner with development and build release teams on data initiatives.
• Rapidly developing prototype data pipelines to validate solutions.
• POC code and developing it into a production ready solution with a focus on code quality, testing, security, performance and operational excellence.
• Embrace DevOps practices / CALMS principles.

Architecture Responsibilities

• Contribute to the evolution of the overall Analytics architectural strategy, including Reference Architectures and Reference Implementations to grow the platform.
• Contribute to the adoption of the firm’s Data Platform and work with stakeholders to enable them to self-serve in their consumption of the platform
• Partner with Data Scientist, Analysts, Architects, and Engineers to build Solution Architectures that leverage the Data Platform in an optimized, low barrier to entry manner.
• Identify and implement processes, tools, and methods that support the target strategy, address data lifecycle, cover data movement, data security, data privacy, and metadata management.
• Effectively communicate new recommendations and solutions to peers, with an emphasis on knowledge sharing. Communicate architectural information to non-technical audiences.
• Adapt existing design patterns.

Requirements
 

• 4+ years Solution Architecture experience, including 2+ years Data Architecture.
• Hands-on experience with several of the following AWS services (Athena, Glue ETL/Catalog, Redshift, DynamoDB, AWS Lambda, CLI, EC2).
• 3+ years hands-on AWS experience, including 2+ years hands-on AWS experience in CodePipeline and/or CloudFormation.
• Strong DevOps mindset and experience in promoting code from staging to production environments through automation.
• 3+ years Software Development experience, including 2+ years of Python (including Spark) experience.
• Experience building & operating data lakes and data warehouse solutions preferably on AWS.
• BA/BS degree in Computer Science, related Software Engineering or equivalent experience.
• AWS Certified, preferably Big Data, SA and/or DevOps.
• A well-grounded knowledge of engineering and continuous delivery practices using modern software development tooling (GitHub, CodeCommit, IDEA, PyCharm, Visual Studio, etc.), processes (e.g. Scrum, Agile), and toolsets (e.g. JIRA, Confluence).
• Understanding of IAM Security, Policies, and Roles.

Additional requirements

• Data Science and Analytics programming language experience (ML, Python, R, etc.)
• Knowledge of big data technologies and frameworks (i.e. Kinesis, Hadoop, Hive, Kafka, etc.)
• Experience and/or demonstrated interest in RDS / Aurora, Route53, SQS, SNS and other new technology.
• Active in technical communities (e.g AWS Meetups), & development of publications (e.g. Slideshare, Medium)

Other skills:

• Displays ability to collaborate with other team members in order to reach the best solution to a problem
• Self-starter / autonomy is a must. Demonstrated ability to self-teach, learn, and apply learnings as a regular course of activity.
• Shows ability to prioritise issues during busy periods in order to ensure optimum performance
• Shows willingness to learn from others in order to ensure that solution proposed is the best solution
• Excellent communication skills including active listening, writing and speaking
• Ability to work independently
• The right attitude:
  • Explore and interpret a diverse range of perspectives and views
  • Build collaborative relationships across organisation boundaries, cultures and other disciplines
• Excellent analytical and problem-solving skills
• Leadership skills:
  • Inspires and motivates others toward goal accomplishments
  • Fosters a culture or commitment, team spirit, pride and trust
  • Lead the development and improvement of quality ideas and proposals
• Continuous improvement:
  • Enable own and others' continuous professional development using a range of methods
  • Reflect on experience, seek feedback and apply your learning
  • Support management in creating the culture of continuous improvement and help encourage this amongst your colleagues
  • Help create a culture of knowledge, experience and expertise sharing

Remote working options - Flexible working options - Learning & Development support - English lessons - Employee Wellness & Wellbeing - Health Insurance - Life Assurance - Pension - and more...