ABOUT UDEMY
We believe anyone can build the life they imagine through online learning. Today, more than 17 million students around the world are advancing their careers and passions by mastering new skills on Udemy. Through our global marketplace, we connect lifelong learners around the world to the largest selection of online courses created by expert instructors, and we’re just getting started.
We’re a close-knit bunch that enjoys problem-solving and collaboration, and we share a serious commitment to delivering the best possible learning and teaching experiences. Udemy’s culture encourages innovation, creativity, passion, and teamwork. We also celebrate our milestones and support each other every day.
Founded in 2010, Udemy is privately owned and headquartered in San Francisco’s SOMA neighborhood with offices in Dublin, Ireland, and Ankara, Turkey. Compensation includes full-time salary, equity compensation plan, and competitive benefits including healthcare, commuter benefits, parental leave, and an unlimited vacation policy.
Information regarding data privacy is available within the Udemy Careers Privacy Notice.
Responsibilities:
- Build robust and scalable data infrastructure (both offline and real-time but more on real-time) to support needs from different teams around the company and to build our discovery experience
- Manage the data infrastructure and do necessary capacity planning.
- May get involved in various projects/tasks as needed. This may involve some project planning, resource planning, and deployment planning in additional to his/her current software engineering responsibilities
- Participate in agile development methodologies with two weeks sprints.
- May require mentoring junior engineers to become proficient developers using best software development practices and processes
- Lead by example and contribute to a team culture that values quality, robustness, and scalability while fostering initiatives and innovation.
- Continue to research and evaluate new technologies (such as Spark) that may improve performance and elegance of our data infrastructure.
Qualifications:
- Minimum 5 years experience in the data engineering and at least 1 year of experience in real-time data processing
Experience with:
- Hadoop/Hive/Spark
- Streaming Processing (Kafka/SparkStreaming or Kinesis)
- Python or Java or Scala
- MySQL, PostgreSQL
- HBase or Cassandra is a big plus
- ElasticSearch is a big plus
Knowledge of:
- How recommendation engine is built
- Lambda architecture or streaming processing
- Demonstrated ability to solve time-critical problems
- Strong technical communication skills
- Willingness to "go the extra mile" when needed.
Preferred but not required:
- Familiarity with machine learning techniques
- Large project lead experience
Knowledge of AWS stack:
