ETL Jobs

Title Build Comprehensive Global Movie & TV Metadata Database for Recommendation Engine Project Overview I am building a personal recommendation engine that predicts my rating for movies and TV shows based on a large history of titles I have already rated. To support accurate predictions, I need a global media metadata database that contains rich structured information for movies and TV series. The dataset should combine multiple trusted sources and be designed for machine-learning comparison against my rating history. Scope of Work Build a master dataset containing global movie and TV metadata. This will serve as the candidate pool for prediction models. The database should include titles from: • IMDb official dataset • The Movie Database API • Optional enri...

Database Migration Specialist: MySQL to Supabase/PostgreSQL We're looking for a data migration expert who doesn't just move data — you ensure it arrives clean, complete, and production-ready. You have deep experience migrating large-scale databases and understand the nuances of moving from MySQL to PostgreSQL in Supabase environments. What You'll Do: - Plan and execute end-to-end migration of large MySQL databases to PostgreSQL on Supabase - Audit source data for inconsistencies, duplicates, and schema incompatibilities before migration - Design and implement migration scripts, transformation logic, and validation checks - Handle data type mapping, constraint differences, and stored procedure conversions between MySQL and PostgreSQL - Perform dry runs, staged migrati...

For the next round of hiring I want an accomplished Senior Data Engineer to sit in on our technical interviews for roughly two hours each day. The role is purely evaluative: you will craft probing questions, join live video calls, and quickly score each candidate’s depth of knowledge across Python, Scala and SQL. Our stack centres on Azure and Databricks, so practical insight into large-scale Spark/PySpark jobs, data-model design, ETL orchestration and cloud performance tuning is essential. Candidates frequently discuss streaming, optimisation strategies and modern AI/ML add-ons, so any hands-on exposure to libraries such as PyTorch, NumPy, SciPy or TensorFlow will help you challenge them at the right level, though it is not mandatory. Availability is limited to two focused hou...