What you’ll do
- Design, develop, and maintain scalable data processing applications
- Develop and optimize distributed data processing solutions using Apache Spark
- Work with AWS cloud services to build and manage data engineering solutions
- Develop and maintain data pipelines using Hadoop, HDFS, Hive
- Write and optimize SQL queries
- Perform data integration, transformation, and validation
- Use UNIX shell scripting for automation
- Troubleshoot performance issues and optimize workflows
What we’re looking for
Qualification: Bachelor's degree in Computer Science, Information Technology, or a related
- Strong hands-on experience in Scala and Python
- Expertise in Apache Spark
- Experience with AWS cloud services
- Strong knowledge of databases and SQL
- Experience with UNIX/Linux shell scripting
- Knowledge of Hadoop, HDFS, Hive, and Big Data technologies
- Strong analytical, problem-solving, and debugging skills
PythonScalaApache SparkAWSHadoopBig DataSQLUNIX shell scriptingHDFSHive
Good to know
- Looking for experienced Python & Scala Developers to join our client team