Complex problems require the right expertise! Today, one of the biggest challenges lies in data storage and processing, across these three main domains (3Vs): Volume, Velocity and Variety.
At Xpand IT, the Data Engineering teamdevelops and implements architectures and software solutions that represent the state of the art on capturing, ingesting, storing and managing critical data from huge clusters where the 3Vs are always present. As concerns technology stack, we take advantage of almost every state-of-the-art framework in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services or MongoDB using Java and Scala as programming languages to interact with them.
Your role
As a Software Engineer, you’ll play a key role in the team along with Big Data Platform Engineers to create the best software solutions, applying big data best practices in terms of architecture and systems design. You’ll ensure that backend software performance, reliability and scalability are achieved regardless of how fast data clusters grow or the throughput of information increases.
Your daily activities will include:
- Implementing solutions in distributed architectures in which the performance of processing large data volumes is essential
- Designing robust and reliable software solutions regardless of the amount of input data
- Implementing big data industry standards into the end software solution
- Analysing complex problems that need solutions for efficiently manipulating huge amounts of information
- Developing data models and data organisations that optimise “search” and “store” operations in large-scale distributed systems
- Designing APIs for swift data tracking and query data at high speeds
Stacks:
Java/Scala, Spark, Kafka/Confluent, MongoDB, Databricks
Job requirements
Academic background
Bachelor's or Master's degree in Computer Science, Information Systems, or related fields.
Experience with Java/Scala
Experience with Java-based technologies (JBoss, Spring, Spring MVC, Hibernate) and defining communication interfaces using standards like XML, JSON, SOAP.
Design patterns
Experience in implementing design patterns in advanced software solutions (multi-threaded, multi-process, multi-cloud).
Databases
Experience with relational and non-relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB).
Development tools
Extensive experience with tools like Eclipse, Maven, Jenkins, GIT, JIRA, or equivalents.
Languages
Fluency in English, spoken and written.
Nice to have:
- Knowledge or experience with distributed computing/storage frameworks such as Apache Spark, Kafka or cloud-native solutions like Databricks, EMR or DataProc;
- Team player and problem-solving skills.