At Xpand IT, the Data Engineering team develops and implements architectures and software solutions focused on large-scale data processing. The team’s mission is to solve complex challenges involving Volume, Velocity, and Variety, ensuring that data is captured, stored, and managed efficiently. The primary focus is to leverage industry-leading technologies to build robust systems that support critical information flows, always ensuring the reliability and performance of the Big Data ecosystem.
Your role
As a Data Engineer, you will play a central role in software development and distributed systems, applying engineering best practices to the world of data. Your focus will be:
- Implementing processing solutions (Batch and Streaming) where performance is essential;
- Designing data pipelines and organizational models that optimize search and storage operations;
- Ensuring software scalability and reliability, regardless of data volume growth;
- Collaborating with platform engineers to integrate industry standards into production solutions;
- Analyzing complex data manipulation problems and developing APIs for high-speed data querying.
Stacks:
- Languages: Java, Scala or Python;
- Frameworks & Processing: Apache Spark, Kafka/Confluent;
- Cloud: Azure, AWS, or Google Cloud;
- Storage/Databases: Delta Lake, MongoDB, SQL, and NoSQL.
Job requirements
Academic background
Bachelor’s or Master’s degree in Computer Science, Information Systems, or related fields.
Software engineering
Solid experience in programming (Java, Scala or Python) and applying design patterns in distributed systems.
Big Data & processing
Hands-on experience with Apache Spark and frameworks for large-scale data processing.
Cloud & Messaging
Strong knowledge of Cloud data services (Azure, AWS, or Google Cloud) and event-driven architectures with Kafka.
Databases
Proficiency in SQL and experience in modeling and managing relational and non-relational (NoSQL) databases.
Languages
Mandatory fluency in both Portuguese and English (written and spoken).
Nice to have:
- Experience with orchestration tools (e.g., Airflow) and Lakehouse ecosystems;
- Knowledge of CI/CD, Git, and automation tools (Maven, Jenkins, or equivalent);
- Experience with Infrastructure as Code (Terraform);
- Analytical skills and a passion for solving complex technical problems within a team.
