Senior Python Data Engineer
# Think Data Be Smart #
About Us: DataSmart is a Portuguese company, positioning itself as a consulting company of excellence, with over 20 years of existence. We are specialized in Technologies and Information Systems services, for the Portuguese and International markets. We pride ourselves on fostering a culture of involvement, experience, and excellence.
Join our team as a Senior Python Data Engineer (Hybrid – Porto, Braga, Coimbra, Lisbon)!
What You’ll Do:
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes to support analytics and business-critical data initiatives.
- Build data engineering solutions using Python, Databricks, and AWS, ensuring efficient processing of large-scale datasets.
- Implement data quality controls, monitoring, validation, and alerting mechanisms to guarantee data reliability and integrity.
- Collaborate with cross-functional teams to deliver scalable, high-performance data solutions aligned with business requirements.
- Optimize data architectures, workflows, and processing performance while contributing to governance, best practices, and continuous improvement initiatives.
- Participate in Agile development processes and support the delivery of modern cloud-based data platforms.
Qualifications:
- 5+ years of experience as a Data Engineer, with strong expertise in Python and production-grade data pipeline development.
- Proven experience building and maintaining end-to-end ETL/ELT workflows, including data ingestion, transformation, validation, monitoring, and alerting.
- Hands-on experience with AWS, Databricks, and at least one of the following technologies: Apache Airflow, Apache Spark, or Apache Kafka.
- Strong SQL skills and solid knowledge of data modelling, data warehousing, and data integration principles.
- Experience implementing data quality controls, monitoring solutions, and working with cloud-based data platforms.
- Familiarity with Git, CI/CD practices, and Agile/Scrum methodologies.
- Strong analytical, problem-solving, and communication skills.
- English proficiency at a professional level (minimum C1).
- Living in Portugal and available to work in a hybrid model.
At DataSmart, you will have the opportunity to integrate into a solid company and participate in highly recognized projects, both nationally and internationally, with an appealing technological environment and career progression.
Excellence in the way to the future!
Connect with Us: Follow us on LinkedIn for updates on career opportunities, company news, and industry insights! For further details, visit us at www.datasmart.pt.
#JoinOurTeam #DataSmart #ThinkDataBeSmart #DataEngineer #Python #AWS #Databricks #Airflow #Spark #Kafka #SQL #ETL #CloudData #DataEngineering #BigData