Data Platform Engineer
# Think Data Be Smart #
About Us: DataSmart is a Portuguese company, positioning itself as a consulting company of excellence, with over 20 years of existence. We are specialized in Technologies and Information Systems services, for the Portuguese and International markets. We pride ourselves on fostering a culture of involvement, experience, and excellence.
Join our team as a Data Platform Engineer (Hybrid – Lisbon)!
What You’ll Do:
- Design and develop scalable data pipelines on Google Cloud Platform
- Build and maintain data models using dbt with Medallion architecture (Bronze/Silver/Gold)
- Implement incremental models and automated data tests to ensure data reliability
- Handle batch and streaming data processing using Python, Apache Beam, and Dataflow
- Integrate data from external APIs and manipulate datasets using pandas and pyarrow
- Manage and operate GCP services including BigQuery, Cloud Run, Pub/Sub, and Workflows
- Implement data governance, quality, and lineage solutions
- Manage infrastructure using Terraform and infrastructure-as-code principles
- Monitor and troubleshoot data pipelines and workflows
- Provide documentation for data models and data flows
- Serve data to multiple consumers including AI, ML, BI, and business applications
Qualifications:
- 5+ years of experience as a Data Engineer
- Advanced SQL skills, especially with BigQuery
- Strong experience with data modeling and dbt
- Experience with modern data architectures (Medallion / Bronze-Silver-Gold)
- Strong Python experience for data processing
- Experience with Apache Beam and Google Cloud Dataflow
- Experience integrating external APIs
- Experience with pandas, pyspark and/or pyarrow
- Experience with GCP services: BigQuery, Cloud Run, Workflows, Cloud Scheduler, Pub/Sub, Google Cloud Storage, Dataplex, IAM
- Knowledge of data governance, quality, and lineage
- Experience with Terraform and infrastructure as code
- Strong understanding of Git, CI/CD, and software engineering best practices
- Experience monitoring and operating data pipelines and cloud workflows
- Strong analytical mindset and attention to detail
- French is a plus
At DataSmart, you will have the opportunity to integrate into a solid company and participate in projects of high recognition, nationally and internationally, with an appealing technological environment and career progression.
Excellence in the way to the future!
Connect with Us: Follow us on LinkedIn for updates on career opportunities, company news, and industry insights! For further details, visit us at www.datasmart.pt
#JoinOurTeam #DataSmart #ThinkDataBeSmart #DataScientist #sql