Data engineer

• Implemented Snowflake as a data warehouse solution, including performance tuning and optimization of SQL queries, resulting in a 40% improvement in query performance.
• Designed and implemented ETL pipelines using Python, dbt and Airflow
• Integrated data sources into AWS S3

• Led the design and implementation of a data lake architecture using Hadoop ecosystem tools to ingest and process data from various sources, resulting in a 50% reduction in data processing time.
• Developed Python scripts using Spark for data processing, cleaning, and transformation, resulting in a more streamlined and automated data pipeline.
• Led a team of data engineers in developing a data integration platform using RESTful APIs, resulting in the successful integration of several third-party data sources such as Salesforce, Hubspot, Microsoft Dynamics, Zoho, SugarCRM
• Streamed data with Kafka
• Maintained data within Mongo DB and Postgres
• Developed an internal Web UI using Python and Flask

• Designed and implemented ETL pipelines using Pentaho, extracting data from various sources and loading it into data warehouses for analysis.
• Developed complex data models using star schema and snowflake schema for data warehousing purposes.

Especialidad Business Intelligence e Integracion de datos