Data2Bots, an IT Consulting company is seeking a skilled Data Engineer to join our team. You will be responsible for designing, building, and maintaining robust data pipelines and infrastructure. Your expertise in data engineering, cloud technologies, and big data processing will be instrumental in unlocking the value of our data assets.
SKILLS, QUALIFICATIONS AND REQUIREMENTS
Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience as a Data Engineer with a strong foundation in data warehousing and ETL/ELT processes.
Proficiency in SQL, Python, and other relevant programming languages.
Experience with big data technologies (Hadoop, Spark, Hive, etc.).
Knowledge of cloud platforms (AWS, Azure, GCP) and their data services.
Strong understanding of data modeling and database design.
Ability to work with large datasets and perform data analysis.
Experience with data visualization tools (Tableau, Power BI).
Knowledge of machine learning and statistical modeling.
Experience with data governance and compliance regulations.
RESPONSIBILITIES
Design, develop, and implement scalable data pipelines to extract, transform, and load data from various sources.
Build and maintain data warehouses and data lakes.
Develop data models and schemas to support business intelligence and analytics.
Optimize data processing and query performance.
Ensure data quality, integrity, and security.
Collaborate with data scientists and analysts to understand data requirements.
Stay up-to-date with the latest data engineering technologies and trends.