استخدام Data Engineer (Excoino)
شرح موقعیت شغلی
We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. She/he will be responsible for designing our data warehouse and implementing our ETL processes. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing our company’s data architecture to support our next generation of products and data initiatives.
Responsibilities
- Develop and maintain optimal data pipelines and tasks with python and Airflow platform.
- Build the infrastructure required for optimal ETL of data from a wide variety of data sources, using python.
- Designing, developing and maintaining business intelligence solutions.
- Oversee and evaluating data quality for transfer to the data warehouse.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications
- At least three years of practical experience in programming Python.
- SQL knowledge and experience working with relational databases as well as working familiarity with a variety of databases.
- Experience building and optimizing data pipelines, architectures and data sets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- 5+ years of experience in a Data Engineer
- Bachelor in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
Preferred Qualification
- Experience with the Kafka ecosystem.
- Experienced in SSIS and SSAS and T-SQL.
- Experience and overall knowledge of Blockchains and cryptocurrency.
- Experience with deployment solutions Docker and Docker-compose.
- Linux.
مهارتهای مورد نیاز
- ETL
- Data engineer
- SQL
- Python
- SSAS
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست