استخدام Data Engineer
شرح موقعیت شغلی
Job Description:
- Design and develop an optimized stable solution for data infrastructure to handle all data user’s needs and provide custom detail-oriented tables, pipelines, cubes, and reports utilizing traditional and ad-hoc BI reporting tools.
- Performing detailed database queries.
- Develop and maintain detailed technical documentation of data pipeline processes.
- Ensure that data pipeline solutions align with industry best practices.
- Develop the packages and procedures to retrieve data from various resources, cubes, and dimensions.
- Develop ETL (extract, transform, load) processes to help extract and manipulate data from multiple sources.
- Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders.
- Establish optimized pipelines connected to various data sources, including MySQL, SQL server, G-sheets
- Design and implement data models that support reporting and analytic needs specified.
- Monitor data systems performance and implement optimization strategies.
- Leverage data controls to maintain data privacy, security, compliance, and quality for allocated areas of ownership.
Requirements:
- Master’s degree or above in Technology Systems (Information Technology/ Computer Science/ Computer Engineering) or other related discipline
- 2 years or more in the data engineering field or 5 years’ experience in related fields
- Working experience in related e-businesses with big scale data sets.
- Solid knowledge of data warehouse design, implementation, and maintenanceAbility to design fact and dimension tables according to the needs of business functions
- Ability to write complex and optimal T-SQL queries in order to obtain the required data
- Experience in ETL process using SSIS to implement packages’ data pipelines and generate automatic jobs to retain them
- Solid knowledge of database performance tuning and administration (indexing, partitioning, compression, and ETC)
- A passion for creating solutions with a positive attitude to change
- Communicate effectively with other teams to integrate systems or gather requirements
- Creating and maintaining documentation that includes the design, requirements, and user manuals for the BI team members
- Database maintenance and retaining the table states
- Experienced in creating data model in SSAS(Tabular), Microsoft PowerBI, using DAX to deploy required measures is plus
مهارتهای مورد نیاز
- SSIS
- SASS
- Sql Server
- Power BI
- Tableau
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست