استخدام Senior Data Engineer (کرج)
شرح موقعیت شغلی
Role
We are seeking a senior-level Data Engineer (+2 years experience) to help us in organizing our data, creating an end-to-end pipeline, and integrating it with BI and Data Analyst teams. This is a fantastic opportunity to take ownership of a critical role, experiment with new ideas, and make a significant impact on our operations. We are looking for a geeky-freaky mind that loves to play with the system until they quench their thirst. If you love solving problems and making a difference, we would love to hear from you.
Responsibilities
- Identify valuable data sources and automate data collection processes and undertake preprocessing of structured and unstructured data.
- Setup analytical infrastructure to facilitate exploration and visualization of datasets.
- Discover opportunities for data acquisition and develop data set processes for data modeling, mining, and production.
- Drive delivery of efficient data engineering standards, templates, patterns, and best practices by effectively using agile process methodology to define work, estimate effort, and measure results.
- Develop and implement data design methods, data structures, and modeling standards which work with multiple business intelligence tools.
- Work with Business Intelligence Team, data scientists team as well as other teams and meet their requirements.
Requirements
- Demonstrated experience of driving meaningful business outcomes through data engineering (most important; we love to have a short report of that!).
- Bachelor’s degree or higher in Computer Science, Computer Engineering, Statistics, or a related field (third-year students and above are also welcome). Relevant experience or personal projects will be considered if a degree is not available (see the previous criteria).
- 2+ years of experience in the data engineering field (including education and personal projects).
- Highly Proficient in SQL and a scripting language like Python and Hands-on experience with at least one RDBMS (MySQL)
- Familiar with data processing tools such as Hadoop and Kafka
- Familiar with orchestration tools such as Airflow
- Experience designing and developing ETL and ELT pipelines with relational and non-relational data.
- Experience designing and implementing data quality checks and validation processes
- Excellent communication skills (medium+ English), with the ability to present and propose ideas and requirements without direct supervision.
- Ability to work and utilize data/code/system version control methods and proper documentation is a must.
- Agile working methods and open feedback culture (be initiativ
- Familiarity with container management and deployment tools such as Docker, and CI/CD process is a plus.
- Experience with visualization and dash boarding platforms like Grafana, Kibana, PowerBI, Quicksight is a plus.
(Note: This role is on-site in Karaj, and remote options are not available at this time.)
مهارتهای مورد نیاز
- Databases
- Data engineer
- CI/CD
- Docker
حداقل سابقه کار
- مهم نیست
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست