استخدام Junior Big Data Engineer
شرح موقعیت شغلی
Description:
· Design, build, and optimize ETL pipelines based on our customer business requirements.
· Collaborate with Business Intelligence, Data Scientists, and other team to achieve stablished business goals,
· Design, implement, maintain and test stable, scalable real-time and batch data pipelines handling billions of records,
· Maintain Big Data System to ensure their reliability, availability and security,
· Propose new data architecture for new requirements and fine-tune the existing ones,
· Monitor data services, queries, ETL pipelines and resolve issues in case of any incident,
· Coordinate data access and security to enable data scientists and analysts to easily access data
· extending big data platforms with new tools and technologies.
Qualifications:
· Good knowledge of working with (at least one):
o Relational databases like Oracle, MySQL, or Postgres
o NoSQL databases: HBase, Elastic, or Solr
· Query and database performance tuning.
· Knowledge of Unix basis and bash scripting.
· Experience in at least one: “Python, Java, or Scala programming languages”.
· BS/MS in computer engineering/science.
· Good Communication and Teamwork Skills.
· Ability to solve complex data and tools issues.
Positive affection:
· Familiar with: Hadoop ecosystem components (HDFS, Yarn, Hive).
· Experience in monitoring systems like ELK, Grafana, Prometheus and Exporters.
مهارتهای مورد نیاز
- MySQL
- NoSQL
- Data engineer
حداقل سابقه کار
- مهم نیست
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- معافیت تحصیلی معافیت دائم پایان خدمت