استخدام Data Engineer
شرح موقعیت شغلی
Job Description
Responsibilities
- Design, optimally develop, and maintain standard data pipelines according to data integration principles and business goals.
- develop and test data systems to create robust and scalable applications for data analytics.
- Work as an individual contributor as well as part of a team in building, maintaining, and troubleshooting data pipelines.
- Backup and Disaster Recovery
- Network, Security, and Database Administration, maintaining the integrity, performance, and efficiency of the database system
- troubleshoot and fix issues that compromise system performance or access to an IT service
Requirements
- Deep understanding of Docker, CI/CD, and Linux.
- Demonstrated experience driving meaningful business outcomes through data engineering.
- Highly proficient in SQL and a scripting language like Python.
- Experience building or working with metadata-driven ETL/ELT patterns and concepts.
- Good analytical and quantitative abilities.
- Familiar with data service ecosystems including data warehousing, lakes, and metadata.
- Being familiar with OLAP, Hadoop, Spark, Kafka, or Metabases is a plus.
- Familiar with configuration management.
مهارتهای مورد نیاز
- Python
- SQL
- Big Data
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست