استخدام Analyst) Data Engineer)
شرح موقعیت شغلی
Responsibilities:
Build and maintain data pipelines from internal databases and applications
Write maintainable, performant code
Collaborate with other domains to ensure data needs are addressed
Maintain and expand data infrastructure for the business at scale
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
Create and maintain tools supporting data pipeline management
Maintain our data warehouse with timely, high quality data
Minimum Qualifications:
2+ years experience deploying production quality code, including experience in or close proximity to a data engineering, data science, or data analytics
Experience using big data stack (Hadoop, Airflow, Kafka, Nifi, ...)
Experience working with at least CDC technologies (StreamSets, Debezium, …)
Experience writing SQL, structuring data, and data storage practices
Experience using Python for data processing
Knowledge of data warehousing concepts
Demonstrated self-direction
Demonstrated willingness to both teach others and learn new techniques
Desire to continually keep up with advancements in data engineering practices
Basic Knowledge of CI/CD
Basic Knowledge of docker and kubernetes
Build and maintain data pipelines from internal databases and applications
Write maintainable, performant code
Collaborate with other domains to ensure data needs are addressed
Maintain and expand data infrastructure for the business at scale
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
Create and maintain tools supporting data pipeline management
Maintain our data warehouse with timely, high quality data
Minimum Qualifications:
2+ years experience deploying production quality code, including experience in or close proximity to a data engineering, data science, or data analytics
Experience using big data stack (Hadoop, Airflow, Kafka, Nifi, ...)
Experience working with at least CDC technologies (StreamSets, Debezium, …)
Experience writing SQL, structuring data, and data storage practices
Experience using Python for data processing
Knowledge of data warehousing concepts
Demonstrated self-direction
Demonstrated willingness to both teach others and learn new techniques
Desire to continually keep up with advancements in data engineering practices
Basic Knowledge of CI/CD
Basic Knowledge of docker and kubernetes
مهارتهای مورد نیاز
- Data Analysis
- SQL
- kafka
- Python
حداقل سابقه کار
- سه تا شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- مهم نیست