Identify, design,implement and optimize infrastructure supporting OLAP for fat processing of queries with custom aggregations.
Create and maintain a highly performing streaming platform for multiple source/destination event processing.
Create and maintain optimal data pipeline architecture and build the infrastructure required for optimal ETL from a wide variety of data sources.
Build processes supporting data transformation, data structures and metadata, dependency management.
Support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
Requirements:
3+ years of professional hands-on Data Engineering experience
A deep understanding of distributed database technologies.
Professional working knowledge of message queuing, stream processing, and highly scalable big data stores.
Experience performing root cause analysis on internal and external data and processes.
Strong analytic skills related to working with unstructured datasets.
Capability of collaboration with data scientists and architects
A deep knowledge of fundamental CS concepts; such as common data structures and algorithms.
Solid understanding of the architectural patterns of large, high-scale data-intensive applications.
Ability to write high-performance, maintainable and clean code.
Experience working in an agile environment utilizing Scrum, Kanban or XP
Demonstrated success in building infrastructure in the public cloud and deploying through CI/CD pipelines, utilizing technologies such as YAML, Python, Ansible, Docker, Kubernetes , etc;
You can influence by laying out the pros and cons of different options and propose the reasoning which supports your decisions through iterative solutions, and clearly and concisely communicate about complex technical, architectural, or organizational problems.
You have effective communication skills and maintain an open-mind and foster a collaborative atmosphere that makes people eager to work with you and regularly achieve consensus with peers and clear status updates.
Self-motivated and self-managing.
معرفی شرکت
در دیتاآرت همراه با تیمی جوان و چالاک در حال توسعه پلتفرم داده و تجربه مشتری (CDXP) هستیم. در تلاشیم با ارائه راهکاری تکنولوژیمحور به کسبوکارها کمک کنیم تا بتوانند به راحتی دادههای خود را از منابع مختلف جمعآوری و یکپارچه کنند، با استفاده از هوش مصنوعی دادهها را غنی کنند و در نهایت دادهها را در جهت اهداف مختلف کسبوکار فعال سازند.