استخدام Big Data Architect
شرح موقعیت شغلی
About the Role
As a Big Data Architect, you are tasked with understanding data-related aspects of Snapp business goals along with client’s requirements and challenges, and accordingly, developing data management and processing strategies. You need to have in-depth knowledge of various state-of-the-art big data tools and techniques, also you should recognize their use-cases in order to fit them as components of your data architectures that identify the best solutions.
Responsibilities:
- Development of proposals for implementation and design of scalable big data architecture
- Design, implement, and deploy high-performance, custom applications at scale on Hadoop
- Understand customer and business requirements in a close collaboration with responsible stakeholders and render those as architectural models that will operate at large scale and high performance.
- Define common business and development processes, platform and tools usage for data acquisition, storage, transformation, and analysis
- Understand best-practices in data architectural design, reference architectures, and well-known design patterns.
- Be problem solver and employ suitable big data tools and techniques to solve the problem.
- Develop roadmaps and implementation strategy around data science initiatives including recommendation engines, predictive modeling, and machine learning
- Articulate architectural differences between solution methods and analyze the advantages/disadvantages of each.
- Define policies and establish standards for modeling, structuring, naming, describing, securing, and formatting data
- Serve as a consultant and leader on all aspects of a modern and flexible SDLC approach, applied to data engineering, analytics and data science efforts.
- Design and build modular, scalable, fault-tolerant, high available (HA), reusable architectures.
- Stay abreast of emerging technologies and projects in the modern data management/engineering space and follow and evaluate their benchmark periodically.
- Hands-on project and development work, as demanded by the project and client role.
Qualifications:
- BS or MS in Computer Science/Engineering or equivalent relevant experience
- 7 years of related experience and demonstrated leadership in the fields of architecting data.
- Ability to think strategically and relate architectural decisions/recommendations to business needs and client culture
- Ability to assess data warehouse and business intelligence architectural components required based on business needs.
- Experience with major big data technologies and frameworks including but not limited to Hadoop, MapReduce, Pig, Hive, HBase, Oozie, Mahout, Flume, ZooKeeper & Sqoop
- Deep understanding of different kinds of NoSQL technologies and their use-cases is plus.
- Familiar with Docker/Kubernetes/OKDs for running services in cloud.
- Experienced across all phases of data modeling, from conceptualization to database optimization
- Knowledge of how to assess the performance of data solutions, how to diagnose performance problems, and tools used to monitor and tune performance
- Deep understanding of indexing and searching
- Being familiar with architectural/design patterns in big data
- Familiar to bash scripting and Linux systems administration
مهارتهای مورد نیاز
- NoSQL
- Docker
- kubernetes
- Linux
حداقل سابقه کار
- بیش از شش سال
جنسیت
- مهم نیست
وضعیت نظام وظیفه
- معافیت تحصیلی معافیت دائم پایان خدمت