استخدام Data Software Engineer

  • دسته‌بندی شغلی

    وب،‌ برنامه‌نویسی و نرم‌افزار
  • موقعیت مکانی

    تهران ، تهران
  • نوع همکاری

    تمام وقت
  • حداقل سابقه کار

    سه تا شش سال
  • حقوق

    توافقی

شرح موقعیت شغلی


About the Team

Dataak (دیتاک) runs a large-scale social media and web harvesting platform, collecting data from Persian-language sources. Our Data / Harvesting Platform squad builds the scrapers, streaming pipelines, and storage layers that turn raw web data into searchable, analyzable data powering our dashboards, chatbot, bulletins, and alerting products.

We're actively evolving our data infrastructure, and you'll get hands-on exposure to both our production systems and the next-generation architecture we're building.


What You'll Do

  • Build and maintain web/social media scraping bots (Python, Scrapy).
  • Develop and operate ETL pipelines that extract, validate, transform, and load data into Elasticsearch, Kafka, and other stores.
  • Contribute to our Kafka-based streaming backbone — producers, consumers, topic design, and monitoring.
  • Support the ongoing migration to a lakehouse architecture (Iceberg, OpenSearch, Trino, Spark) by helping build and test Spark Structured Streaming ingest jobs and batch migration pipelines.
  • Write and maintain Airflow DAGs for orchestration, scheduling, and monitoring of data pipelines.
  • Debug data quality issues, pipeline failures, and scraper breakages (e.g., anti-bot changes, schema drift, rate limiting).
  • Write tests for new bots, converters, and pipeline components; follow code review practices.
  • Collaborate with the wider Data squad, following the team's design-first process for non-trivial changes before implementation.

What We're Looking For

  • 1–2 years of hands-on experience as a software or data engineer (internships and strong personal/academic projects count toward this).
  • Solid Python fundamentals: writing clean, testable code, working with virtual environments and package managers (e.g., pip, uv).
  • Understanding of ETL/data pipeline concepts — extract, transform, load, validation, incremental processing.
  • Familiarity with at least one of: web scraping (requests, Scrapy, BeautifulSoup, or similar), or streaming systems (Kafka or equivalent).
  • Working knowledge of SQL and NOSQL  and comfort with at least one database (MySQL, Mongo, or similar).
  • Basic understanding of Elasticsearch or another search/indexing system (or strong willingness to learn).
  • Comfortable working with Linux, Git, and Docker in day-to-day development.
  • Good debugging skills and ability to reason about data correctness, not just “code that runs.”
  • working proficiency in technical English (reading docs, writing code/comments).

Nice to Have

  • Exposure to Apache Spark, Apache Airflow, or Kubernetes.
  • Familiarity with data lakehouse concepts (Iceberg, Delta Lake, Hudi) or columnar/analytical storage.
  • Experience with Elasticsearch/OpenSearch indexing, mappings, or query DSL.
  • Interest in Persian-language NLP or social media data analysis.
  • Experience with monitoring/observability tools (Grafana, Prometheus).

Why Join Us

  • Work on a large-scale, real-world data platform processing high-volume Persian-language social data.
  • Direct mentorship from senior engineers and hands-on involvement in a live lakehouse migration — rare exposure for an engineer at this level.
  • A small, tight-knit squad where your work ships to production and is directly visible in the product.
  • Room to grow from ETL/scraping fundamentals into distributed data systems (Spark, Iceberg, streaming architectures).

معرفی شرکت

دِیتاک شرکتی دانش بنیان و تخصصی درحوزه داده کاوی(Data Mining) و کلان داده(Big Data) است. در دیتاک محصولاتی ارائه می دهیم که می‌تواند به تصمیم‌گیری‌ها کمک کند، ریسک‌ها را کاهش دهد و مشکلات را شناسایی کند تا کیفیت محصول و عملکرد مشتری را بهبود و ارتقا بخشد.
کار تیمی، خلاقیت و نوآوری، اشتراک‌گذاری دانش و تجربیات، حل چالش های سخت از ارزش های کلیدی فرهنگ دِیتاک است.
  • مهارت‌های مورد نیاز

    Java NoSQL Git
  • جنسیت

    مهم نیست
  • وضعیت نظام وظیفه

    مهم‌ نیست
  • حداقل مدرک تحصیلی

    کارشناسی

مشاغل مشابه

چه موردی را می‌خواهید گزارش کنید؟

از اینجا شروع کنید

در شغل بهتری استخدام شوید! رایگان!

  • جستجو و ارسال رزومه به آگهی‌های استخدام بیش از ۱۰۰,۰۰۰ شرکت ایرانی
  • رزومه‌ساز رایگان
  • دریافت فرصت‌های شغلی جدید مرتبط از طریق ایمیل (Job Alert)
  • شناخت محیط کار و فرهنگ سازمانی شرکت‌های در حال استخدام
image/svg+xml