Dataak (دیتاک) runs a large-scale social media and web harvesting platform, collecting data from Persian-language sources. Our Data / Harvesting Platform squad builds the scrapers, streaming pipelines, and storage layers that turn raw web data into searchable, analyzable data powering our dashboards, chatbot, bulletins, and alerting products.
We're actively evolving our data infrastructure, and you'll get hands-on exposure to both our production systems and the next-generation architecture we're building.
What You'll Do
Build and maintain web/social media scraping bots (Python, Scrapy).
Develop and operate ETL pipelines that extract, validate, transform, and load data into Elasticsearch, Kafka, and other stores.
Contribute to our Kafka-based streaming backbone — producers, consumers, topic design, and monitoring.
Support the ongoing migration to a lakehouse architecture (Iceberg, OpenSearch, Trino, Spark) by helping build and test Spark Structured Streaming ingest jobs and batch migration pipelines.
Write and maintain Airflow DAGs for orchestration, scheduling, and monitoring of data pipelines.
Debug data quality issues, pipeline failures, and scraper breakages (e.g., anti-bot changes, schema drift, rate limiting).
Write tests for new bots, converters, and pipeline components; follow code review practices.
Collaborate with the wider Data squad, following the team's design-first process for non-trivial changes before implementation.
What We're Looking For
1–2 years of hands-on experience as a software or data engineer (internships and strong personal/academic projects count toward this).
Solid Python fundamentals: writing clean, testable code, working with virtual environments and package managers (e.g., pip, uv).
دِیتاک شرکتی دانش بنیان و تخصصی درحوزه داده کاوی(Data Mining) و کلان داده(Big Data) است. در دیتاک محصولاتی ارائه می دهیم که میتواند به تصمیمگیریها کمک کند، ریسکها را کاهش دهد و مشکلات را شناسایی کند تا کیفیت محصول و عملکرد مشتری را بهبود و ارتقا بخشد.
کار تیمی، خلاقیت و نوآوری، اشتراکگذاری دانش و تجربیات، حل چالش های سخت از ارزش های کلیدی فرهنگ دِیتاک است.