Senior Software Engineer - Crawling (m/f/d)

About the Job

We’re growing fast and looking for a hands-on Senior Software Engineer (m/f/d) to help us unlock and scale access to the world’s data. You’ll design and build high-performance web crawlers, scraping systems, and data pipelines that power our next-generation products.

This is a chance to work on complex engineering challenges with massive real-world impact. You’ll work alongside a sharp, collaborative team and ship production systems end-to-end. If you’re passionate about building tools that ingest, process, and deliver data at scale—we want to talk.

What you will do

• Build and scale web crawling and scraping systems that can handle dynamic, large-scale data extraction.
• Design robust pipelines for data ingestion , cleaning, and enrichment.
• Work closely with product and ML teams to deliver data-driven features.
• Deploy and operate containerized apps in cloud environments ( AWS, Azure, GCP ).
• Improve and automate deployments with CI/CD , Ansible , or serverless stacks.
• Stay ahead of anti- bot measures, optimizing systems for reliability and performance.
• Contribute to technical architecture and help shape the engineering culture.

Your profile

• 5+ years of professional software development experience.
• Strong skills in Python (bonus: Go , Java/Spring Boot ).
• Hands-on experience with web scraping , data pipelines , and the challenges of large-scale data collection.
• Solid experience with Docker and cloud platforms ( AWS , Azure, or GCP).
• Proficiency with Git , CLI tools, and containerized deployments.
• Familiarity with tools like Apache Airflow , Ansible , or serverless architectures.
• Clear communicator who thrives in a collaborative, fast-paced environment.
• Comfortable working onsite/hybrid with a tight-knit team.

• Full-stack skills (React, Angular, or Vue) - or willingness to learn frontend quickly.
• Experience with ML pipelines, data labeling workflows, or Large Language Models (LLMs).
• Knowledge of anti-scraping measures.
• Familiarity with Terraform, Kubernetes, and modern DevOps tooling.

Why us?

• Hybrid work in Munich.
• Flexible working time.
• 30 days of vacation per year.
• 30 days of workcation per year, in the EU and some selected countries.
• High autonomy and flat hierarchies.
• Direct access to the users and quick iteration cycles.

Closing

We welcome candidates from all backgrounds and encourage diversity in our team. We encourage diverse people to apply and join our mission-driven culture that values open communication, work-life balance, and a welcoming environment. Convince us with your personality and your skills - and together we will make great things happen!

About us

Founded in 2021, we at Certivity are a creative, and dynamic team of highly skilled domain experts working on innovative RegTech Software. Our solution will shape and define the term “RegTech” as we develop a completely new product for the highly complex and not yet digitized environment of product regulations. Our primary focus is the automotive industry, with options to expand to many other domains as well. Our B2B cloud platform bundles all relevant tasks for compliance with vehicle regulations and laws. For more information about us and our product have a look at our website.