تفاصيل الوظيفة
Senior Web Scraping & Anti-Bot Engineer
Job Overview
We are seeking a highly skilled Web Scraping & Anti-Bot Engineer with expertise in building high-performance automation and data extraction systems for complex, high-traffic platforms. The ideal candidate will have strong experience with DataDome, Queue-it, reverse engineering modern web apps, and developing resilient systems for dynamic, time-sensitive environments. This role requires ongoing research into evolving anti-bot technologies and fast adaptation to changing site architectures.
Key Responsibilities
- Build and maintain high-performance automation and data extraction systems for dynamic, high-demand platforms.
- Design scalable solutions for high-traffic events and time-critical releases.
- Reverse engineer web apps, APIs, and client-side JavaScript to understand workflows and network behavior.
- Research anti-bot protections and implement reliable bypass strategies for evolving security systems.
- Work with DataDome, Queue-it, CAPTCHA systems, CDNs, and other anti-automation technologies.
- Develop browser and HTTP automation handling authentication, sessions, cookies, and fingerprinting.
- Optimize performance, speed, reliability, and resource usage.
- Monitor production systems, quickly identify issues, and deploy fixes with minimal downtime.
- Build internal tools to improve reliability, monitoring, and efficiency.
- Collaborate with engineering teams to adapt to platform changes and improve performance.
Required Skills
- Expert-level Python and JavaScript.
- Strong experience in advanced web scraping and browser automation.
- Deep understanding of reverse engineering web apps and APIs.
- Experience with:
- DataDome
- Queue-it
- CAPTCHA systems
- CDN/WAF protections
- Browser fingerprinting
- Proxy/IP management
- Session and cookie handling
- Experience with Playwright, Puppeteer, Selenium, or similar tools.
- Strong knowledge of HTTP/HTTPS, WebSockets, REST, GraphQL, JSON, and async programming.
- Excellent debugging and analytical skills.
Preferred Qualifications
- Experience with distributed automation systems.
- Familiarity with Docker, Linux, Git, and cloud infrastructure.
- Understanding of HTTP/2, HTTP/3, TLS, and browser internals.
- Experience maintaining production-grade, high-availability systems.
What We're Looking For
- Strong research and problem-solving abilities.
- Fast adaptation to changing anti-bot systems and web architectures.
- Self-driven and able to work independently.
- High attention to detail and reliability.
- Ability to perform under tight deadlines and high-pressure conditions.