Job: Python Engineer (Data Integrations)

Description

Our client is in search of a highly skilled and motivated Python Engineer to join their growing team. In this role, you will work closely with the CTO and the engineering team to design, develop, and maintain first-party and second-party data integration solutions with a strong focus on data scraping. You will be responsible for building robust systems to collect, integrate, and manage data from various sources, ensuring reliability, accuracy, and scalability. Reporting to the CTO, you will work on new initiatives and optimize existing processes to support our expanding product portfolio.

Responsibilities 

• Design, build, test, and maintain scalable Python-based solutions for first-party and second-party data integrations and web scraping.
• Collaborate with engineering and product teams to define integration and scraping requirements for both internal and external data sources.
• Develop efficient and maintainable scraping solutions to extract data from websites, APIs, and other digital platforms, ensuring high-quality data collection.
• Implement systems to handle data integration from external partners (second-party data) while ensuring compliance with data-sharing agreements.
• Optimize data scraping processes for speed, performance, and accuracy, handling large-scale data extractions.
• Monitor and troubleshoot issues related to data scraping, integrations, and related infrastructure.
• Use agile methodologies to manage tasks and deliverables, working closely with cross-functional teams.
• Ensure the accuracy, consistency, and security of data collected through scraping and integrations.
• Keep up-to-date with industry trends and best practices in data scraping, web technologies, and Python development.
• Contribute to the overall success of the team by taking on additional responsibilities as required in a dynamic environment.

Requirements

• 3+ years of Python engineering experience, with a strong focus on web scraping and data integrations.
• Expertise in Python and relevant libraries (BeautifulSoup, Selenium).
• Experience working with first-party and second-party data, integrating data from various sources (including APIs, web scraping, and partner data systems).
• Proven ability to scale scraping operations, manage proxies, IP rotation, and solve anti-scraping challenges.
• Strong understanding of web technologies (HTML, CSS, JavaScript) and RESTful APIs.
• Familiarity with databases (SQL and NoSQL) for handling, storing, and processing scraped data.
• Experience with cloud platforms (AWS, GCP, or Azure) and containerization tools (Docker, Kubernetes) is a plus.
• Strong problem-solving, debugging, and performance optimization skills.
• Excellent communication skills in English (Spanish is a plus).
• Ability to work independently and remotely in a fast-paced environment.