Junior Python Developer focusing on web scraping and data extraction at Beemôn. Collaborating with the engineering team to develop and maintain data collection scripts.
Responsibilities
Develop and maintain scripts and crawlers for automated data collection.
Create spiders using Scrapy, Requests and BeautifulSoup (bs4).
Automate navigation on dynamic pages using Selenium.
Assist with configuring and using proxies and VPNs for data collection.
Work with queues and asynchronous processing using Celery, Redis and RabbitMQ.
Integrate collected data with internal systems built with Django.
Store and manipulate data using PostgreSQL.
Monitor crawler runs and identify failures or inconsistencies in data collection.
Identify and handle common scraping blocks, such as rate limiting, incorrect headers, or session issues.
Requirements
Knowledge of Python.
Basic understanding of HTTP, HTML and REST APIs.
Basic knowledge of web scraping.
Familiarity with Git and version control workflows.
Basic experience working in teams using agile methodologies.
Basic knowledge of SQL.
Benefits
Education assistance
Career development plan
Fuel allowance
Wellness
Quick Massage
Meal allowance
Health insurance
Flexible schedule
Job title
Junior Python Developer – Web Scraping, Data Extraction
Praktikant zur Erlangung der Fachhochschulreife bei Lebenshilfe Bonn. Einblick in die verschiedenen Bereiche der Arbeit mit Menschen mit Beeinträchtigung.
Backend Engineering Manager responsible for leading backend infrastructure team at Fun.xyz. Delivering robust Web3 payment systems while fostering technical excellence and team growth.
Gen AI Python Developer at Citi focusing on Generative AI technologies and robust Python applications. Collaborating in a dynamic engineering team to build innovative AI - powered solutions.
Platform Architect responsible for end - to - end architecture of enterprise data platforms at Carrier. Leading data governance and technical integrity across cloud environments.
Drupal Developer responsible for feature design and implementation in a multidisciplinary team. Ensuring high CMS performance and collaborating with internal teams.
Java Developer enhancing banking applications at Handelsbanken. Collaborating with teams on the full software development lifecycle from design to deployment in London, UK.
Developing Python applications for an innovative education platform at Keeps. Involved in projects that aim to revolutionize education and create growth opportunities.
Designing and implementing scalable systems using Python, GCP, and Terraform. Collaborating with teams to automate processes and enhance system performance.
Engineer for measurement technology developing automated test software and systems for secure communication solutions. Focus on integrating external measurement systems and analysis of data processes in a hybrid role.
AI - First Developer building innovative AI - driven tools and prototypes at GenLayer Labs. Collaborating with a technical team in a hybrid environment to explore AI and blockchain technologies.