📌 Freelancermap Scraper – Extract Freelancer Profiles at Scale ## Overview This scraper allows you to extract freelancer profile data from Freelancermap.de at scale. It collects structured information such as: - 👤 Basic profile details (name, title, location, description) - 💼 Skills & expertise - 📂 Project history - 🏅 Certifications - 📞 Contact details (phone & email) – requires login - 📑 Profile PDF download (optional) The scraper is fast, reliable, and production-ready, making it ideal for: - Building lead lists - Market & skills analysis - Recruiting & HR workflows - Integrating freelancer data into your CRM or dashboards --- ## ⚙️ Input Configuration The scraper accepts the following parameters using a JSON input object. ### Example input: json { "email": "your-login-email@example.com", "password": "your-password", "startPage": 7, "endPage": 8, "includeEmail": true, "includePhone": true, "pdfdownloadonoff": true, "maxConcurrency": 1, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [] }, "startUrls": [ "https://www.freelancermap.de/freelancer-verzeichnis.html?availability=100&maxHourlyRate=90&sort=3&matchingSkills%5B0%5D=KSNQCEX0FGMCVVVXQ0MD&matchingSkills%5B1%5D=KS1285T645JRKKFWSV0W&matchingSkills%5B2%5D=KS1202B652YN84D9KXMX&matchingSkills%5B3%5D=KS121F45VPV8C9W3QFYH&languages%5B0%5D=5&remoteOnly%5B0%5D=0&placeOfWorkMode=radius&query=UX+Designer&countries%5B%5D=1&countries%5B%5D=2&countries%5B%5D=3&location=2925533&radius=250&city=Frankfurt+am+Main&pagenr=1" ] } --- ## 🔑 Login vs. No-Login Usage - ✅ Without login → Scraper works seamlessly and extracts profile data (skills, projects, certifications, etc.). - 🔑 With login → Required only if you want contact details (phone/email) or PDFs. Controlled via the input parameters: - "includeEmail": true - "includePhone": true - "pdfdownloadonoff": true 👉 If all three are set to false, login is not required. --- ## ⚡ How It Works 1. The scraper navigates through search results pages (startPage → endPage). 2. Profile URLs are collected and added to the request queue. 3. Each profile is opened, and details are extracted using robust Playwright locators. 4. If login + contact details are enabled, the scraper clicks the Contact Details button and extracts phone/email. 5. Data is stored in clean JSON format (and optionally PDFs). --- ## 🌟 Key Features - ✅ Works with or without login - ✅ Extracts all freelancer details (Basic profile details, skills, history, certifications) - ✅ Optional contact info & PDF download - ✅ Fully scalable (crawl thousands of profiles) - ✅ Proxy support for reliability