LinkedIn Posts Scraper Extract posts, updates, and content from LinkedIn profiles and company pages. Perfect for social media monitoring, content analysis, and trend research. ## Features - ✅ Four scraping methods - ✅ Scrape posts from profiles - ✅ Extract company updates - ✅ Get engagement metrics - ✅ Download images and videos - ✅ Track content performance ## Scraping Methods (Categories) ### 1. Collect by URL Scrape specific LinkedIn posts using direct post URLs. Best for: Analyzing specific viral posts or tracking particular updates ### 2. Discover by Company URL Get all recent posts from a company's LinkedIn page. Best for: Brand monitoring, competitor analysis, company communications ### 3. Discover by Profile URL Extract all recent posts from a person's LinkedIn profile. Best for: Influencer tracking, thought leader monitoring, personal brand analysis ### 4. Discover by URL Discover posts from LinkedIn feed or search URLs. Best for: Trending content discovery, topic-based post collection ## How It Works Two-Step Process: 1. Generate Snapshot ID: Submit URLs to start collecting posts 2. Fetch Data: After 30 seconds, retrieve all post data with engagement metrics ## Input ### Required Fields - Action: Generate Snapshot ID or Fetch Data - Category: Choose your scraping method ### Input Fields For All Categories: - LinkedIn URLs: URLs relevant to your chosen category (one per line) For Fetch Data: - Snapshot ID: The ID from the generate step - Category: Must match the category used for generation ## Input Examples ### Example 1: Specific Posts json { "action": "generate_snap_id", "category": "collect_by_url", "urls": "https://www.linkedin.com/posts/billgates_activity-7000000000000000000/\nhttps://www.linkedin.com/posts/satyanadella_activity-7000000000000000001/" } ### Example 2: Company Posts json { "action": "generate_snap_id", "category": "discover_by_company_url", "urls": "https://www.linkedin.com/company/microsoft/\nhttps://www.linkedin.com/company/google/" } ### Example 3: Profile Posts json { "action": "generate_snap_id", "category": "discover_by_profile_url", "urls": "https://www.linkedin.com/in/williamhgates/\nhttps://www.linkedin.com/in/satyanadella/" } ### Example 4: Feed Discovery json { "action": "generate_snap_id", "category": "discover_by_url", "urls": "https://www.linkedin.com/feed/" } ### Example 5: Fetch Data (Wait 30 seconds!) json { "action": "fetch_data", "category": "collect_by_url", "snap_id": "linkedin_post_s_post123" } ## Data Extracted ### Post Content - Post title/headline - Full post text - Post type (text, image, video, article, poll) - Publication date and time - Direct post URL ### Author Information - Author name - Author profile URL - Author headline/title - Profile picture ### Engagement Metrics - Number of likes/reactions - Comment count - Share/repost count - Engagement rate - View count (when available) ### Media Content - Images (URLs to all images) - Videos (URLs and metadata) - Attached documents - Article links ### Additional Data - Hashtags used - Mentioned profiles - Post visibility (public/connections) ## Example Output json { "post_id": "7000000000000000000", "title": "Excited to share our latest innovation", "text": "Today marks a significant milestone for our team. We're launching a new AI-powered tool that will revolutionize how businesses operate...", "author": "Satya Nadella", "author_url": "https://www.linkedin.com/in/satyanadella/", "author_headline": "Chairman and CEO at Microsoft", "post_type": "image", "date": "2024-01-15T14:30:00Z", "likes_count": 45230, "comments_count": 1523, "shares_count": 3421, "engagement_rate": "10.2%", "post_url": "https://www.linkedin.com/posts/satyanadella_activity-7000000000000000000/", "images": [ "https://media.licdn.com/dms/image/..." ], "hashtags": ["#AI", "#Innovation", "#Technology"], "company": "Microsoft" } ## Step-by-Step Guide ### 1. Choose Your Category | Category | When to Use | |----------|-------------| | Collect by URL | You have specific post URLs | | Discover by Company | Track brand communications | | Discover by Profile | Monitor thought leaders | | Discover by URL | Explore trending content | ### 2. Generate Snapshot ID - Select "Generate Snapshot ID" - Choose your category - Enter URLs (one per line) - Run the actor - Save the snapshot ID ### 3. Wait 30 Seconds Let the scraping process complete ### 4. Fetch Your Posts - Select "Fetch Data" - Choose the same category - Enter your snapshot ID - Run to get results ## Important Notes ⚠️ Match Your Category The category used for fetching MUST match the category used for generating. Mixed categories will cause errors. ⚠️ 30-Second Wait Minimum Premature fetching results in incomplete or missing data. ⚠️ URL Format Matters - Post URLs: Must be activity URLs - Company URLs: Use main company page - Profile URLs: Use main profile page ## Use Cases ### Social Media Monitoring - Track brand mentions - Monitor competitor content - Analyze social sentiment - Identify trending topics ### Content Strategy - Benchmark engagement rates - Identify high-performing content - Optimal posting time analysis - Content type performance ### Influencer Marketing - Track influencer content - Measure reach and engagement - Identify brand ambassadors - Content collaboration opportunities ### Market Research - Industry trend analysis - Thought leadership tracking - Customer feedback monitoring - Product launch tracking ### PR & Communications - Monitor company announcements - Track executive communications - Crisis communication analysis - Brand perception research ## Tips for Maximum Insights ### Engagement Analysis - Compare engagement across time periods - Track post performance by content type - Identify viral content patterns - Measure audience response ### Content Planning - Study successful post formats - Analyze hashtag effectiveness - Determine optimal post length - Identify engaging visuals ### Competitive Intelligence - Monitor competitor posting frequency - Analyze their engagement rates - Track their messaging themes - Identify their top-performing content ## Common Questions Q: How many recent posts are collected? A: Typically the last 10-25 posts, depending on the profile/company activity. Q: Can I get older posts? A: Only recent posts that are visible on the page are collected. Q: Are images and videos downloaded? A: URLs to media are provided. You can download them separately. Q: Can I track post analytics over time? A: Run the actor periodically and compare results in your dataset. Q: What about private posts? A: Only publicly visible posts are collected. ## Category Selection Guide ### Collect by URL - ✅ Tracking specific viral posts - ✅ Analyzing competitor's best content - ✅ Monitoring campaign posts - ❌ Bulk content discovery ### Discover by Company - ✅ Brand monitoring - ✅ Complete company content audit - ✅ Corporate communication tracking - ❌ Individual thought leader posts ### Discover by Profile - ✅ Influencer content tracking - ✅ Thought leader monitoring - ✅ Executive communications - ❌ Company official updates ### Discover by URL - ✅ Trending content discovery - ✅ Topic-based research - ✅ Feed analysis - ❌ Specific user content ## Data Analysis Ideas ### Engagement Metrics - Average likes per post - Comment-to-like ratio - Share rate analysis - Engagement rate trends ### Content Performance - Best performing content types - Optimal posting times - Hashtag effectiveness - Topic popularity ### Competitive Benchmarks - Compare engagement rates - Content frequency analysis - Response time metrics - Audience growth correlation ## Export & Integration ### Export Formats - JSON: API and tool integration - CSV: Spreadsheet analysis - Excel: Business reporting - XML: System integration ### Data Uses - Import to analytics tools - Create engagement reports - Build content calendars - Power dashboards ## Best Practices 1. Regular Monitoring: Run daily/weekly for trends 2. Compare Metrics: Track changes over time 3. Content Types: Analyze which formats perform best 4. Timing Analysis: Find optimal posting times 5. **Hashtag