Investors Business Daily News Scraper

Overview

This actor scrapes financial news articles from InvestorsBusinessDaily.com. It extracts structured data from the site and exports it to formats like JSON, CSV, XML, or Excel. The tool is designed for developers and analysts who need programmatic access to IBD's financial news content.

Key Features

• Scrapes article data including titles, authors, publication dates, and summaries.
• Extracts associated stock ticker symbols for market analysis.
• Captures metadata like article sections, image URLs, and premium content flags.
• Outputs data in multiple structured formats for easy integration.
• Runs on the Apify platform, handling scaling and proxy management.

How to Use

1. Configure the actor's input parameters (see Input section).
2. Run the actor on Apify. It will navigate the site and extract data based on your configuration.
3. Retrieve the results from the actor's dataset in your chosen format.

Input

Configure the scraper via the input schema on Apify. Key parameters typically include:
* Start URLs: The IBD article or section pages to begin scraping from.
* Max Articles: A limit on the number of articles to scrape.
* Proxy Configuration: Settings for using proxies during the crawl.

For the complete and current input schema, visit the input tab.

Output

The actor outputs an array of article objects. Each object contains structured fields as shown in the example below.

[
  {
    "Id": 9302704,
    "Title": "Dow Jones Futures: Stock Market Rally Begins; Nvidia Partner Super Micro Falls Late",
    "Author": "ED CARSON",
    "AuthorUrl": "https://www.investors.com/author/carsone/",
    "Abstract": "A rally attempt has begun, but it's too soon to get excited. Nvidia partner Super Micro led key earnings late.",
    "PublishDate": "2024-08-06T21:46:01",
    "PublishDateForDisplay": "08/06/2024 09:46 PM ET",
    "Symbols": [ "AMGN", "MELI", "META", "NVDA", "PLTR", "RDDT", "RIVN", "SMCI", "TOST", "TSLA" ],
    "ImageUrl": "https://www.investors.com/wp-content/uploads/2017/11/stock-bull-tongue-adobe.jpg",
    "Section": "Market Trend",
    "Column": "Stock Market Today",
    "Url": "https://www.investors.com/market-trend/stock-market-today/dow-jones-futures-market-rally-nvidia-super-micro/",
    "IsPremium": false
  }
]

Legal Note

Be aware of legal considerations when scraping. Personal data is protected by regulations like the GDPR. Ensure you have a legitimate purpose for scraping and that your use case complies with the website's Terms of Service and relevant laws. Consult legal counsel if unsure.

Contact

For custom solutions or modifications, contact the actor developer directly at hello@mscraper.com. You can also browse other scrapers on the Apify profile.