EPC Scraper

🏡 What is EPC Scraper? This EPC Scraper will enable you scrape any energy performance certificate from find-energy-certificate.service.gov.uk. You can simply take your listing url from browser and enter it into this actor. This actor will crawl through all pages of particular listing and generate dataset for you. Listing url is something you get when you perform the search on epc site. Example listing urls : - https://find-energy-certificate.service.gov.uk/find-a-certificate/search-by-postcode?postcode=BN1+3JB ## 🚪 What can this EPC Scraper do? 📈 Extract EPC certificates from official UK epc site 👀 This actor is not just scraper but also has monitoring capability. You can turn on monitoring mode and it will give you only newly added epc compared to your previous scrapes. 📩 This actor also helps yu to identify which epc are expired. ⬇️ Download epc data in Excel, CSV, JSON, and other formats ## 📚 How do I start scraping with this scraper? 1. Register for your free Apify account here 2. You don't need to provide your credit card details for free acount. Just click on "Get Started" button on above link and complete the registration only. 3. Free account comes with reasonable credits to try out this actor. This actor also comes with free trial of 3 days without any commitment/upfront charge. 4. Run this actor and verify the scraped data. Apify has huge integration possibilities. You can download the data or push the data into any 3rd party platform directly. ## 🌳 What epc data can I extract using this tool? | 📝 | 📝 | | ------------------ | ------------------------------- | | Rating | Full Address | | EPC URL | Locality | | Postcode | Property Type | | Floor Area | Expiry Stats | | Current Score | Potential Score | | Primary Usage | Average Bill | | Potential Saving | Year | | Produced CO2 | Potential CO2 | | Assesor Name | Assesor Phone | | Assesor Email | Accreditation Details | | Assessment Date | Certificate Date | | Assessment Type | Certificate Expiry Date | | Fetaures | Proposed Changes | ## ⬇️ Input For simple usecase, you just need to provide browser url of rightmove search result page & that's all. You can leave other fields as they are to be sensible defaults. ### Input example json { "listUrls": [ { "url": "https://find-energy-certificate.service.gov.uk/find-a-certificate/search-by-postcode?postcode=BN1+3JB" } ], "fullScrape": true, "monitoringMode": false, "addEmptyTrackerRecord" : false } Understading monitoring mode : - fullScrape : This option is by default turned on. When enabled it always force actor to scrape complete listing from all pagination pages regardless of monitoring is enabled or not. - monitoringMode : This option when turned on will only scrape newly added epc compared to previously scraped epc by this actor. It's important to turn off fullScrape setting if you are using this mode. If you keep fullScrape on, it will re-scrape complete listing again. - addEmptyTrackerRecord : This option when turned on will add empty record having only id of epc to Apify dataset. This helps you identify whether epc is still listed compared to your own database in incremental mode. ## ⬆️ Output The scraped data is stored in the dataset of each run. The data can be viewed or downloaded in many popular formats, such as JSON, CSV, Excel, XML, RSS, and HTML. ### Output example The result for scraping a single property like this: json { "url": "https://find-energy-certificate.service.gov.uk/energy-certificate/0010-2129-7282-2472-9215", "postCode": "BN1 3JB", "locality": "BRIGHTON", "address": "Flat 6,36 Dyke Road", "rating": "C", "id": "0010-2129-7282-2472-9215", "propertyType": "Mid-floor flat", "floorArea": "35 square metres", "currentScore": "75 C", "potentialScore": "79 C", "features": [ { "name": "Wall", "description": "Solid brick, with internal insulation", "rating": "Good" }, { "name": "Window", "description": "Partial double glazing", "rating": "Poor" } ], "primaryUsage": 327, "averageBill": 488, "potentialSaving": 94, "averageCostYear": 2022, "co2Produces": 1.9, "co2Potential": 1.5, "changes": [ { "name": "Heat recovery system for mixer showers", "installationCost": "£585 - £725", "yearlySaving": "£36", "potentialRating": "76 C" }, { "name": "Double glazed windows", "installationCost": "£3,300 - £6,500", "yearlySaving": "£59", "potentialRating": "79 C" } ], "assessorName": "Paul Cronin", "assessorPhone": "01273 977447", "assessorEmail": "paul@croninspropertychecks.com", "accreditationScheme": "Stroma Certification Ltd", "accreditationAssessorID": "STRO033856", "accreditationPhone": "0330 124 9660", "accreditationEmail": "certification@stroma.com", "assessorDeclaration": "No related party", "assessmentDate": "31 August 2022", "certificateDate": "6 September 2022", "assessmentType": "RdSAP", "otherCertificates": [ { "id": "0576-2869-6215-9092-1251", "expiryDate": "16 September 2022" } ], "validtillDate": "5 September 2032", "expired": false } ## ❓Limitations Since epc site allows only search by full post code, you need to provide multiple such post code list urls to cover larger targetted area. Good News is that even if multiple list urls contains overlapping results, they will get deduplicated within same run data. ## 🙋‍♀️ For custom solutions In case you need some custom solution, you can contact me : dhrumil@techvasu.com Or learn more about me on github : https://github.com/dhrumil4u360