Category Archives: Data

Solar Data

Solar radiation data is best obtained direct from sensors, be it ground stations, satellite observation networks, or modeled solutions that combine both.  To this end, solar data is available from various databases, modeling projects, and commercial venders….all with varying degrees of quality.

Posted in Data, Resource Assessment, Solar | Leave a comment

Renewable Generation

Introduction to Renewable Generation

Renewable generation includes sources of energy that renew themselves constantly through natural processes and will never run out during normal human time-scales. Renewable energies come from three primary sources: the Sun, heat from the inner Earth, and tidal power.  The Sun, in turn fuels the wind and, indirectly, most biomass resources.

Posted in Data, Economics, Engineering, RE Policy | Leave a comment

Thermal Generation

Thermal Generation Efficiencies

Thermal generation relies on fossil fuels and renewable fuel sources like biomass, biogass, waste=to-energy and geothermal.  The following section indicates thermal efficiency ranges for converting primary energy into electricity based on standard market and state-of-the-art equipment.  The efficiency values reported do not include losses attributed to plant availability such as planned maintenance, unforced outages, and grid curtailments.

Posted in Data, Economics, Engineering, RE Policy | Leave a comment

Weather Data

Weather data sources are presented that were collated to support wind and solar resource assessment, engineering design, and power system monitoring.  Data sources include ground stations, satellite observation networks, reanalysis data, forecasts systems, and aerosol models.

All links and content have been extracted from data source websites to facilitate ease of access to data servers.  Please contribute if you find links have changed or data product definitions should be updated.

Posted in Data, Dust, Meteorology, Resource Assessment, Solar, Wind | Leave a comment

Aerosol Data

Intro to Aerosol Data

Aerosol data can be obtained from several sources.  It is important to point out that aerosol data has many uncertainties.  Measuring atmospheric aerosols is a challenge due to the large range in particle size, shape, concentration and  composition. No single instrument can measure all the aerosol properties, and detection methods of the smallest sub-3 nm particles are still developing.

Posted in Data, Meteorology | Comments Off on Aerosol Data

Climate Models and Reanalysis Data

Intro to Reanalysis Data

Reanalysis Data - Wind SpeedReanalysis is a scientific method for developing a comprehensive and consistent record of how the weather and climate are changing over time.  Reanalysis data relies on the assimalation of sensor data from multiple sources and numerical weather prediction models to produce a continually updated, gridded data set that describes the state of the Earth’s atmosphere at difference points in time and space.  Gridded reanalysis data is available from different sources.  The different data sources vary with respect to

Posted in Data, Meteorology, Resource Assessment | Comments Off on Climate Models and Reanalysis Data

Forecast Systems

Weather and atmospheric forecast data can be obtained from the following forecast systems:

Posted in Data, Meteorology | Comments Off on Forecast Systems

Observation Networks

Introduction to Satellite Observation Networks

Satellite observation networks provide invaluable data on the climate and the layered atmosphere.  Space satellite data is a key input to assess the feasibility and operational integrity of renewable energy power systems.

Posted in Data, Meteorology, Resource Assessment | Comments Off on Observation Networks

Ground Stations

Ground station sensors for weather and climate observation are listed below.  The list is limited to station networks that that provide verification of wind and solar resource data.

Posted in Data, Meteorology, Resource Assessment | Comments Off on Ground Stations

Fuel Cells


fuel_cell2A fuel cell converts the chemical energy from a fuel into electricity, heat and water through a chemical reaction with oxygen. Hydrogen is the most common fuel and is produced from the steam methane reforming of natural gas, but for greater efficiency hydrocarbons can be used directly, be it natural gas, gasoline, or alcohols like methanol.

Since fuel cells rely on an electrochemical process and not combustion, emissions from fuel cells are significantly lower than emissions from even the cleanest fuel combustion processes.

Posted in Data, Economics, Engineering, RE Policy | Leave a comment

Energy Content of Fuels

Energy Content Explained

Click to enlarge

Click to enlarge

The energy content of any organic fuel is defined as the fuel’s primary energy.  Primary energy is measured given the fuels calorific value or the heat generation from the complete combustion of one unit of fuel under well-defined conditions.  The calorific value can be a gross or net number, depending on whether the combustible heat released takes into account the vapor condensation of water.  Power production efficiency is typically calculated using Net Calorific Value (NCV) after water vaporization.

Posted in Data, Economics, Engineering | Leave a comment

U.S. Wind and Solar Energy Exceed 10% of Total Power Output

For the first time, U.S. wind and solar production in March exceeded 10% of total electricity generation, based on March data in EIA’s Electric Power Monthly.

The record contribution for non-hydro renewables comes amid surging installations of both wind and solar in the US, with 14.8GW of solar and 8.2GW of wind added in 2016.  On an annual basis, wind and solar made up 7% of total U.S. electric generation.

Posted in Data, Solar, Wind | Leave a comment

Extract Data Tables from PDF Files in R

A new method to extract data tables from PDF files is introduced. Most of the data scraping tools available are browser-based.  The common tools are also manual in nature and limited to one table at a time. A solution is outlined to extract multiple tables at once.  The solution combines the R programming language with the open-source Java program Tabula. The result is a convenient method that transforms documents into databases.

Benefit Statement
The ability to train a machine to extract data tables from PDF files has several benefits:

Posted in Data, Misc Tricks, R Data Import, R Programming | Comments Off on Extract Data Tables from PDF Files in R

SpatialPoints in R: Large Data Case Study

A common task in spatial data analysis is  extracting SpatialPoints inside a set of polygons or buffer zones.  Analysts can use standard GIS or map tools to extract a set of points within an area of interest using manual “point-and-click” routines. This method is easy, but will probably prove impractical, especially in cases involving big data.  The alternative is to train a machine to automatically extract the points in a polygon or buffer zone.  This post achieves that task and presents a case-study with R code.

Posted in Data, GDAL, GIS, Qatar RE, Solar, Spatial Analysis | Comments Off on SpatialPoints in R: Large Data Case Study

Wind and Solar Capacity to Pass Nuclear

Nuclear, Wind, and Solar Capacity

Sources: IAEA, EIA, Bloomberg New Energy Finance

Wind and solar capacity are expanding  rapidly and each is well on track to pass nuclear power capacity.  Advocates of nuclear energy have long been predicting its renaissance, but the installation of nuclear capacity appears to be stalled with little to no change in recent years.  Wind energy, by contrast, will have more capacity installed than nuclear by 2015 and solar energy capacity is likely to pass nuclear prior to 2020.   

Posted in Data, Nuclear, Renewable Energy, Solar, Wind | Comments Off on Wind and Solar Capacity to Pass Nuclear