Do different geologists see the same fractures? Quantifying subjective bias in fracture data collection.

Author(s):  
Billy Andrews ◽  
Jennifer Roberts ◽  
Zoe Shipton ◽  
Gareth Johnson ◽  
Sabina Bigi ◽  
...  

<p>The characterisation of natural fracture networks using outcrop analogues is important in understanding subsurface fluid flow and rock mass characteristics in fractured lithologies. It is well known from decision sciences that subjective bias can significantly impact the way data is gathered and interpreted, introducing scientific uncertainty.</p><p>This study investigates the scale of and nature of subjective bias on fracture data collected by geoscientists using four commonly used approaches (linear scanlines, circular scanlines, topology sampling and window sampling) both in the field and in workshops using field photographs.</p><p>We observe considerable variability between each participant’s interpretation of the same scanline, and this variability is seen regardless of participants’ level of geological experience. Geologists appear to be either focussing on the detail or focussing on gathering larger volumes of data; personal character traits that affect the recorded fracture network attributes. As a result, the fracture statistics that are derived from field data can vary considerably for the same scanline, depending on which geologist collected the data. Additionally, the personal bias of geologists collecting the data affects the scanline size (minimum length of linear scanlines, radius of circular scanlines or area of a window sample) needed to collect a statistically representative amount of data.</p><p>Based on our findings and on understanding of bias reduction in decision sciences, we suggest protocols to recognise, understand and limit the effect of subjective bias on fracture data biases during data collection.</p><p>Our work shows the capacity for cognitive biases to introduce uncertainty into observation-based data. Fracture statistics derived from field data often inputs into geological models that are used for a range of applications, from understanding fluid flow to characterising rock strength, and so these uncertainties have ramifications for propagation into a range of outcomes. Importantly, our findings that personal bias can affect data collection have implications well beyond the geosciences.</p>

Solid Earth ◽  
2019 ◽  
Vol 10 (2) ◽  
pp. 487-516 ◽  
Author(s):  
Billy J. Andrews ◽  
Jennifer J. Roberts ◽  
Zoe K. Shipton ◽  
Sabina Bigi ◽  
M. Chiara Tartarello ◽  
...  

Abstract. The characterisation of natural fracture networks using outcrop analogues is important in understanding subsurface fluid flow and rock mass characteristics in fractured lithologies. It is well known from decision sciences that subjective bias can significantly impact the way data are gathered and interpreted, introducing scientific uncertainty. This study investigates the scale and nature of subjective bias on fracture data collected using four commonly applied approaches (linear scanlines, circular scanlines, topology sampling, and window sampling) both in the field and in workshops using field photographs. We demonstrate that geologists' own subjective biases influence the data they collect, and, as a result, different participants collect different fracture data from the same scanline or sample area. As a result, the fracture statistics that are derived from field data can vary considerably for the same scanline, depending on which geologist collected the data. Additionally, the personal bias of geologists collecting the data affects the scanline size (minimum length of linear scanlines, radius of circular scanlines, or area of a window sample) needed to collect a statistically representative amount of data. Fracture statistics derived from field data are often input into geological models that are used for a range of applications, from understanding fluid flow to characterising rock strength. We suggest protocols to recognise, understand, and limit the effect of subjective bias on fracture data biases during data collection. Our work shows the capacity for cognitive biases to introduce uncertainty into observation-based data and has implications well beyond the geosciences.


2019 ◽  
Author(s):  
Billy J. Andrews ◽  
Jennifer J. Roberts ◽  
Zoe K. Shipton ◽  
Sabina Bigi ◽  
Maria C. Tartarello ◽  
...  

Abstract. The characterisation of natural fracture networks using outcrop analogues is important in understanding sub-surface fluid flow and rock mass characteristics in fractured lithologies. It is well known from decision-sciences that subjective bias significantly impacts the way data is gathered and interpreted. This study investigates the impact of subjective bias on fracture data collected using four commonly used approaches (linear scanlines, circular scanlines, topology sampling and window sampling) both in the field and in workshops using field photographs. Considerable variability is observed between each participant's interpretation of the same scanline, and this variability is seen regardless of geological experience. Geologists appear to be either focussing on the detail or focussing on gathering larger volumes of data, and this innate personality trait affects the recorded fracture network attributes. As a result, fracture statistics derived from the field data and which are often used as inputs for geological models, can vary considerably between different geologists collecting data from the same scanline. Additionally, the personal bias of geologists collecting the data affects the size (minimum length of linear scanlines, radius of circular scanlines or area of a window sample) required of the scanline that is needed to collect a statistically representative amount of data. We suggest protocols to recognise, understand and limit the effect of subjective bias on fracture data biases during data collection.


2019 ◽  
Author(s):  
Billy J. Andrews ◽  
Jennifer J. Roberts ◽  
Zoe K. Shipton ◽  
Sabina Bigi ◽  
Maria C. Tartarello ◽  
...  

2018 ◽  
Author(s):  
Casey J. Duncan ◽  
◽  
Marjorie A. Chan ◽  
Elizabeth Hajek ◽  
Diane L. Kamola ◽  
...  

2000 ◽  
Vol 1710 (1) ◽  
pp. 114-121 ◽  
Author(s):  
Sastry Chundury ◽  
Brian Wolshon

It has been recognized that CORSIM (and its constituent program, NETSIM) is one of the most widely used and effective computer programs for the simulation of traffic behavior on urban transportation networks. Its popularity is due in large part to the high level of detail incorporated into its modeling routines. However, the car-following models, used for the simulation of driver behavior in the program, have not been formally calibrated or validated. Since the model has performed well in a wide range of applications for so many years, it has always been assumed to have an implied validity. This study evaluated the NETSIM car-following models by comparing their results with field data. Car-following field data were collected using a new data collection system that incorporates new Global Positioning System and geographic information system technologies to improve the accuracy, ease, speed, and cost-effectiveness of car-following data collection activities. First, vehicle position and speed characteristics were collected under field conditions. Then simulated speeds and distances were based on identical lead vehicle actions using NETSIM car-following equations. Comparisons of simulated and field data were completed using both graphical and statistical methods. Although some differences were evident in the graphical comparisons, the graphs overall indicated a reasonable match between the field and simulated vehicle movements. Three statistical tests, including a goodness-of-fit test, appear to support these subjective conclusions. However, it was also found that definitive statistical conclusions were difficult to draw since no single test was able to compare the sets of speed and distance information on a truly impartial basis.


Sign in / Sign up

Export Citation Format

Share Document