I have received some csv/excel files exported from EQuIS, how do I import them into ESdat?

There is no single common export in EQuIS systems that has a common set of csv files and reference values, so there isn't a one size fits all approach to transferring EQuIS files between systems, which means that some data mapping is required - and that also applies when importing the various EQuIS exports into ESdat.   There are however typically some commonalities such that a general approach can be adopted, described below.

Unless you are experienced in performing data migrations from EQuIS you can expect it will take a few attempts to get it correct, so plan on a few practice runs and doing data validations in ESdat prior to importing.  

Firstly, determine which csv file types have been provided, typically these will include those listed below, and guidance for importing these is provided:

EQuIS csv or Excel sheet types:

Data TypeEQuIS CSV/Sheet NameComments
LocationsLocation 
Wells/PiezometersWell 
Chemistry Samples and ResultsSampleTypically also accompanied by one or more of SampleParameter TestResultQA and Result
Chemistry Samples and ResultsSampleParameterA simplified export of results related to the "Sample" data
Chemistry Samples and ResultsTestResultsQAProvides QA results related to the "Sample" data
Chemistry Samples and ResultsResultsResults related to the "Sample" data
Chemistry Samples and ResultsBasicChemistryA combination of Sample and Results information provided in a single list
Chemistry Samples and ResultsFieldResultsA combination of Sample and Results information provided in a single list
Water LevelsWaterLevel Variations include Basic_WaterLevel
GeologyGeologyVariations include Basic_Geology, Lithology

 

From the above, identify which ESdat tables you will need in order to import the data and generate an appropriate ESdat Excel Import Template.  The ESdat Table Names for each Data Type are given below:

Data TypeESdat Tables
LocationsLocations
WellsWells
Chemistry Samples and ResultsLab Reports, Chemistry_Samples, Chemistry_Results
Water LevelsGroundwater_and_NAPL_Levels
GeologyGeology

 

Generate an ESdat Import Template for these Tables.  Click Data Migration - New Import - Other and select the Tables you have identified you will need.

 

This will generate Import Templates for these tables in the browser.  From the menu shown below you can select "Excel Template", which will create an Excel file into which you can copy the EQuIS data.  Select this.      

You will now need to copy the data from the EQuIS data files into the ESdat Excel Import Template.  Data Mapping from EQuIS to ESdat for columns typically included in EQuIS exports is below. Additional columns with data may be included in the EQuIS export, to import that data you will need to assess the most appropriate column in ESdat to copy the data into.  

Locations

 

EQuIS FieldESdat FieldComments
sys_loc_codeLocation_Code 
latitude, alt_y_coordy_coorduse one of latitude or x_coord based on your ESdat Site Coordinate System
longitude, alt_x_coordx_coordsee above
surf_elevElevation 
horz_collect_method_codeSurvey_Method 
loc_descDescription 
loc_typeLocation_Type 
loc_purposePurpose 
Total Depth Note, any fields related to borehole information, as distinct from the location on the surface will need to be imported into the Boreholes Table in ESdat.

 

Wells

EQuIS FieldESdat FieldComments
sys_loc_codeLocation_Code 
well_idWell 
top_casing_elevTOC 
stickup_heightStickup 
depth_of_wellBase_Depth 
geologic_unit_codeMonitoring_UnitIn ESdat is intended to refer to the Aquifer or Groundwater Unit
remarkComments 

*Note EQuIS exports typically dont include the screened interval for each Well/Piezometer but this may be included in seperate "Well Construction" files/sheets. It can be challenging to identify which screened interval relates to which Well/Piezometer, the data provider should be contacted for clarification if needed.

Chemistry Samples and Results

Chemistry Sample Fields are given below:

Where the EQuIS export has Samples and Results exported as seperate files/sheets the Sample information generally maps to the ESdat Chemistry_Samples import sheet, and the Results information generally maps to the ESdat Chemistry_Results sheet as in the table below.  

Where the EQuIS export has a mix of Sample and Result fields (eg if you have a BasicChemistry or FieldChemistry EQuIS EDD) the sample information will need to be copied into the ESdat Chemistry Samples sheet, one row per sample (ie remove any duplication), and the Result information coped into the ESdat Chemistry Results sheet. 

Chemistry Sample Data

EQuIS FieldESdat FieldComments
sys_sample_CodeSampleCode 
sample_nameField_ID 
sample_matrix_typeMatrix_Type 
sample_type_codeSample_TypeMay require value replacement to match standard ESdat values.  Valid ESdat values are:

Normal,
Field_D (Field Duplicate)
Interlab_D (Interlab Duplicate)
Rinsate
Field_B (Field Blank)
Trip_B (Trip Blank)
Composite N Samples (Composite of the specified number of samples)
MS, (Matrix Spike)
MS_D, (Matrix Spike Duplicate)
Trip_B, (Trip Blank)
MB, (Method Blank)
SB, (Storage Blank)
LCS, (Lab Control Sample)
LCS_D, (LCS Duplicate)
SRM, (Standard Reference Material)
CRM, (Certified Reference Material)
LAB_D (Duplicate)
LAB_T (Triplicate)
NCP (Non-Client Parent – for duplicates or spikes from another client in the same sample analysis batch)
parent_sample_codeParent_Sample 
sample_delivery_groupSDG 
Sampled_DateSampled_Date_Time 
sys_loc_codeLocation_Code 
start_depthSample_Depth_From 
end_depthSample_Depth_to 
sample_methodSampling_Method 
commentComments 

 

Chemistry Result Data

EQuIS FieldESdat FieldComments
sys_sample_codeSampleCode 
cas_rn or param_codeChemCode 
Chemical_NameOriginalChemName 
result_value, param_valueResult 
param_unitResult_Unit 
result_type_codeResult_TypeMay require value replacement to match standard ESdat values. ESdat values are:

REG (regular result)
Calc (calculated result)
leached_REG (regular leached results)
SUR (Surrogate)
leached_SUR (leached surrogate)
SC (Spike Compound)
SC (Spike Compound Duplicate)
Detect_FlagPrefixIf Detect Flag = Y then Prefix is blank, 
If Detect Flag = N then Prefix = <
lab_anl_method_name or measurement_methodMethod_Name 
RemarkFinal_Comments 
analysis_date & analysis_timeAnalysed_Date 
Fraction, Total_or_DissolvedTotal_or_FilteredConfirm based on data
lab_matrix_codeMatrix_TypeNeeds to be entered or match the value at the Sample level in ESdat.  If it is a Leached Result, the Matrix Type for the Sample should be Soil and the Result Type should be set to "Leached_Reg"
prep_methodExtraction_Method 
lab_name_code Should be entered at the Sample level in ESdat along with any Lab Report Number, and also entered into the Lab_Reports sheet.  Note in ESdat a Lab name can't be entered for lab data unless a Lab Report Number is also entered.
lab_sample_id Should be entered at the Sample level in ESdat
result_type_codeResult_Type 
lab_qualifiersLab_Qualifier 
Interpreted_qualifiersValidation_Qualifier 
intpreted_QualifiersFinal_Qualifier 
method_detection_limitmdl 
reporting_detection_limitrdl 
quantitation_limiteql 
detection_limit_unitsDetection_Limit_Units 
result_commentFinal_Comment 
qc_original_concSpike_Concentration 
qc_spike_measuredSpike_Measurement 
qc_spike_lclLCL 
qc_spike_uclUCL 
test_batch_idLab_Analysis_Batch_ID 

 

Water Levels

EQuIS FieldESdat FieldComments
sys_loc_codeLocation_Code 
 WellESdat requires a Well (ie piezometer) identifier for groundwater levels.  If there is only one well at a Location a dash "-" can be used.  If there are multiple wells/piezometers at the location the identifier may be entered/exported from EQuIS is a variety of different ways and the supplier of the data should clarify.  
measurement_dateDate_time 
water_level_depthWater_Depth 
water_level_elevWater_Elevation 
measured_depth_of_wellWell_Depth 
dry_indicator_ynDry 
Measurement_MethodMeasurement_MethodGenerall "Dip" in ESdat
lnapl_depth, dnapl_depthProduct_DepthESdat calculates if it is DNAPL or LNAPL on outputs based on the Product_Depth and the Water_Depth

 

Geology

EQuIS FieldESdat FieldComments
sys_loc_codeLocatoin_Code 
start_depthTop_Depth 
end_depthBottom_Depth 
material_typeLithological_Code 
geo_unit_code_1Stratigraphy1 
geo_unit_code_2Stratigraphy2 
remarkComments 
moistureMoisture 
colorColour 
observationLithological_Description 
consistencySoil_Consistency 
grainsizeGrain_Size 

 

Other

The above are the most common data exports provided from EQuIS.  Both EQuIS and ESdat support additional data tables, and data columns in the above tables.  Mapping of other data will need to be done after considering the data exported from EQuIS and the Import Templates available in ESdat.