Configuring Data for Import

Configuring data for import can be done using the Import Data Tool in the PISCES toolbox as well as manually in New_Data.mdb. The Import Data Tool is a limited functionality tool that covers most import use cases

Please see the Importing Data Tutorial for more information. Some related reference information is below.

Add to New_Data.mdb

Configuring data for import into PISCES happens in PISCES\inputs\New_Data.mdb. Add the feature or table from the data storage folder to New_Data.mdb. This is a temporary workspace that is only used for configure new data sets prior to importing the records to the main PISCES database. Full configuration for each data set needs to happen in the New_Data.mdb database or the import will not be successful. PISCES code does not automatically recognize what type of data is in a dataset or what the fields in the dataset represent.

Add source to NewData Table

Each unique feature or table for importing records needs to be appended to the NewData table. The NewData table sets the operations to use when PISCES runs the data import functions, so it is very important to configure correctly.

Field Name Description
ID Autonumber
Feature_Class_Name The name of the feature or table in New_Data.mdb
Species_ID The PISCES species code (or Alt_codes) if it is a single species or filter if the data contains records for multiple species.
Input_Filter The input filter that will be used to process the data set
Presence_type The default observation presence type
IF_Method Configuration options for the input filter
Observer_ID The default observer for the dataset (see the Observers table)
Survey_Methods The survey method used to collect the data
Notes Any notes about the data set
Imported The number of records imported (fills in automatically once records are added)
Input_Filter_Args [Unimplemented]
Projection projection of the data source

FieldMapping

Each field in the feature or table to be imported into the database must be referenced or mapped to a field type that the input filter can process. PISCES input filters match the inputs from the FieldMapping table to interpret the data in a standardized format. The PISCES import functions recognizes fields for Species, Latitude, Longitude, Zone_ID (HUC12), Date, Certainty, Observer , Observation Type , Survey Method, and Notes/Items. Each unique field mapping should be added separately to the table, but make sure that all of the fields reference the NewData ID number.

Field Name Description
ID Autonumber
NewData_ID The ID for the feature class in the NewData table
Field_Name The field in the database that the item will be placed into
Input_Field The name of the field in the input data that will be standardized
Handler_Function Optional function to pass the data through before it gets mapped to the field in Field_Name
Required If field is required and there is not data then the importer skips the observation