Configuring Data for Import¶
Configuring data for import can be done using the Import Data Tool in the PISCES toolbox as well as manually in New_Data.mdb. The Import Data Tool is a limited functionality tool that covers most import use cases
Please see the Importing Data Tutorial for more information. Some related reference information is below.
Add to New_Data.mdb¶
Configuring data for import into PISCES happens in PISCES\inputs\New_Data.mdb. Add the feature or table from the data storage folder to New_Data.mdb. This is a temporary workspace that is only used for configure new data sets prior to importing the records to the main PISCES database. Full configuration for each data set needs to happen in the New_Data.mdb database or the import will not be successful. PISCES code does not automatically recognize what type of data is in a dataset or what the fields in the dataset represent.
Add source to NewData Table¶
Each unique feature or table for importing records needs to be appended to the NewData table. The NewData table sets the operations to use when PISCES runs the data import functions, so it is very important to configure correctly.
|Feature_Class_Name||The name of the feature or table in New_Data.mdb|
|Species_ID||The PISCES species code (or Alt_codes) if it is a single species or filter if the data contains records for multiple species.|
|Input_Filter||The input filter that will be used to process the data set|
|Presence_type||The default observation presence type|
|IF_Method||Configuration options for the input filter|
|Observer_ID||The default observer for the dataset (see the Observers table)|
|Survey_Methods||The survey method used to collect the data|
|Notes||Any notes about the data set|
|Imported||The number of records imported (fills in automatically once records are added)|
|Projection||projection of the data source|
Each field in the feature or table to be imported into the database must be referenced or mapped to a field type that the input filter can process. PISCES input filters match the inputs from the FieldMapping table to interpret the data in a standardized format. The PISCES import functions recognizes fields for Species, Latitude, Longitude, Zone_ID (HUC12), Date, Certainty, Observer , Observation Type , Survey Method, and Notes/Items. Each unique field mapping should be added separately to the table, but make sure that all of the fields reference the NewData ID number.
|NewData_ID||The ID for the feature class in the NewData table|
|Field_Name||The field in the database that the item will be placed into|
|Input_Field||The name of the field in the input data that will be standardized|
|Handler_Function||Optional function to pass the data through before it gets mapped to the field in Field_Name|
|Required||If field is required and there is not data then the importer skips the observation|