NB_430_19_6 - NB 430-19-6 SOI – October 2019 Annual Soil Refresh Requirements
NB 430-19-6 SOI – October 2019 Annual Soil Refresh Requirements
National Bulletin: 430-19-6 Date: July 15, 2019
Subject: SOI – October 2019 Annual Soil Refresh Requirements


Action Required By: August 23, 2019 (regional offices)
Action Required By: September 16, 2019 (State soil scientists)
 
Purpose.  To provide requirements on the annual refresh of the official soil survey data.   
 
Expiration Date.  December 31, 2019
 
Background.  Each year, the official soil survey data is updated. The official soils database is accessed by the web-based Web Soil Survey (WSS) and is the official soils database that is queried against through the Soil Data Access Facility (SDA).

 

The users of this data rely on its accuracy as they make decisions concerning land management, including Government officials responsible for implementing Government farm and other programs established by law.  This refresh of the official soils dataset occurs annually with the data being delivered by October 1.

 

Many steps must be taken to ensure the best available soils data is used in preparing for the annual refresh of the certified official national soils database. The soil survey regional offices are responsible for completing a quality assurance review of new or revised data posted to the staging server. The State soil scientist (SSS), or their designee, is responsible for completing the quality control (QC) review and exporting the certified soil survey data for their States to the staging server. The SSS is responsible for verifying and committing the certified spatial and attribute data from the staging server to the Soil Data Warehouse (SDW).

 

The goal for this refresh is provide the refreshed data by October 1 or as close to the beginning of each fiscal year as possible. 
 

Explanation.  This year’s annual refresh will require all surveys to be processed.  Due to changes made to some existing national interpretations and the addition of new national interpretations, every survey not exported to the staging server since August 23, 2019 must be processed.  Surveys that are ready to be refreshed can be exported from NASIS to the staging server, verified and committed. Surveys that are already in WSS and do not need the tabular or spatial data updated must still be processed to include new and updated national interpretations.  

Update FY 2020 Surveys

Tabular data for surveys that have been updated and are ready to be published to WSS must be exported from NASIS on or after August 23, 2019 and processed as outlined below in steps 1-4.

 

Soil survey information published to the WSS will include the following:

 

  1. All required national interpretations are automatically included when a survey is exported from NASIS to the Staging Server.  Required national interpretations include all NASIS primary rules marked as ready to use in the NSSC Pangea Rules folder. The SSS can supplement the national interpretations by selecting interpretations of interest from the “NSSC Regional Interpretations” folder or interpretations tagged for State use from any of the other “Regional Office” folders.  These are located under the “select/view interps” export tab in NASIS.  Any SSS who has questions about national interpretations or NSSC owned regional interpretations should contact Bob Dobos by email (bob.dobos@usda.gov). Any SSS who has questions about regional interpretations (non-NSSC owned) should contact the regional office.

    • New and/or revised interpretations:

      • FOR - Windthrow Hazard (New for FY20)

      • FOR - Mechanical Planting Suitability

      • FOR - Mechanical Site Preparation (Deep)

      • FOR - Mechanical Site Preparation (Surface)

      • FOR - Potential Erosion Hazard (Off-Road/Off-Trail)

         

  1. At a minimum, the component text, as listed in the column named “Group” and nontechnical description as listed in the column named “Kind” must be checked for export under the “select/view text” export tab in NASIS.  Verification, by the SSS, that all nontechnical descriptions are available for export can be determined by running the NASIS NSSC Pangaea report named “!_NASIS to Staging Server Export - Brief Soil Descrip Check”.  A web based version of this report is available here.

     

  2. Any other text table data considered for export to WSS must be examined by the SSS to verify that personally identifiable information (PII) is removed or not published.

     

  3. It is recommended that all components be exported, but the discretion of the SSS should be applied to the decision of whether minor components should be exported.  At a minimum, every minor component that has been classified as a hydric soil must be exported.

     

The SSS will review and verify the data in the county and MLRA overlap tables.  The SSS will finalize documentation of the legend certification history table before export. 

 

Schedule of deadlines

To meet the October 1 deadline, a recommended schedule of sub-deadlines is as follows:

 

Regional offices should complete their work by August 23.  The SSS should complete his or her work by September 16.  The NSSC and Fort Collins staff should finish publishing the refreshed data to WSS starting by October 1.

 

When a survey is exported from NASIS to the staging server, a database stored procedure is run to check for a series of “Fatal Errors”.  If an error exists, the export fails.  To improve efficiency, the Database FOCUS Team wrote a report that pre checks surveys for all “Fatal Errors”.  This allows the SSS and Regional Offices to identify and correct fatal errors before going through the export process.

 

The report is located in the NSSC Pangaea Report folder and is named “!_NASIS to Staging Server Export - Fatal Errors Pre Check.”  A web based version of the report is also available here.  When an error is found, the report calls a sub-report. The sub-report identifies where the errors are occurring and directs the SSS to those errors.  This should greatly increase the efficiency of the SSS review by removing the time-consuming process of searching the errors and lighten the load on the server when the data is committed.

 

Over 3000 surveys are exported each year.  The servers that process exports have a finite capacity and the process slows when numerous surveys are exported at once.  Delays are common close to the final deadline, when export traffic increases.  To avoid delays, it is strongly recommended that SSS do not wait until the last minute to complete exports

 

Additional information that is specific to the export process is in chapter 17 of the NAISS User Guide.   Is also found in YouTube NASIS Training Videos.

 

The WSS Refresh job aids and videos are located at the following URLs:

 

Export and Commit Official Soil Survey Data: https://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/edu/ncss/?cid=nrcs142p2_054322#database_gen

 

Video on Export and Commit: https://www.youtube.com/watch?v=wwYOkvCLw8o&t=844s

 

Recall* and Commit Official Soil Survey Data: https://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/edu/ncss/?cid=nrcs142p2_054322#database_gen

 

* The preferred method is to export from NASIS.  Recall should only be used when absolutely necessary. 

 

Guidance on the official soil survey information refresh policy has been written into Title 430, National Soil Survey Handbook (NSSH), Part 644, Subpart A, Section 644.2.  Future guidance on the refresh of soil survey data will be referred to NSSH policy.      
 
Contact.  For further information, please contact Drew Kinney, National Leader for Soil Business Systems, NSSC, at (402) 437-4098 or drew.kinney@usda.gov.
 
 

 /s/

MARY PODOLL
Acting Deputy Chief for Soil Science and Resource Assessment

 
 
Attachment - Instructions for Using NASIS Export to Staging Server Pre-Check Report
[NB_430_19_6 - ]