TUFLOW SWMM Tutorial M03 Development

From Tuflow
Revision as of 08:01, 12 April 2024 by RustyJonesTUFLOW (talk | contribs) (Created page with "= Introduction = This tutorial, Module 3 of the TUFLOW SWMM tutorial dataset, demonstrates how to add SWMM urban hydrology to a 1D / 2D SWMM stormwater pipe network / 2D TUFLO...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Introduction

This tutorial, Module 3 of the TUFLOW SWMM tutorial dataset, demonstrates how to add SWMM urban hydrology to a 1D / 2D SWMM stormwater pipe network / 2D TUFLOW HPC catchment model. TUFLOW SWMM Tutorial Module 3 builds from the model created in TUFLOW SWMM Tutorial Module 2. The completed TUFLOW SWMM Module 2 model is provided in the TUFLOW_SWMM_Module_03\TUFLOW folder of the download dataset as the starting point for this tutorial. If you are not already familiar with TUFLOW SWMM linking, we recommend completing TUFLOW SWMM Modules 1 and 2 prior to starting this tutorial.

Project Initialization

QGIS

QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3.9.0.110 or newer are required to access the SWMM Processing Tools described in the following sections. For installation, see Installation of TUFLOW Plugin.
Define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace:

  1. Open QGIS.
  2. Go to Project > Properties…
  3. In the CRS tab, type ‘WGS 84 / UTM Zone 60S’.
  4. Select the matching projection in the 'Predefined Coordinate Reference Systems' section.
  5. Click ‘Apply’ and ‘OK’.
  6. Ensure that the projection is set correctly by viewing the bottom right hand corner of the workspace. It should read ‘EPSG:32760’.



TUFLOW Plugin

Next we need to configure the QGIS TUFLOW Plugin settings to link with the project folder where we will build our model:

  1. Open the 'Configure TUFLOW Project' tool by selecting Plugins > TUFLOW > Editing > Configure / Create TUFLOW Project.
  2. In the previous section, the CRS (Coordinate Reference System) for the QGIS Workspace was defined. As such, the projection inputs are set automatically.
  3. To set the location of the TUFLOW folder, click 'Browse...' and navigate to the TUFLOW_SWMM_Module_03 folder. Click 'Select Folder'.
  4. To set the location of the TUFLOW single precision executable file, click 'Browse...' and navigate to the exe\2023-03-AD folder. Select TUFLOW_iSP_w64.exe and click 'Open'.
  5. Select 'GPKG' as the GIS Format.
  6. Select 'TUFLOW Classic / HPC' as the TUFLOW Engine.
  7. Tick on 'Save Default Settings Globally'.
  8. Click 'OK'.

    SWMM M03 configure project.png


TUFLOW Model

Load and Style TUFLOW Model Files

Load in the project GIS layers:

  1. Click on the ‘Load TUFLOW Layers from TCF’ symbol from the TUFLOW Plugin toolbar.
    Tuflow plugin load tcf layers.png

  2. Navigate to the TUFLOW_SWMM_Module_03\TUFLOW\runs folder and select TS02_5m_001.tcf.
  3. In the Load Layers window, select:
    • Ordering Options: Alphabetical
    • Grouping Options: Group by control file
    • Raster Load Options: Load Normally
  4. Click ‘Open’ and ‘OK’.


Style the TUFLOW layers. Suggested styling steps were provided in TUFLOW SWMM Tutorial M01. They have not been duplicated here.

Increment TUFLOW GeoPackage File

We will now save a copy of TS02_001.gpkg with a new name, TS03_001.gpkg. This project initialization step is recommended so prior model versions from a project are not broken as a result of changes being made to GIS inputs.

  1. In the QGIS Layers Panel, select (left click) 2d_bc_M01_001_L.
  2. Click on the 'Increment Selected Layer' symbol from the TUFLOW Plugin toolbar. This opens the dialog shown below.
    Tuflow plugin increment layer.png

    • Source Layer: Automatically set to the selected layer, 2d_bc_M01_001_L.
    • Output Database: Click 'Browse...'. This will automatically open to the TUFLOW\model\gis folder. Set the new output database name to TS03_001.gpkg and click 'Save'.
    • Output Layer Name: This will automatically increment to 2d_bc_M01_002_L. Change the name back to 2d_bc_M01_001_L.
    • Delete the pre-filled 'Incremented Layer' entry in the table. We do not wish to modify the version number associated with the 2d_bc file. This current exercise will not change the version number of any of the GIS layer inputs, it is simply establishing a copy of the existing GeoPackage where future edits will be saved to.
    • Select 'Remove Source Layer from Workspace'.
    • Select 'Increment Layer and Preserve Database'.
  3. Click 'OK'.
  4. The GeoPackage database, TS03_001.gpkg will now be in the TUFLOW_SWMM_Module_03\TUFLOW\model\gis folder.


Increment SWMM GeoPackage File

SWMM pipe network junction attributes need to be updated when converting a TUFLOW 2D direct rainfall / SWMM 1D model (TUFLOW SWMM Tutorial Module 2). into a format that uses SWMM hydrology instead of direct rainfall. Similar to above (incrementing the TUFLOW GeoPackage file), we will increment the SWMM pipe network database name so we do not alter the inputs necessary for TS02_5m_001.tcf to function without issue.

  1. In the QGIS Layers Panel, open the TS02_001.tscf group. In the sw02_001 group, right click Links--Conduits.
  2. Select TUFLOW > SWMM - Increment GeoPackage. This opens the dialog shown below.
    • Output File: Click the ... and set the new database name to sw03_001.gpkg.
    • Existing GeoPackage Layers: 'Unload -- do not move'.
  3. Select 'OK'.
  4. The tool will automatically load sw03_001.gpkg into the QGIS workspace and remove sw02_001.gpkg from the QGIS workspace.
  5. In the QGIS Layers Panel, move sw03_001.gpkg to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project.


Save QGIS Project Workspace

  1. Go to Project > Save As.
  2. Navigate to the TUFLOW_SWMM_Module_03 folder and type SWMM_M03 as the filename with the extension .qgz.


GIS Inputs

Update SWMM GeoPackage Spatial Database

In previous tutorials we have created new SWMM GeoPackage databases for our new entries. This tutorial will demonstrate a different update approach. Instead of creating a new SWMM GeoPackage database, we will update the existing database, sw03_001.gpkg by adding new SWMM Sections for the hydrology elements we will be incorporating into the model in this tutorial.

  1. Go to Processing > Toolbox from the top dropdown menu options to open the Processing Toolbox.
  2. Go to TUFLOW >> SWMM in the processing tool list and select 'GeoPackage - Add sections'. This opens the dialog shown below.
    • GPKG filename modify: Click the ... and navigate to the TUFLOW_SWMM_Module_03\TUFLOW\model\swmm folder. Select sw03_001.gpkg.
    • CRS for GeoPackage: Click the drop down menu and select 'Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S'.
    • SWMM Sections to add: Click the ..., and tick on:
    • Hydrology--Raingages
    • Hydrology--Subcatchments
  3. Click 'Run'.
  4. Once the tool is finished, click 'Close'.


The above steps have added the new sections to the SWMM GeoPackage database, sw03_001.gpkg. However, the new sections are not currently displayed in the QGIS Layers Panel. We need to close the database and reopen it to view the changes.

  1. In the QGIS Layers Panel, right click sw03_001 and select 'Remove Group...'.
  2. In Windows File Explorer, navigate to the TUFLOW\model\swmm folder and drag and drop sw03_001.gpkg into QGIS.
  3. When prompted by QGIS, under 'Options', tick on 'Add layers to group', then select 'Add Layers' to open all vectors within sw03_001.gpkg. By default, all items in the available list should have been selected.
  4. In the QGIS Layers Panel, move sw03_001.gpkg to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project when we are making edits.
  5. In the QGIS Layers Panel, within the sw03_001 group, move Hydrology--Subcatchments to the bottom. This will ensure that the other data within this database can be seen.


SWMM GIS Data Entry

A GeoPackage called Urban_Hydrology.gpkg is provided in the TUFLOW_SWMM_Module_03\Tutorial_Data folder. It contains one SWMM input layer and one TUFLOW input layer:

  • SWMM_Subcatchments: defines the 1D SWMM urban hydrology subcatchment delineation and associated parameters.
  • TUFLOW_Subcatchments: defines the remaining 2D TUFLOW catchment hydrology subcatchment delineation.

To populate the SWMM GeoPackage created in the previous section:

  1. In Windows File Explorer, navigate to the TUFLOW_SWMM_Module_03\Tutorial_Data folder. Drag and drop the Urban_Hydrology.gpkg into QGIS.
  2. When prompted by QGIS select SWMM_Subcatchments. Click 'Add Layers'.
  3. In the QGIS Layers Panel, right click on the SWMM_Subcatchments layer and select 'Zoom to Layer(s)'.
  4. Use the 'Select Features' tool to highlight all items included in SWMM_Subcatchments.
  5. Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.
  6. In the QGIS Layers Panel, select (left click) the sw03_001 >> Hydrology--Subcatchments layer.
  7. Make the sw03_001 >> Hydrology--Subcatchments layer editable by clicking the 'Toggle Editing' symbol Toggle editing icon.png.
  8. Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
  9. Toggle the editing off to save the edits.
  10. Remove SWMM_Subcatchments.


SWMM GIS Data Updates

The following updates are being made to the objects and layers within sw03_001.gpkg.

Update SWMM Hydrology Raingages

The information within Hydrology--Raingages defines the pluviographs in the catchment. We will link to two different rain gages in this example.
Note: 'Gage' is the American spelling of 'Gauge' in Oxford English.

  1. In the QGIS Layers Panel, select (left click) Hydrology--Raingages and toggle on editing.
  2. Right click Hydrology--Raingages and select 'Open Attribute Table'.
  3. Click 'Add Feature' twice. Enter the following attributes (leave all other fields as NULL):
    Name Form Intevl SnowCatchDeficiency Format Tseries
    RF_G1 Volume 0.1 1 TIMESERIES RF_FC04
    RF_G2 Volume 0.1 1 TIMESERIES RF_FC07

    For a summary of the attributes associated with Hydrology--Raingages, refer to TUFLOW 2023-03-AD Release Notes (Table A.11) and the SWMM5 Reference Manual - Volume 1 (Hydrology).

  4. Turn off editing and save the information.


Update SWMM Hydrology Subcatchments

The information within Hydrology--Subcatchments defines the subcatchment parameters (including catchment area, width, slope, percent impervious, outlet specification and infiltration details). All required data entries have been pre-filled in the supplied dataset except the 'Area' information, which we will determine using QGIS. SWMM requires the hydrology subcatchment area information in hectares.

  1. In the QGIS Layers Panel, select (left click) Hydrology--Subcatchments and toggle on editing.
  2. Right click Hydrology--Subcatchments and select 'Open Attribute Table'.
  3. Choose 'Area' as the target field and type the calculation expression, '$area / 10000'.
    • '$area ': Extracts the area of each region (subcatchment) in Hydrology--Subcatchments.
    • '/ 10000': Converts the area values into hectares.
    Note: The projection used in these tutorials is measured in meters. Thus, when QGIS extracts the area from a region, it reports the area in m2. If using a projection that is measured in feet, QGIS would extract the area in ft2.
  4. Click 'Update All'.
  5. Turn off editing and save the information.
  6. Inspect the attribute information within Hydrology--Subcatchments to familiarize yourself with the data. A few demonstration features have been included in the dataset.
    • Two rainfall gages are linked to the subcatchments. Downstream subcatchments linked to rain gage 'RF_G1'. Upstream subcatchments are linked to rain gage 'RF_G2'.
    • Subcatchments 'SPit11A' and 'SPit11A' are being routed to subcatchment 'SPit11C' before entering the SWMM pipe network. All other hydrology subcatchments route directly to a SWMM Node--Junctions.
    For a summary of the attributes associated with the layer, refer to TUFLOW 2023-03-AD Release Notes (Table A.38) and the SWMM5 Reference Manual - Volume 1 (Hydrology).


SWMM Options

SWMM Project--Options defines the SWMM simulation controls, such as hydrology computation timestep. Project--Options are not required in the new GeoPackage database we are creating for this Tutorial. This is because this model will be constructed from multiple SWMM input (INP) files:

  • sw01_001.inp (road culverts).
  • sw03_001.inp (underground pipe network inputs and SWMM hydrology).

When TUFLOW processes SWMM inputs, it combines the multiple INP files into one single INP prior to simulation. For this model, the simulation control parameters defined in Module 1 (sw01_001) Project--Options will apply. The options relevant to this tutorial that have already been defined in the Module 1 input include:

  • flow_units: set to metric.
  • infiltration method: set to Green Ampt.
  • wetstep hydrology timestep: set to 1 minute.
  • dry step hydrology timestep: set to 1 minute.

Note: If we wanted to change the Project--Options as a result of this modules additional data, Project--Options should have been included as a item in the earlier SWMM GeoPackage Update step, or SWMM GeoPackage Create step if using the model development workflow demonstrated in the previous tutorials. If the SWMM INP file reference is specified lower in the TCSF control file, the information contained in the file supersedes any duplicate information defined by INP files higher in the TCSF control file .

Update SWMM Junction Details

When coupling SWMM hydrology with a 1D pipe network, updated Nodes--Junctions attribute details are needed if converting from 2D direct rainfall (rain-on-grid) model design. Now the SWMM hydrology inputs are complete, we will make the necessary changes to Nodes--Junctions in sw03_001.gpkg.

  1. In the QGIS Layers Panel, select (left click) Nodes--Junctions and toggle on editing.
  2. In the Processing Toolbox, select the 'Edit Features In-Place' tool. This allows the editing of an existing layer, instead of the creation of a new layer.
  3. Go to TUFLOW >> SWMM in the processing tool list and select 'Junctions - Set attributes ' processing tool. This opens the dialog shown below.
    • Input Subcatchments: sw03_001 >> Hydrology--Subcatchments
    • Input Inlet Usage Layers: TS02_001.tscf >> swmm_iu_TS02_001
    • Input BC Connection Layers: TS02_001.tbc >> 2d_bc_SWMM_Pipe_Network_Connections_001_L
    • General options:
    • Maximum Depth Option (Ymax): 'Set to 0.0'.
    • Nodes receiving subcatchment flows option (if connected to 2D): 'Set Apond = 0.0; Ksur = 0.0 (overwrites options below)'.
    • Nodes connected to 2D without Inlets:
    • Ysur: 0
    • Area of ponding: 50
    • Nodes connected to the 2D with Inlets:
    • Maximum depth: 'Use global option'.
    • Ysur: 0
    • Area of ponding: 25
    • Nodes without a 2D connection:
    • Surcharge Depth: 50
    • Area of ponding: 1
  4. Select 'Modify All Features'.
  5. Once the tool has finished, click 'Close'.
  6. Turn off editing to save the edits.
  7. View the attributes associated within Nodes--Junctions to verify the data processing has been completed correctly.
    For a summary of the attributes associated with the Nodes--Junctions layer, refer to TUFLOW 2023-03-AD Release Notes (Table A.30) and the SWMM Reference Manual - Volume 2 (Hydraulics).


Export SWMM INP File

We will now create a new INP file for the pipe network and SWMM urban hydrology inputs. To do this, we need to convert sw03_001.gpkg into a SWMM INP file.

  1. In the Processing Toolbox, go to TUFLOW >> SWMM and select 'GeoPackage - Write to SWMM inp'. This opens the dialog shown below.
    • GeoPackage Input File: Navigate to the TUFLOW\model\swmm folder and select sw03_001.gpkg.
  2. By default, this tool will save the SWMM inp file in the same folder location and with the same name as the GeoPackage input file. In this case, it will save sw03_001.inp to the TUFLOW\model\swmm folder.
  3. Click 'Run'.
  4. Once the tool is finished, click 'Close'.


TUFLOW GIS Updates

We will be reverting the TUFLOW model back to a configuration that uses inflows from an external hydrology model (as per Module 1), instead of 2D direct rainfall (Module 2), in the areas not covered by SWMM urban hydrology. Instead of reusing the input from Module 1, we will need to use a new TUFLOW source area inflow layer. This will ensure that we do not double count the flow generated over the area now represented by SWMM.

  1. Click on the ‘Import Empty File’ symbol from the TUFLOW plugin toolbar.
    Tuflow plugin import empty file.png

  2. Select '2d_sa' from the Empty Type list.
  3. In the Run ID box write 'TS03_001'.
  4. Tick the 'Regions' Geometry Type.
  5. In the Spatial Database Options, select 'All to one'. Navigate to the TUFLOW_SWMM_Module_03\TUFLOW\model\gis folder and select TS03_001.gpkg. Click Save and hit 'OK'.
  6. The 2d_sa_TS03_001_L appears in the QGIS Layers Panel.

    TS3 import empty 2d sa 01a.png

  7. In Windows File Explorer, navigate to the TUFLOW_SWMM_Module_03\Tutorial_Data folder. Drag and drop the Urban_Hydrology.gpkg into QGIS.
  8. When prompted by QGIS, select TUFLOW_Subcatchments. Click 'Add Layers'.
  9. In the QGIS Layers Panel, select (left click) the TUFLOW_Subcatchments layer.
  10. Use the 'Select Features' tool to highlight the four regions included in TUFLOW_Subcatchments.
  11. Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.
  12. In the QGIS Layers Panel, select (left click) the 2d_sa_TS03_001_R layer.
  13. Make the 2d_sa_TS03_001_R layer editable by clicking the 'Toggle Editing' symbol Toggle editing icon.png.
  14. Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
  15. Toggle off editing to save the edits.
  16. Remove Urban_Hydrology.gpkg.
    The polygon entry we have updated refers to a new subcatchment name for the region adjacent to the SWMM subcatchments. The new name is 'FC06.62', instead of 'FC06'. When we update the TUFLOW Control files we will configure the file references so we are sourcing data from a new flow file obtained from an external hydrology model that has been updated with the reduced catchment area, in recognition of SWMM being used for the flow estimate in the proposed urban development area.
    Note: Common hydrology software used in combination with TUFLOW by modelers include: HEC-HMS, RORB, Drains, WBNM, URBS and more.


TUFLOW Boundary Updates

As a result of the changes made to the TUFLOW inflows, new TUFLOW Boundary Condition csv files are also needed. Updated files have been provided in the TUFLOW_SWMM_Module_03\Tutorial_Data folder. These files provide the values and model linkages to the new hydrology inflows, which include the 'FC06.62' entry.

  1. Copy bc_dbase_TS03_001.csv and TS03_01p2hr.csv from the TUFLOW_SWMM_Module_03\Tutorial_Data folder to the TUFLOW_SWMM_Module_03\TUFLOW\bc_dbase folder.


Simulation Control Files

To avoid the potential risk of overwriting existing control files accidentally, we will start by saving new control files where we will be making subsequent syntax updates during the following steps.

  1. Open TS02_5m_001.tcf in a Text Editor (Notepad++ is recommended). Save the file as TS03_5m_001.tcf in the TUFLOW_SWMM_Module_03\TUFLOW\runs folder.
  2. Using the 'Open File' function in Notepad++:
    • Open TS02_001.tbc, and save the file as TS03_001.tbc in the TUFLOW\model folder.
    • Open TS02_001.tscf, and save the file as TS03_001.tscf in the TUFLOW\model folder.

TUFLOW Control File (TCF)

  1. Open TS03_001.tcf and make the following reference updates:
    Spatial Database == ..\model\gis\TS03_001.gpkg ! Specify the location of the GeoPackage Spatial Database
    BC Control File == ..\model\TS03_001.tbc ! Reference the TUFLOW Boundary Condition Control File
    BC Database == ..\bc_dbase\bc_dbase_TS03_001.csv ! Reference the Boundary Condition Database
    SWMM Control File == ..\model\TS03_001.tscf ! Reference the SWMM (1D) Control File
  2. Comment out the 'Map Cuttoff Depth' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).
    ! Map Cutoff Depth == 0.05


TUFLOW Boundary Control File (TBC)

  1. Open TS03_001.tbc. If using Notepad++, right click the file reference in TS03_5m_001.tcf and select 'Open File'.
  2. Comment out the 'Global Rainfall BC' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).
    ! Global Rainfall BC == RF_FC04
  3. Add the following additional command:
    Read GIS SA == 2d_sa_TS03_001_R ! Reads in 2D source area - Excluding SWMM areas


TUFLOW SWMM Control File (TSCF)

  1. Open TS03_001.tscf. If using Notepad++, right click the file reference in TS03_5m_001.tcf and select 'Open File'.
  2. Replace Read SWMM == swmm\sw02_001.inp with the following command:
    Read SWMM == swmm\sw03_001.inp
  3. Add the following additional command:
    Read BC Timeseries == RF_FC04 | RF_FC07 ! TUFLOW BC Database / SWMM Rain Gage Linkage


Running the Simulation

  1. Save a copy of _run_TS02_HPC.bat as _run_TS03_HPC.bat in the TUFLOW_SWMM_Module_03\TUFLOW\runs folder.
  2. Update the batch file to reference the TS03_5m_001.tcf :
    set exe="..\..\..\exe\2023-03-AD\TUFLOW_iSP_w64.exe"
    set run=start "TUFLOW" /wait %exe% -b
    %run% TS03_5m_001.tcf
  3. Save the batch file and double click it in Windows File Explorer to run the simulation.
    If the model simulation doesn't run, here is a link to some common Trouble Shooting advice.


Troubleshooting

Did your TUFLOW SWMM model fail to run successfully? If so, here is a link to a troubleshooting guide: TUFLOW SWMM Troubleshooting.

Check Files

Review the SWMM INP and simulation report file from the TUFLOW_SWMM_Module_03\TUFLOW\results folder to confirm the new hydrology inputs are being processed correctly:

  • View TS03_5m_001_swmm.inp in a text editor to confirm the combining of the two input INP files has occurred correctly. Also use the QGIS Processing tool, GeoPackage - Create from SWMM inp , to view the information in QGIS.
  • View TS03_5m_001_swmm_curves.inp in a text editor to confirm the rainfall time series that has been used by the SWMM hydrology engine matches the input dataset.
  • View TS03_5m_001_swmm.rpt in a text editor to confirm the model computation is healthy in term of mass conservation.

Results Output

Complete the steps outlined in following link to review the simulation results from the TUFLOW SWMM model simulation:

TUFLOW SWMM Tutorial 03 Results

Conclusion

  • EPA SWMM urban hydrology was added to the model (replacing 2D drect rainfall / rain-on-grid).
  • The 1D SWMM pipe urban pipe network junction attributes were updated to accomodate for the change in model configuration, from 2D direct rainfall to 1D SWMM hydrology.
  • Check and result files associated with the SWMM hydrology modelling were inspected.

Other TUFLOW SWMM Tutorials


Up
Go-up.png Return to TUFLOW SWMM Tutorial Introduction Main Page
Retrieved from "https://wiki.tuflow.com/w/index.php?title=TUFLOW_SWMM_Tutorial_M03_Development&oldid=39213"