Difference between revisions of "TUFLOW SWMM Tutorial M03"

From Tuflow
Jump to navigation Jump to search
(302 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
= Introduction =
 
= Introduction =
This tutorial, Module 3 of the TUFLOW SWMM tutorial dataset demonstrates how to add SWMM urban hydrology to a 1D / 2D SWMM stormwater pipe network, TUFLOW HPC catchment model. TUFLOW SWMM Tutorial Module 3 builds from the model created in <u>[[TUFLOW_SWMM_Tutorial_M02|TUFLOW SWMM Tutorial Module 2]]</u>. The completed TUFLOW SWMM Module 2 model is provided in the '''''TUFLOW_SWMM_Module_02\TUFLOW''''' folder of the download dataset as the starting point for this tutorial. If you are not already familiar with TUFLOW SWMM linking, we recommend first completing Module 1 and 2 before this tutorial. <br>
+
This tutorial, Module 3 of the TUFLOW SWMM tutorial dataset, demonstrates how to add SWMM urban hydrology to a 1D / 2D SWMM stormwater pipe network and 2D TUFLOW HPC catchment model. TUFLOW SWMM Tutorial Module 3 builds from the model created in <u>[[TUFLOW_SWMM_Tutorial_M02|TUFLOW SWMM Tutorial Module 2]]</u>. The completed TUFLOW SWMM Module 2 model is provided in the '''''TUFLOW_SWMM_Module_03\TUFLOW''''' folder of the download dataset as the starting point for this tutorial. If you are not already familiar with TUFLOW SWMM linking, we recommend completing TUFLOW SWMM Modules 1 and 2 prior to starting this tutorial. <br>
  
 
= Project Initialization =
 
= Project Initialization =
 
==QGIS==
 
==QGIS==
QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3.9.0.49 or newer are required to access the SWMM Processing Tools described in the following sections. For installation, see <u>[https://wiki.tuflow.com/index.php?title=TUFLOW_QGIS_Plugin#Installation_of_Plugin Installation of TUFLOW Plugin]</u>.<br>
+
QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3.9.0.110 or newer are required to access the SWMM Processing Tools described in the following sections. For installation, see <u>[https://wiki.tuflow.com/index.php?title=TUFLOW_QGIS_Plugin#Installation_of_Plugin Installation of TUFLOW Plugin]</u>.<br>
 
Define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace:
 
Define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace:
 
<ol>  
 
<ol>  
Line 20: Line 20:
 
Next we need to configure the QGIS TUFLOW Plugin settings to link with the project folder where we will build our model:<br>
 
Next we need to configure the QGIS TUFLOW Plugin settings to link with the project folder where we will build our model:<br>
 
<ol>
 
<ol>
<li>Go to Plugins > TUFLOW > Editing > Configure / Create TUFLOW Project.
+
<li>Open the 'Configure TUFLOW Project' tool by selecting Plugins > TUFLOW > Editing > Configure / Create TUFLOW Project.
<li>Change the folder which contains TUFLOW to the '''TUFLOW_SWMM_Module_03''' folder.  
+
<li>In the previous section, the CRS (Coordinate Reference System) for the QGIS Workspace was defined. As such, the projection inputs are set automatically.
<li> Set the GIS Format to '''GPKG'''.
+
<li>To set the location of the TUFLOW folder, click 'Browse...' and navigate to the '''TUFLOW_SWMM_Module_03''' folder. Click 'Select Folder'.  
<li>Click 'OK' and save the workspace by selecting Project > Save As.<br>
+
<li>To set the location of the TUFLOW single precision executable file, click 'Browse...' and navigate to the '''exe\2023-03-AD''' folder. Select '''TUFLOW_iSP_w64.exe''' and click 'Open'.
 +
<li>Select 'GPKG' as the GIS Format.
 +
<li>Select 'TUFLOW Classic / HPC' as the TUFLOW Engine.
 +
<li>Tick on 'Save Default Settings Globally'.
 +
<li>Click 'OK'.<br>
 
<br>
 
<br>
'''<<image>>'''<br>
+
[[File:SWMM_M03_configure_project.png]]<br>
 
</ol>
 
</ol>
 
<br>
 
<br>
Line 37: Line 41:
 
[[File: Tuflow_plugin_load_tcf_layers.png]]<br>
 
[[File: Tuflow_plugin_load_tcf_layers.png]]<br>
 
<br>
 
<br>
<li>In File Explorer, navigate to the '''TUFLOW_SWMM_Module_03\TUFLOW\runs''' folder and select '''TS02_5m_001.tcf'''.
+
<li>Navigate to the '''TUFLOW_SWMM_Module_03\TUFLOW\runs''' folder and select '''TS02_5m_001.tcf'''.
 
<li>In the Load Layers window, select:
 
<li>In the Load Layers window, select:
 
* Ordering Options: Alphabetical
 
* Ordering Options: Alphabetical
Line 45: Line 49:
 
</ol>
 
</ol>
 
<br>
 
<br>
Style the TUFLOW layers. Suggested styling steps were provided in <u>[[TUFLOW_SWMM_Tutorial_M01#QGIS_Project_Initialization|TUFLOW SWMM Tutorial M01]]</u>. They have not been duplicated here.<br>
+
Style the TUFLOW layers. Suggested styling steps were provided in <u>[[TUFLOW_SWMM_Tutorial_M01#Load_and_Style_TUFLOW_Model_Files|TUFLOW SWMM Tutorial M01]]</u>. They have not been duplicated here.<br>
 
<br>
 
<br>
 +
 
=== Increment TUFLOW GeoPackage File ===  
 
=== Increment TUFLOW GeoPackage File ===  
Save a copy of TS02_001.gpkg with a new name (TS03_001.gpkg). This project initialization step is recommended so prior model versions from a project are not broken as a result of changes being made to GIS inputs.
+
We will now save a copy of '''TS02_001.gpkg''' with a new name, '''TS03_001.gpkg'''. This project initialization step is recommended so prior model versions from a project are not broken as a result of changes being made to GIS inputs.
  
 
<ol>
 
<ol>
<li> Left click '''2d_bc_M01_001_L''' in the QGIS Layers panel.
+
<li>In the QGIS Layers panel, select (left click) '''2d_bc_M01_001_L'''.
<li> Select the TUFLOW Plugin '''Increment Selected Layer''' tool.
+
<li>Click on the 'Increment Selected Layer' symbol from the TUFLOW Plugin toolbar. This opens the dialog shown below.
<li>
+
<br>
 +
[[File:tuflow_plugin_increment_layer.png]]<br>
 +
<br>
 +
:*Source Layer: Automatically set to the selected layer, '''2d_bc_M01_001_L'''.
 +
:*Output Database: Click 'Browse...'. This will automatically open to the '''TUFLOW\model\gis''' folder. Set the new output database name to '''TS03_001.gpkg''' and click 'Save'.
 +
:*Output Layer Name: This will automatically increment to '''2d_bc_M01_00''2''_L'''. Change the name back to '''2d_bc_M01_00''1''_L'''.
 +
:*Delete the pre-filled 'Incremented Layer' entry in the table. We do not wish to modify the version number associated with the 2d_bc file. This current exercise will not change the version number of any of the GIS layer inputs, it is simply establishing a copy of the existing GeoPackage where future edits will be saved to.
 +
:*Select 'Remove Source Layer from Workspace'.
 +
:*Select 'Increment Layer and Preserve Database'.
 +
<li>Click 'OK'.
 +
<li>The GeoPackage database, '''TS03_001.gpkg''' will now be in the '''TUFLOW_SWMM_Module_03\TUFLOW\model\gis''' folder.
 +
<br><br>
 +
{{Video|name=Animation_TS3_Initialization_02a.mp4|width=1235}}
 +
<br>
 +
</ol>
  
Set the new Output Database name to '''TS03_001.gpkg'''.
+
=== Increment SWMM GeoPackage File ===
<li>Delete the pre-filled "Incremented Layer" entry. We do not wish to modify the version number associated with the 2d_bc file. This current exercise will not change the version number of any of the GIS layer inputs, it is simply establishing a copy of the existing Geopackage where future edits will be saved to.
+
SWMM pipe network junction attributes need to be updated when converting a TUFLOW 2D direct rainfall / SWMM 1D model <u>([[TUFLOW_SWMM_Tutorial_M02|TUFLOW SWMM Tutorial Module 2]]</u>) into a format that uses SWMM hydrology instead of direct rainfall. Similar to above (incrementing the TUFLOW GeoPackage file), we will increment the SWMM pipe network database name so we do not alter the inputs necessary for '''TS02_5m_001.tcf''' to function without issue.  
<li>Select '''Remove Source Layer from Workspace'''.
+
<ol>
<li>Select '''Increment Layer and Preserve Database'''.
+
<li> In the QGIS Layers panel, open the '''TS02_001.tscf''' group. In the '''sw02_001''' group, right click '''Links--Conduits'''.
<li>Select '''OK'''.
+
<li> Select TUFLOW > SWMM - Increment GeoPackage. This opens the dialog shown below.
 +
:*Output File: Click the ... and set the new database name to '''sw03_001.gpkg'''
 +
:*Existing GeoPackage Layers: 'Unload -- do not move'.
 +
<li> Select 'OK'.
 +
<li> The tool will automatically load '''sw03_001.gpkg''' into the QGIS workspace and remove '''sw02_001.gpkg''' from the QGIS workspace.
 +
<li> In the QGIS Layers panel, move '''sw03_001.gpkg''' to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project.  
 +
<br><br>
 +
{{Video|name=Animation_TS3_Initialization_03a.mp4|width=1235}}
 +
<br>
 
</ol>
 
</ol>
'''<<image>>'''<br>
 
  
 
===Save QGIS Project Workspace===
 
===Save QGIS Project Workspace===
Save the QGIS Workspace:
 
 
<ol>
 
<ol>
 
<li>Go to Project > Save As.
 
<li>Go to Project > Save As.
Line 71: Line 96:
 
<br>
 
<br>
  
= SWMM Inputs =
+
= GIS Inputs =
==Create SWMM GeoPackage Spatial Database==  
+
==Update SWMM GeoPackage Spatial Database==  
We will create a new SWMM GeoPackage database for our pipe network feature entries:
+
In previous tutorials we have created new SWMM GeoPackage databases for our new entries. This tutorial will demonstrate a different update approach. Instead of creating a new SWMM GeoPackage database, we will update the existing database, '''sw03_001.gpkg''' by adding new SWMM Sections for the hydrology elements we will be incorporating into the model in this tutorial.
<ol>  
+
 
<li>Go to '''Processing > Toolbox''' from the top dropdown menu options to open the Processing Toolbox Panel.
+
<ol>
<li>Go to '''TUFLOW > SWMM''' in the processing tool list and select 'GeoPackage - Create'. This opens the dialog shown below.
+
<li>Go to Processing > Toolbox from the top dropdown menu options to open the Processing Toolbox.
:*To set the ‘CRS for GeoPackage’: Click the drop down menu and select ‘Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S’.
+
<li>Go to TUFLOW >> SWMM in the processing tool list and select '<u>[[QGIS_SWMM_GeoPackage_Add_Sections |GeoPackage - Add sections]]</u>'. This opens the dialog shown below.
:*To set the ‘Initial SWMM Sections’: Click the …, and tick on:
+
:*GPKG filename modify: Click the ... and navigate to the '''TUFLOW_SWMM_Module_03\TUFLOW\model\swmm''' folder. Select '''sw03_001.gpkg'''.
:**'''Hydrology--Raingages''', '''Hydrology--Subcatchments'''
+
:*CRS for GeoPackage layers: Click the drop down menu and select 'Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S'.
:*To define the ‘GPKG filename to create’: Click the …, select ‘Save to File’. Navigate to the '''TUFLOW\model\swmm''' folder and save the GeoPackage Database as '''sw03_001.gpkg'''.
+
:*SWMM Sections to add: Click the ..., and tick on:
''Note: In Module 1 we included '''Project--Options''' in the GeoPackage file. Project--Options define the SWMM simulation controls, such as hydrology computation timestep. Project--Options are not required in the new geopackage database we are creating for this Tutorial. This is because this model will be constructed from multiple SWMM input (INP) files: ''
+
::*'''Hydrology--Raingages'''
''* The SWMM INP file created during Module 1 (road culverts).''
+
::*'''Hydrology--Subcatchments'''
''* The SWMM INP file careted for Module 2 (underground pipe network inputs). ''
 
''* This Module's SWMM INP (SWMM urban hydrology).''
 
''When TUFLOW processes SWMM inputs, it combines the multiple INP files into one single INP prior to simulation. For this model, the simulation control parameters defined in the Module 1 '''Project--Options''' will apply. Options relevant to this tutorial that have already been defined in the Module 1 input were '''flow_units''':set to metric, '''infiltration''' method: set to Green Ampt,'''wetstep''' hydrology timestep: set to 1 minute and '''dry step''' hydrology timestep: set to 1 minute.'' <br>
 
 
<li>Click 'Run'.
 
<li>Click 'Run'.
<li>Once to tool has finished, click ‘Close’.
+
<li>Once the tool is finished, click 'Close'.
<li>In File Explorer, navigate to the '''TUFLOW\model\swmm''' folder and drag and drop '''sw03_001.gpkg''' into QGIS.  
+
<br><br>
 +
{{Video|name=Animation_TS3_SWMM_Inputs_01a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
The above steps have added the new sections to the SWMM GeoPackage database, '''sw03_001.gpkg'''. However, the new sections are not currently displayed in the QGIS Layers panel. We need to close the database and reopen it to view the changes.
 +
<ol>
 +
<li>In the QGIS Layers panel, right click '''sw03_001''' and select 'Remove Group...'.
 +
<li>In Windows File Explorer, navigate to the '''TUFLOW\model\swmm''' folder and drag and drop '''sw03_001.gpkg''' into QGIS.  
 
<li>When prompted by QGIS, under 'Options', tick on 'Add layers to group', then select 'Add Layers' to open all vectors within '''sw03_001.gpkg'''. By default, all items in the available list should have been selected.  
 
<li>When prompted by QGIS, under 'Options', tick on 'Add layers to group', then select 'Add Layers' to open all vectors within '''sw03_001.gpkg'''. By default, all items in the available list should have been selected.  
<li>In the QGIS Layers panel, move '''sw03_001.gpkg''' to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project.  
+
<li>In the QGIS Layers panel, move '''sw03_001.gpkg''' to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project when edits are made.
 +
<li>In the QGIS Layers panel, within the '''sw03_001''' group, move '''Hydrology--Subcatchments''' to the bottom. This will ensure that the other data within this database can be seen.  
 
<br><br>
 
<br><br>
'''<<Video>>'''
+
{{Video|name=Animation_TS3_SWMM_Inputs_02a.mp4|width=1235}}
 +
<br>
 
</ol>
 
</ol>
 +
 +
== SWMM GIS Data Entry ==
 +
 +
A GeoPackage called '''Urban_Hydrology.gpkg''' is provided in the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. It contains one SWMM input layer and one TUFLOW input layer:
 +
:*'''SWMM_Subcatchments''': defines the 1D SWMM urban hydrology subcatchment delineation and associated parameters.
 +
:*'''TUFLOW_Subcatchments''': defines the remaining 2D TUFLOW catchment hydrology subcatchment delineation.<br>
 +
 +
To populate the SWMM GeoPackage created in the previous section:
 +
<ol>
 +
<li>In Windows File Explorer, navigate to the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. Drag and drop the '''Urban_Hydrology.gpkg''' into QGIS.
 +
<li>When prompted by QGIS select '''SWMM_Subcatchments'''. Click 'Add Layers'.
 +
<li>In the QGIS Layers panel, right click on the '''SWMM_Subcatchments''' layer and select 'Zoom to Layer(s)'.
 +
<li>Use the 'Select Features' tool to highlight all items included in '''SWMM_Subcatchments'''.
 +
<li>Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.
 +
<li>In the QGIS Layers panel, select (left click) the '''sw03_001 >> Hydrology--Subcatchments''' layer.
 +
<li>Make the '''sw03_001 >> Hydrology--Subcatchments''' layer editable by clicking the 'Toggle Editing' symbol [[File:toggle_editing_icon.png|27x27px]].
 +
<li>Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
 +
<li>Toggle the editing off to save the edits.
 +
<li>Remove '''SWMM_Subcatchments'''.
 +
<br><br>
 +
{{Video|name=Animation_TS3_SWMM_Inputs_03a.mp4|width=1235}}
 
<br>
 
<br>
 +
</ol>
  
== GIS Data Entry ==
+
==SWMM GIS Data Updates==
 +
The following updates are being made to the objects and layers within '''sw03_001.gpkg'''.
  
A GeoPackage called '''Urban_Hydrology.gpkg''' is provided in the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. It contains one SWMM input layers:
+
===Update SWMM Hydrology Raingages===
:*'''Subcatchments''': defining the hydrology subcatchment delineation and asociated parameters.
+
The information within '''Hydrology--Raingages''' defines the pluviographs in the catchment. We will link to two different rain gages in this example. <br>
 +
'''Note:''' 'Gage' is the American spelling of 'Gauge' in Oxford English.
  
 +
<ol>
 +
<li>In the QGIS Layers panel, select (left click) '''Hydrology--Raingages''' and toggle on editing.
 +
<li>Right click '''Hydrology--Raingages''' and select 'Open Attribute Table'.
 +
<li>Click 'Add Feature' twice. Enter the following attributes (leave all other fields as ''NULL''):
 +
{| class="wikitable" width="60%"
 +
!style="background-color:#005581; font-weight:bold; color:white;"| Name
 +
!style="background-color:#005581; font-weight:bold; color:white;"| Form
 +
!style="background-color:#005581; font-weight:bold; color:white;"| Intevl
 +
!style="background-color:#005581; font-weight:bold; color:white;"| SnowCatchDeficiency
 +
!style="background-color:#005581; font-weight:bold; color:white;"| Format
 +
!style="background-color:#005581; font-weight:bold; color:white;"| Tseries
 +
|-
 +
| RF_G1 || Volume || 0.1 || 1 || TIMESERIES || RF_FC04
 +
|-
 +
| RF_G2 || Volume || 0.1 || 1 || TIMESERIES || RF_FC07
 +
|}
 +
For a summary of the attributes associated with '''Hydrology--Raingages''', refer to <u>[https://docs.tuflow.com/classic-hpc/release/2023-03-AD/SWMM-Input-Detailed-1.html#tab:tab-SWMM-Input-Raingages TUFLOW 2023-03-AD Release Notes (Table A.11)]</u> and the <u>[https://downloads.tuflow.com/SWMM/SWMM5_Reference_Manual_Volume1_Hydrology_P100NYRA.pdf SWMM5 Reference Manual - Volume 1 (Hydrology)]</u>.
 +
<li> Turn off editing and save the information.
 +
<br><br>
 +
{{Video|name=Animation_TS3_SWMM_Inputs_04a.mp4|width=1235}}
 
<br>
 
<br>
To populate the GeoPackage created in the previous section:
+
</ol>
 +
 
 +
===Update SWMM Hydrology Subcatchments===
 +
The information within '''Hydrology--Subcatchments''' defines the subcatchment parameters (including catchment area, width, slope, percent impervious, outlet specification and infiltration details). All required data entries have been pre-filled in the supplied dataset except the 'Area' information, which we will determine using QGIS. SWMM requires the hydrology subcatchment area information in hectares.
 
<ol>
 
<ol>
<li>In Windows Explorer, navigate to the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. Drag and drop the '''Urban_Hydrology.gpkg''' into QGIS.  
+
<li>In the QGIS Layers panel, select (left click) '''Hydrology--Subcatchments''' and toggle on editing.
<li>When prompted by QGIS, under 'Options', tick on 'Add layers to group', then select '''Subcatchments'''. Click 'Add Layers'.
+
<li>Right click '''Hydrology--Subcatchments''' and select 'Open Attribute Table'.
<li>In the QGIS Layers panel, right click on the '''Subcatchments''' layer and select 'Zoom to Layer'.
+
<li>Choose 'Area' as the target field and type the calculation expression, '$area / 10000'.
<li>Use the 'Select Features' tool to highlight all items included in '''Subcatchments'''.
+
:* '$area ': Extracts the area of each region (subcatchment) in '''Hydrology--Subcatchments'''.
 +
:* '/ 10000': Converts the area values into hectares.<br>
 +
'''Note:''' The projection used in these tutorials is measured in meters. Thus, when QGIS extracts the area from a region, it reports the area in m<sup>2</sup>. If using a projection that is measured in feet, QGIS would extract the area in ft<sup>2</sup>.
 +
<li>Click 'Update All'.
 +
<li>Turn off editing and save the information.
 +
<li>Inspect the attribute information within '''Hydrology--Subcatchments''' to familiarize yourself with the data. A few demonstration features have been included in the dataset.
 +
:*Two rainfall gages are linked to the subcatchments. Downstream subcatchments are linked to rain gage 'RF_G1'. Upstream subcatchments are linked to rain gage 'RF_G2'.
 +
:*Subcatchments 'SPit11A' and 'SPit11B' are being routed to subcatchment 'SPit11C' before entering the SWMM pipe network. All other hydrology subcatchments route directly to a SWMM '''Node--Junctions'''.<br>
 +
For a summary of the attributes associated with the layer, refer to <u>[https://docs.tuflow.com/classic-hpc/release/2023-03-AD/SWMM-Input-Detailed-1.html#tab:tab-SWMM-Input-Subcatchments TUFLOW 2023-03-AD Release Notes (Table A.38)]</u> and the <u>[https://downloads.tuflow.com/SWMM/SWMM5_Reference_Manual_Volume1_Hydrology_P100NYRA.pdf SWMM5 Reference Manual - Volume 1 (Hydrology)]</u>.
 +
<br><br>
 +
{{Video|name=Animation_TS3_SWMM_Inputs_05a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
===SWMM Options===
 +
SWMM '''Project--Options''' defines the SWMM simulation controls, such as hydrology computation timestep. '''Project--Options''' are not required in the new GeoPackage database we are creating for this Tutorial. This is because this model will be constructed from multiple SWMM input (INP) files:
 +
:*'''sw01_001.inp''' (road culverts).
 +
:*'''sw03_001.inp''' (underground pipe network inputs and SWMM hydrology).
 +
When TUFLOW processes SWMM inputs, it combines the multiple INP files into one single INP prior to simulation. For this model, the simulation control parameters defined in Module 1 ('''sw01_001''') '''Project--Options''' will apply. The options relevant to this tutorial that have already been defined in the Module 1 input include:
 +
:*'''FLOW_UNITS''': set to metric (CMS).
 +
:*'''INFILTRATION''' method: set to GREEN-AMPT.
 +
:*'''WET_STEP''' hydrology timestep: set to 1 minute.
 +
:*'''DRY_STEP''' hydrology timestep: set to 1 minute.<br>
 +
'''Note:''' If we wanted to change the '''Project--Options''' as a result of this modules additional data, '''Project--Options''' should have been included as a item in the earlier <u>[[TUFLOW_SWMM_Tutorial_M03#Update_SWMM_GeoPackage_Spatial_Database | SWMM GeoPackage Update]]</u> step, or SWMM GeoPackage Create step if using the model development workflow demonstrated in the previous tutorials. If the SWMM INP file reference is specified lower in the TSCF control file, the information contained in the file supersedes any duplicate information defined by INP files higher in the TSCF control file.''
 +
<br><br>
 +
 
 +
===Update SWMM Junction Details===
 +
When coupling SWMM hydrology with a 1D pipe network, updated '''Nodes--Junctions''' attribute details are needed if converting from 2D direct rainfall (rain-on-grid) model design. Now the SWMM hydrology inputs are complete, we will make the necessary changes to '''Nodes--Junctions''' in '''sw03_001.gpkg'''.<br>
 +
 
 +
<ol>
 +
<li>In the QGIS Layers panel, select (left click) '''Nodes--Junctions''' and toggle on editing.
 +
<li>In the Processing Toolbox, select the 'Edit Features In-Place' tool. This allows the editing of an existing layer, instead of the creation of a new layer.
 +
<li>Go to TUFLOW >> SWMM in the processing tool list and select '<u>[[QGIS_SWMM_Junctions_Set_Attributes |Junctions - Set attributes ]]</u>' processing tool. This opens the dialog shown below.
 +
:*Input Subcatchment Layers: '''sw03_001 >> Hydrology--Subcatchments'''
 +
:*Input Inlet Usage Layers: '''TS02_001.tscf >> swmm_iu_TS02_001'''
 +
:*Input BC Connection Layers: '''TS02_001.tbc >> 2d_bc_SWMM_Pipe_Network_Connections_001_L'''
 +
:*General options:
 +
:::*Maximum Depth Option (Ymax): 'Set to 0.0'.
 +
:::*Nodes receiving subcatchment flows option (if connected to 2D): 'Set Apond = 0.0; Ksur = 0.0 (overwrites options below)'.
 +
:*Nodes connected to 2D without Inlets (through embankment culvert):
 +
:::*Ysur: 0
 +
:::*Area of ponding: 50
 +
:*Nodes connected to the 2D with Inlets (underground pipe network):
 +
:::*Maximum depth: 'Use global option'.
 +
:::*Ysur: 0
 +
:::*Area of ponding: 25
 +
:*Nodes without a 2D connection (underground pipe network):
 +
:::*Surcharge depth: 50
 +
:::*Area of ponding: 1
 +
<li>Select 'Modify All Features'.
 +
<li>Once the tool has finished, click 'Close'.
 +
<li>Turn off editing to save the edits.
 +
<li>View the attributes associated within '''Nodes--Junctions''' to verify the data processing has been completed correctly. <br>
 +
For a summary of the attributes associated with the '''Nodes--Junctions''' layer, refer to <u>[https://docs.tuflow.com/classic-hpc/release/2023-03-AD/SWMM-Input-Detailed-1.html#tab:tab-SWMM-Input-Junctions TUFLOW 2023-03-AD Release Notes (Table A.30)]</u> and the <u>[https://downloads.tuflow.com/SWMM/SWMM5_Reference_Manual_Volume2_Hydaulics_P100S9AS.pdf SWMM Reference Manual - Volume 2 (Hydraulics)]</u>.
 +
<br><br>
 +
{{Video|name=Animation_TS3_SWMM_Inputs_06a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
== Export SWMM INP File ==
 +
We will now create a new INP file for the pipe network and SWMM urban hydrology inputs. To do this, we need to convert '''sw03_001.gpkg''' into a SWMM INP file.
 +
 
 +
<ol>
 +
<li>In the Processing Toolbox, go to TUFLOW >> SWMM and select '<u>[[QGIS_SWMM_GeoPackage_Write_to_SWMM_inp |GeoPackage - Write to SWMM inp]]</u>'. This opens the dialog shown below.
 +
:*GeoPackage Input File: Navigate to the '''TUFLOW\model\swmm''' folder and select '''sw03_001.gpkg'''.
 +
<li>By default, this tool will save the SWMM inp file in the same folder location and with the same name as the GeoPackage input file. In this case, it will save '''sw03_001.inp''' to the '''TUFLOW\model\swmm''' folder.
 +
<li>Click 'Run'.
 +
<li>Once the tool is finished, click 'Close'.
 +
<br><br>
 +
{{Video|name=Animation_TS3_SWMM_Inputs_07a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
==TUFLOW GIS Updates==
 +
We will be reverting the TUFLOW model back to a configuration that uses inflows from an external hydrology model (as per Module 1), instead of 2D direct rainfall (Module 2), in the areas not covered by SWMM urban hydrology. Instead of reusing the input from Module 1, we will need to use a new TUFLOW source area inflow layer. This will ensure that we do not double count the flow generated over the area now represented by SWMM.
 +
 
 +
<ol>
 +
<li>Click on the ‘Import Empty File’ symbol from the TUFLOW plugin toolbar. <br>
 +
[[File:tuflow_plugin_import_empty_file.png]]<br>
 +
<br>
 +
<li>Select '2d_sa' from the Empty Type list.
 +
<li>In the Run ID box write 'TS03_001'.
 +
<li>Tick the 'Regions' Geometry Type.
 +
<li>In the Spatial Database Options, select 'All to one'. Navigate to the '''TUFLOW_SWMM_Module_03\TUFLOW\model\gis''' folder and select '''TS03_001.gpkg'''. Click Save and hit 'OK'.
 +
<li>The '''2d_sa_TS03_001_R''' appears in the QGIS Layers panel.<br>
 +
<br>
 +
[[File:TS3_import_empty_2d_sa_01a.png]]<br>
 +
<br>
 +
<li>In Windows File Explorer, navigate to the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. Drag and drop the '''Urban_Hydrology.gpkg''' into QGIS.  
 +
<li>When prompted by QGIS, select '''TUFLOW_Subcatchments'''. Click 'Add Layers'.
 +
<li>In the QGIS Layers panel, select (left click) the '''TUFLOW_Subcatchments''' layer.
 +
<li>Use the 'Select Features' tool to highlight the four regions included in '''TUFLOW_Subcatchments'''.
 
<li>Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.  
 
<li>Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.  
<li>Select the '''Hydrology--Subcatchments''' layer in the Layers panel by left clicking on it once.  
+
<li>In the QGIS Layers panel, select (left click) the '''2d_sa_TS03_001_R''' layer.
<li>Make the '''Hydrology--Subcatchments''' layer editable by clicking the 'Toggle Editing' symbol [[File:toggle_editing_icon.png|27x27px]].
+
<li>Make the '''2d_sa_TS03_001_R''' layer editable by clicking the 'Toggle Editing' symbol [[File:toggle_editing_icon.png|27x27px]].
 
<li>Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
 
<li>Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
<li>Toggle the editing off to save the edits.
+
<li>Toggle off editing to save the edits.
<li>Remove '''Urban_Hydrology.gpkg''' from QGIS.
+
<li>Remove '''Urban_Hydrology.gpkg'''.<br>
 +
The polygon entry we have updated refers to a new subcatchment name for the region adjacent to the SWMM subcatchments. The new name is 'FC06.62', instead of 'FC06'. When we update the TUFLOW control files we will configure the file references so we are sourcing data from a new flow file obtained from an external hydrology model that has been updated with the reduced catchment area, in recognition of SWMM being used for the flow estimate in the proposed urban development area. <br>
 +
'''Note:''' Common hydrology software used in combination with TUFLOW by modelers include: HEC-HMS, RORB, Drains, WBNM, URBS and more.''
 
<br><br>
 
<br><br>
'''<<Video>>'''<br>
+
{{Video|name=Animation_TS3_TUFLOW_Inputs_01a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
==TUFLOW Boundary Updates==
 +
As a result of the changes made to the TUFLOW inflows, new TUFLOW boundary condition csv files are also needed. Updated files have been provided in the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. These files provide the values and model linkages to the new hydrology inflows, which include the 'FC06.62' entry.
 +
<ol>
 +
<li>Copy '''bc_dbase_TS03_001.csv''' and '''TS03_01p2hr.csv''' from the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder to the '''TUFLOW_SWMM_Module_03\TUFLOW\bc_dbase''' folder.
 
<br><br>
 
<br><br>
<li>Inspect the attribute information within '''Hydrology--Subcatchments''' to familiarize yourself with the data.
+
{{Video|name=Animation_TS3_TUFLOW_Boundary_01a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
=Simulation Control Files=
 +
To avoid the potential risk of overwriting existing control files accidentally, we will start by saving new control files where we will be making subsequent syntax updates during the following steps.
 +
<ol>
 +
<li>Open '''TS02_5m_001.tcf''' in a Text Editor (Notepad++ is recommended). Save the file as '''TS03_5m_001.tcf''' in the '''TUFLOW_SWMM_Module_03\TUFLOW\runs''' folder.
 +
<li>Using the 'Open File' function in Notepad++:
 +
:*Open '''TS02_001.tbc,'''  and save the file as '''TS03_001.tbc''' in the '''TUFLOW\model''' folder.
 +
:*Open '''TS02_001.tscf,'''  and save the file as '''TS03_001.tscf''' in the '''TUFLOW\model''' folder.
 +
<br>
 +
</ol>
 +
 
 +
===TUFLOW Control File (TCF)===
 +
<ol>
 +
<li>Open '''TS03_001.tcf''' and make the following reference updates:<br>
 +
<font color="blue"><tt>Spatial Database </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>..\model\gis\TS03_001.gpkg</tt></font> <font color="green"><tt>  ! Specify the location of the GeoPackage Spatial Database</tt></font><br>
 +
<font color="blue"><tt>BC Control File</tt></font> <font color="red"><tt> == </tt></font> <font color="black"><tt>..\model\TS03_001.tbc</tt></font> <font color="green"><tt>  ! Reference the TUFLOW Boundary Condition Control File</tt></font><br>
 +
<font color="blue"><tt>BC Database</tt></font> <font color="red"><tt> == </tt></font> <font color="black"><tt>..\bc_dbase\bc_dbase_TS03_001.csv</tt></font> <font color="green"><tt>  ! Reference the Boundary Condition Database</tt></font><br>
 +
<font color="blue"><tt>SWMM Control File</tt></font> <font color="red"><tt> == </tt></font> <font color="black"><tt>..\model\TS03_001.tscf</tt></font> <font color="green"><tt>  ! Reference the SWMM (1D) Control File</tt></font><br>
 +
<li> Comment out the 'Map Cuttoff Depth' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).<br>
 +
<font color="green"><tt>! Map Cutoff Depth == 0.05</tt></font><br>
 +
<br>
 +
{{Video|name=Animation_TS3_Sim_Control_01a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
===TUFLOW Boundary Control File (TBC)===
 +
<ol>
 +
<li>Open '''TS03_001.tbc'''. If using Notepad++, right click the file reference in '''TS03_5m_001.tcf''' and select 'Open File'.
 +
<li>Comment out the 'Global Rainfall BC' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).<br>
 +
<font color="green"><tt>! Global Rainfall BC == RF_FC04</tt></font>
 +
<br>
 +
<li>Add the following additional command:<br>
 +
<font color="blue"><tt>Read GIS SA</tt></font><font color="red"><tt> == </tt></font><font color="black"><tt>2d_sa_TS03_001_R </tt></font><font color="green"><tt>! Reads in 2D source area - Excluding SWMM areas</tt></font><br>
 +
<br>
 +
{{Video|name=Animation_TS3_Sim_Control_02a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
===TUFLOW SWMM Control File (TSCF)===
 +
<ol>
 +
<li>Open '''TS03_001.tscf'''. If using Notepad++, right click the file reference in '''TS03_5m_001.tcf''' and select 'Open File'.
 +
<li>Replace <font color="blue"><tt>Read SWMM</tt></font><font color="red"><tt> == </tt></font><font color="black"><tt>swmm\sw02_001.inp</tt></font> with the following command:<br>
 +
<font color="blue"><tt>Read SWMM</tt></font><font color="red"><tt> == </tt></font><font color="black"><tt>swmm\sw03_001.inp</tt></font><br>
 +
<li>Add the following additional command:<br>
 +
<font color="blue"><tt>Read BC Timeseries</tt></font><font color="red"><tt> == </tt></font><font color="black"><tt>RF_FC04 | RF_FC07 </tt></font><font color="green"><tt>! TUFLOW BC Database / SWMM Rain Gage Linkage</tt></font><br>
 +
<br>
 +
{{Video|name=Animation_TS3_Sim_Control_03a.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
=Running the Simulation=
 +
<ol>
 +
<li>Save a copy of '''_run_TS02_HPC.bat''' as '''_run_TS03_HPC.bat''' in the '''TUFLOW_SWMM_Module_03\TUFLOW\runs''' folder.
 +
<li>Update the batch file to reference the '''TS03_5m_001.tcf''' :<br>
 +
<font color="blue"><tt>'''set'''</tt></font> <font color="black"><tt>exe</tt></font><font color="red"><tt>=</tt></font><font color="black"><tt>"..\..\..\exe\2023-03-AD\TUFLOW_iSP_w64.exe"</tt></font><br>
 +
<font color="blue"><tt>'''set'''</tt></font> <font color="black"><tt>run</tt></font><font color="red"><tt>=</tt></font><font color="black"><tt>start "TUFLOW" /wait</tt></font> <font color="orange"><tt> %exe%</tt></font> <font color="black"><tt> -b</tt></font> <br>
 +
<font color="orange"><tt>%run% </tt></font> <font color="black"><tt>TS03_5m_001.tcf </tt></font>
 +
 
 +
<li>Save the batch file and double click it in Windows File Explorer to run the simulation. <br>
 +
If the model simulation doesn't run, here is a link to some common <u>[[Tutorial_Troubleshooting_QGIS | Troubleshooting]]</u> advice.
 
<br><br>
 
<br><br>
'''<<Video>>'''<br>
+
{{Video|name=Animation_TS3_Run_Sim_01a.mp4|width=1235}}<br>
 
</ol>
 
</ol>
 +
 +
== Troubleshooting ==
 +
Did your TUFLOW SWMM model fail to run successfully? If so, here is a link to a troubleshooting guide: <u>[[TUFLOW_SWMM_Troubleshooting | TUFLOW SWMM Troubleshooting]]</u>.<br>
 +
<br>
 +
 +
= Check Files =
 +
Review the SWMM INP and simulation report file from the '''TUFLOW_SWMM_Module_03\TUFLOW\results''' folder to confirm the new hydrology inputs are being processed correctly:
 +
* View '''TS03_5m_001_swmm.inp''' in a text editor to confirm the combining of the two input INP files has occurred correctly. Also use the QGIS Processing tool, <u>[[QGIS_SWMM_GeoPackage_Create_from_SWMM_inp |GeoPackage - Create from SWMM inp]]</u>, to view the information in QGIS.
 +
* View '''TS03_5m_001_swmm_curves.inp''' in a text editor to confirm the rainfall time series that has been used by the SWMM hydrology engine matches the input dataset.
 +
* View '''TS03_5m_001_swmm.rpt''' in a text editor to confirm the model computation is healthy in term of mass conservation.
 +
 +
= Results Output =
 +
Complete the steps outlined in following link to review the simulation results from the TUFLOW SWMM model simulation:
 +
 +
<u>[[TUFLOW_SWMM_Tutorial_M03_Results_QGIS | TUFLOW SWMM Tutorial 03 Results]]</u> <br>
 +
 +
= Conclusion =
 +
*EPA SWMM urban hydrology was added to the model (replacing 2D drect rainfall / rain-on-grid).
 +
*The 1D SWMM urban pipe network junction attributes were updated to accomodate for the change in model configuration, from 2D direct rainfall to 1D SWMM hydrology.
 +
*Check and result files associated with the SWMM hydrology modelling were inspected.
 +
 +
=Other TUFLOW SWMM Tutorials=
 +
*<u>[[TUFLOW_SWMM_Tutorial_M01 | TUFLOW SWMM Module 1]]</u>  - 1D SWMM Culverts
 +
*<u>[[TUFLOW_SWMM_Tutorial_M02 | TUFLOW SWMM Module 2]]</u>  - 1D SWMM Pipe Network / 2D TUFLOW Direct Rainfall Hydrology
 +
*<u>[[TUFLOW_SWMM_Tutorial_M03 | TUFLOW SWMM Module 3]]</u>  - 1D SWMM Pipe Network / 1D SWMM Urban Hydrology
 +
*<u>[[TUFLOW_SWMM_Tutorial_M04 | TUFLOW SWMM Module 4]]</u>  - 1D SWMM Pipe Network / 1D SWMM Urban Hydrology: Executing multiple different event simulations from a single model control file.
 +
*<u>[[XPSWMM_to_TUFLOW-SWMM | XPSWMM to TUFLOW SWMM]]</u>  - How to convert an XPSWMM model to TUFLOW SWMM.
 +
<br>
 +
{{Tips Navigation
 +
|uplink=[[TUFLOW_SWMM_Tutorial_Introduction#Tutorial_Modules| Return to TUFLOW SWMM Tutorial Introduction Main Page]]
 +
}}

Revision as of 09:46, 5 May 2024

Introduction

This tutorial, Module 3 of the TUFLOW SWMM tutorial dataset, demonstrates how to add SWMM urban hydrology to a 1D / 2D SWMM stormwater pipe network and 2D TUFLOW HPC catchment model. TUFLOW SWMM Tutorial Module 3 builds from the model created in TUFLOW SWMM Tutorial Module 2. The completed TUFLOW SWMM Module 2 model is provided in the TUFLOW_SWMM_Module_03\TUFLOW folder of the download dataset as the starting point for this tutorial. If you are not already familiar with TUFLOW SWMM linking, we recommend completing TUFLOW SWMM Modules 1 and 2 prior to starting this tutorial.

Project Initialization

QGIS

QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3.9.0.110 or newer are required to access the SWMM Processing Tools described in the following sections. For installation, see Installation of TUFLOW Plugin.
Define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace:

  1. Open QGIS.
  2. Go to Project > Properties…
  3. In the CRS tab, type ‘WGS 84 / UTM Zone 60S’.
  4. Select the matching projection in the 'Predefined Coordinate Reference Systems' section.
  5. Click ‘Apply’ and ‘OK’.
  6. Ensure that the projection is set correctly by viewing the bottom right hand corner of the workspace. It should read ‘EPSG:32760’.



TUFLOW Plugin

Next we need to configure the QGIS TUFLOW Plugin settings to link with the project folder where we will build our model:

  1. Open the 'Configure TUFLOW Project' tool by selecting Plugins > TUFLOW > Editing > Configure / Create TUFLOW Project.
  2. In the previous section, the CRS (Coordinate Reference System) for the QGIS Workspace was defined. As such, the projection inputs are set automatically.
  3. To set the location of the TUFLOW folder, click 'Browse...' and navigate to the TUFLOW_SWMM_Module_03 folder. Click 'Select Folder'.
  4. To set the location of the TUFLOW single precision executable file, click 'Browse...' and navigate to the exe\2023-03-AD folder. Select TUFLOW_iSP_w64.exe and click 'Open'.
  5. Select 'GPKG' as the GIS Format.
  6. Select 'TUFLOW Classic / HPC' as the TUFLOW Engine.
  7. Tick on 'Save Default Settings Globally'.
  8. Click 'OK'.

    SWMM M03 configure project.png


TUFLOW Model

Load and Style TUFLOW Model Files

Load in the project GIS layers:

  1. Click on the ‘Load TUFLOW Layers from TCF’ symbol from the TUFLOW Plugin toolbar.
    Tuflow plugin load tcf layers.png

  2. Navigate to the TUFLOW_SWMM_Module_03\TUFLOW\runs folder and select TS02_5m_001.tcf.
  3. In the Load Layers window, select:
    • Ordering Options: Alphabetical
    • Grouping Options: Group by control file
    • Raster Load Options: Load Normally
  4. Click ‘Open’ and ‘OK’.


Style the TUFLOW layers. Suggested styling steps were provided in TUFLOW SWMM Tutorial M01. They have not been duplicated here.

Increment TUFLOW GeoPackage File

We will now save a copy of TS02_001.gpkg with a new name, TS03_001.gpkg. This project initialization step is recommended so prior model versions from a project are not broken as a result of changes being made to GIS inputs.

  1. In the QGIS Layers panel, select (left click) 2d_bc_M01_001_L.
  2. Click on the 'Increment Selected Layer' symbol from the TUFLOW Plugin toolbar. This opens the dialog shown below.
    Tuflow plugin increment layer.png

    • Source Layer: Automatically set to the selected layer, 2d_bc_M01_001_L.
    • Output Database: Click 'Browse...'. This will automatically open to the TUFLOW\model\gis folder. Set the new output database name to TS03_001.gpkg and click 'Save'.
    • Output Layer Name: This will automatically increment to 2d_bc_M01_002_L. Change the name back to 2d_bc_M01_001_L.
    • Delete the pre-filled 'Incremented Layer' entry in the table. We do not wish to modify the version number associated with the 2d_bc file. This current exercise will not change the version number of any of the GIS layer inputs, it is simply establishing a copy of the existing GeoPackage where future edits will be saved to.
    • Select 'Remove Source Layer from Workspace'.
    • Select 'Increment Layer and Preserve Database'.
  3. Click 'OK'.
  4. The GeoPackage database, TS03_001.gpkg will now be in the TUFLOW_SWMM_Module_03\TUFLOW\model\gis folder.


Increment SWMM GeoPackage File

SWMM pipe network junction attributes need to be updated when converting a TUFLOW 2D direct rainfall / SWMM 1D model (TUFLOW SWMM Tutorial Module 2) into a format that uses SWMM hydrology instead of direct rainfall. Similar to above (incrementing the TUFLOW GeoPackage file), we will increment the SWMM pipe network database name so we do not alter the inputs necessary for TS02_5m_001.tcf to function without issue.

  1. In the QGIS Layers panel, open the TS02_001.tscf group. In the sw02_001 group, right click Links--Conduits.
  2. Select TUFLOW > SWMM - Increment GeoPackage. This opens the dialog shown below.
    • Output File: Click the ... and set the new database name to sw03_001.gpkg.
    • Existing GeoPackage Layers: 'Unload -- do not move'.
  3. Select 'OK'.
  4. The tool will automatically load sw03_001.gpkg into the QGIS workspace and remove sw02_001.gpkg from the QGIS workspace.
  5. In the QGIS Layers panel, move sw03_001.gpkg to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project.


Save QGIS Project Workspace

  1. Go to Project > Save As.
  2. Navigate to the TUFLOW_SWMM_Module_03 folder and type SWMM_M03 as the filename with the extension .qgz.


GIS Inputs

Update SWMM GeoPackage Spatial Database

In previous tutorials we have created new SWMM GeoPackage databases for our new entries. This tutorial will demonstrate a different update approach. Instead of creating a new SWMM GeoPackage database, we will update the existing database, sw03_001.gpkg by adding new SWMM Sections for the hydrology elements we will be incorporating into the model in this tutorial.

  1. Go to Processing > Toolbox from the top dropdown menu options to open the Processing Toolbox.
  2. Go to TUFLOW >> SWMM in the processing tool list and select 'GeoPackage - Add sections'. This opens the dialog shown below.
    • GPKG filename modify: Click the ... and navigate to the TUFLOW_SWMM_Module_03\TUFLOW\model\swmm folder. Select sw03_001.gpkg.
    • CRS for GeoPackage layers: Click the drop down menu and select 'Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S'.
    • SWMM Sections to add: Click the ..., and tick on:
    • Hydrology--Raingages
    • Hydrology--Subcatchments
  3. Click 'Run'.
  4. Once the tool is finished, click 'Close'.


The above steps have added the new sections to the SWMM GeoPackage database, sw03_001.gpkg. However, the new sections are not currently displayed in the QGIS Layers panel. We need to close the database and reopen it to view the changes.

  1. In the QGIS Layers panel, right click sw03_001 and select 'Remove Group...'.
  2. In Windows File Explorer, navigate to the TUFLOW\model\swmm folder and drag and drop sw03_001.gpkg into QGIS.
  3. When prompted by QGIS, under 'Options', tick on 'Add layers to group', then select 'Add Layers' to open all vectors within sw03_001.gpkg. By default, all items in the available list should have been selected.
  4. In the QGIS Layers panel, move sw03_001.gpkg to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project when edits are made.
  5. In the QGIS Layers panel, within the sw03_001 group, move Hydrology--Subcatchments to the bottom. This will ensure that the other data within this database can be seen.


SWMM GIS Data Entry

A GeoPackage called Urban_Hydrology.gpkg is provided in the TUFLOW_SWMM_Module_03\Tutorial_Data folder. It contains one SWMM input layer and one TUFLOW input layer:

  • SWMM_Subcatchments: defines the 1D SWMM urban hydrology subcatchment delineation and associated parameters.
  • TUFLOW_Subcatchments: defines the remaining 2D TUFLOW catchment hydrology subcatchment delineation.

To populate the SWMM GeoPackage created in the previous section:

  1. In Windows File Explorer, navigate to the TUFLOW_SWMM_Module_03\Tutorial_Data folder. Drag and drop the Urban_Hydrology.gpkg into QGIS.
  2. When prompted by QGIS select SWMM_Subcatchments. Click 'Add Layers'.
  3. In the QGIS Layers panel, right click on the SWMM_Subcatchments layer and select 'Zoom to Layer(s)'.
  4. Use the 'Select Features' tool to highlight all items included in SWMM_Subcatchments.
  5. Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.
  6. In the QGIS Layers panel, select (left click) the sw03_001 >> Hydrology--Subcatchments layer.
  7. Make the sw03_001 >> Hydrology--Subcatchments layer editable by clicking the 'Toggle Editing' symbol Toggle editing icon.png.
  8. Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
  9. Toggle the editing off to save the edits.
  10. Remove SWMM_Subcatchments.


SWMM GIS Data Updates

The following updates are being made to the objects and layers within sw03_001.gpkg.

Update SWMM Hydrology Raingages

The information within Hydrology--Raingages defines the pluviographs in the catchment. We will link to two different rain gages in this example.
Note: 'Gage' is the American spelling of 'Gauge' in Oxford English.

  1. In the QGIS Layers panel, select (left click) Hydrology--Raingages and toggle on editing.
  2. Right click Hydrology--Raingages and select 'Open Attribute Table'.
  3. Click 'Add Feature' twice. Enter the following attributes (leave all other fields as NULL):
    Name Form Intevl SnowCatchDeficiency Format Tseries
    RF_G1 Volume 0.1 1 TIMESERIES RF_FC04
    RF_G2 Volume 0.1 1 TIMESERIES RF_FC07

    For a summary of the attributes associated with Hydrology--Raingages, refer to TUFLOW 2023-03-AD Release Notes (Table A.11) and the SWMM5 Reference Manual - Volume 1 (Hydrology).

  4. Turn off editing and save the information.


Update SWMM Hydrology Subcatchments

The information within Hydrology--Subcatchments defines the subcatchment parameters (including catchment area, width, slope, percent impervious, outlet specification and infiltration details). All required data entries have been pre-filled in the supplied dataset except the 'Area' information, which we will determine using QGIS. SWMM requires the hydrology subcatchment area information in hectares.

  1. In the QGIS Layers panel, select (left click) Hydrology--Subcatchments and toggle on editing.
  2. Right click Hydrology--Subcatchments and select 'Open Attribute Table'.
  3. Choose 'Area' as the target field and type the calculation expression, '$area / 10000'.
    • '$area ': Extracts the area of each region (subcatchment) in Hydrology--Subcatchments.
    • '/ 10000': Converts the area values into hectares.
    Note: The projection used in these tutorials is measured in meters. Thus, when QGIS extracts the area from a region, it reports the area in m2. If using a projection that is measured in feet, QGIS would extract the area in ft2.
  4. Click 'Update All'.
  5. Turn off editing and save the information.
  6. Inspect the attribute information within Hydrology--Subcatchments to familiarize yourself with the data. A few demonstration features have been included in the dataset.
    • Two rainfall gages are linked to the subcatchments. Downstream subcatchments are linked to rain gage 'RF_G1'. Upstream subcatchments are linked to rain gage 'RF_G2'.
    • Subcatchments 'SPit11A' and 'SPit11B' are being routed to subcatchment 'SPit11C' before entering the SWMM pipe network. All other hydrology subcatchments route directly to a SWMM Node--Junctions.
    For a summary of the attributes associated with the layer, refer to TUFLOW 2023-03-AD Release Notes (Table A.38) and the SWMM5 Reference Manual - Volume 1 (Hydrology).


SWMM Options

SWMM Project--Options defines the SWMM simulation controls, such as hydrology computation timestep. Project--Options are not required in the new GeoPackage database we are creating for this Tutorial. This is because this model will be constructed from multiple SWMM input (INP) files:

  • sw01_001.inp (road culverts).
  • sw03_001.inp (underground pipe network inputs and SWMM hydrology).

When TUFLOW processes SWMM inputs, it combines the multiple INP files into one single INP prior to simulation. For this model, the simulation control parameters defined in Module 1 (sw01_001) Project--Options will apply. The options relevant to this tutorial that have already been defined in the Module 1 input include:

  • FLOW_UNITS: set to metric (CMS).
  • INFILTRATION method: set to GREEN-AMPT.
  • WET_STEP hydrology timestep: set to 1 minute.
  • DRY_STEP hydrology timestep: set to 1 minute.

Note: If we wanted to change the Project--Options as a result of this modules additional data, Project--Options should have been included as a item in the earlier SWMM GeoPackage Update step, or SWMM GeoPackage Create step if using the model development workflow demonstrated in the previous tutorials. If the SWMM INP file reference is specified lower in the TSCF control file, the information contained in the file supersedes any duplicate information defined by INP files higher in the TSCF control file.

Update SWMM Junction Details

When coupling SWMM hydrology with a 1D pipe network, updated Nodes--Junctions attribute details are needed if converting from 2D direct rainfall (rain-on-grid) model design. Now the SWMM hydrology inputs are complete, we will make the necessary changes to Nodes--Junctions in sw03_001.gpkg.

  1. In the QGIS Layers panel, select (left click) Nodes--Junctions and toggle on editing.
  2. In the Processing Toolbox, select the 'Edit Features In-Place' tool. This allows the editing of an existing layer, instead of the creation of a new layer.
  3. Go to TUFLOW >> SWMM in the processing tool list and select 'Junctions - Set attributes ' processing tool. This opens the dialog shown below.
    • Input Subcatchment Layers: sw03_001 >> Hydrology--Subcatchments
    • Input Inlet Usage Layers: TS02_001.tscf >> swmm_iu_TS02_001
    • Input BC Connection Layers: TS02_001.tbc >> 2d_bc_SWMM_Pipe_Network_Connections_001_L
    • General options:
    • Maximum Depth Option (Ymax): 'Set to 0.0'.
    • Nodes receiving subcatchment flows option (if connected to 2D): 'Set Apond = 0.0; Ksur = 0.0 (overwrites options below)'.
    • Nodes connected to 2D without Inlets (through embankment culvert):
    • Ysur: 0
    • Area of ponding: 50
    • Nodes connected to the 2D with Inlets (underground pipe network):
    • Maximum depth: 'Use global option'.
    • Ysur: 0
    • Area of ponding: 25
    • Nodes without a 2D connection (underground pipe network):
    • Surcharge depth: 50
    • Area of ponding: 1
  4. Select 'Modify All Features'.
  5. Once the tool has finished, click 'Close'.
  6. Turn off editing to save the edits.
  7. View the attributes associated within Nodes--Junctions to verify the data processing has been completed correctly.
    For a summary of the attributes associated with the Nodes--Junctions layer, refer to TUFLOW 2023-03-AD Release Notes (Table A.30) and the SWMM Reference Manual - Volume 2 (Hydraulics).


Export SWMM INP File

We will now create a new INP file for the pipe network and SWMM urban hydrology inputs. To do this, we need to convert sw03_001.gpkg into a SWMM INP file.

  1. In the Processing Toolbox, go to TUFLOW >> SWMM and select 'GeoPackage - Write to SWMM inp'. This opens the dialog shown below.
    • GeoPackage Input File: Navigate to the TUFLOW\model\swmm folder and select sw03_001.gpkg.
  2. By default, this tool will save the SWMM inp file in the same folder location and with the same name as the GeoPackage input file. In this case, it will save sw03_001.inp to the TUFLOW\model\swmm folder.
  3. Click 'Run'.
  4. Once the tool is finished, click 'Close'.


TUFLOW GIS Updates

We will be reverting the TUFLOW model back to a configuration that uses inflows from an external hydrology model (as per Module 1), instead of 2D direct rainfall (Module 2), in the areas not covered by SWMM urban hydrology. Instead of reusing the input from Module 1, we will need to use a new TUFLOW source area inflow layer. This will ensure that we do not double count the flow generated over the area now represented by SWMM.

  1. Click on the ‘Import Empty File’ symbol from the TUFLOW plugin toolbar.
    Tuflow plugin import empty file.png

  2. Select '2d_sa' from the Empty Type list.
  3. In the Run ID box write 'TS03_001'.
  4. Tick the 'Regions' Geometry Type.
  5. In the Spatial Database Options, select 'All to one'. Navigate to the TUFLOW_SWMM_Module_03\TUFLOW\model\gis folder and select TS03_001.gpkg. Click Save and hit 'OK'.
  6. The 2d_sa_TS03_001_R appears in the QGIS Layers panel.

    TS3 import empty 2d sa 01a.png

  7. In Windows File Explorer, navigate to the TUFLOW_SWMM_Module_03\Tutorial_Data folder. Drag and drop the Urban_Hydrology.gpkg into QGIS.
  8. When prompted by QGIS, select TUFLOW_Subcatchments. Click 'Add Layers'.
  9. In the QGIS Layers panel, select (left click) the TUFLOW_Subcatchments layer.
  10. Use the 'Select Features' tool to highlight the four regions included in TUFLOW_Subcatchments.
  11. Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.
  12. In the QGIS Layers panel, select (left click) the 2d_sa_TS03_001_R layer.
  13. Make the 2d_sa_TS03_001_R layer editable by clicking the 'Toggle Editing' symbol Toggle editing icon.png.
  14. Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
  15. Toggle off editing to save the edits.
  16. Remove Urban_Hydrology.gpkg.
    The polygon entry we have updated refers to a new subcatchment name for the region adjacent to the SWMM subcatchments. The new name is 'FC06.62', instead of 'FC06'. When we update the TUFLOW control files we will configure the file references so we are sourcing data from a new flow file obtained from an external hydrology model that has been updated with the reduced catchment area, in recognition of SWMM being used for the flow estimate in the proposed urban development area.
    Note: Common hydrology software used in combination with TUFLOW by modelers include: HEC-HMS, RORB, Drains, WBNM, URBS and more.


TUFLOW Boundary Updates

As a result of the changes made to the TUFLOW inflows, new TUFLOW boundary condition csv files are also needed. Updated files have been provided in the TUFLOW_SWMM_Module_03\Tutorial_Data folder. These files provide the values and model linkages to the new hydrology inflows, which include the 'FC06.62' entry.

  1. Copy bc_dbase_TS03_001.csv and TS03_01p2hr.csv from the TUFLOW_SWMM_Module_03\Tutorial_Data folder to the TUFLOW_SWMM_Module_03\TUFLOW\bc_dbase folder.


Simulation Control Files

To avoid the potential risk of overwriting existing control files accidentally, we will start by saving new control files where we will be making subsequent syntax updates during the following steps.

  1. Open TS02_5m_001.tcf in a Text Editor (Notepad++ is recommended). Save the file as TS03_5m_001.tcf in the TUFLOW_SWMM_Module_03\TUFLOW\runs folder.
  2. Using the 'Open File' function in Notepad++:
    • Open TS02_001.tbc, and save the file as TS03_001.tbc in the TUFLOW\model folder.
    • Open TS02_001.tscf, and save the file as TS03_001.tscf in the TUFLOW\model folder.

TUFLOW Control File (TCF)

  1. Open TS03_001.tcf and make the following reference updates:
    Spatial Database == ..\model\gis\TS03_001.gpkg ! Specify the location of the GeoPackage Spatial Database
    BC Control File == ..\model\TS03_001.tbc ! Reference the TUFLOW Boundary Condition Control File
    BC Database == ..\bc_dbase\bc_dbase_TS03_001.csv ! Reference the Boundary Condition Database
    SWMM Control File == ..\model\TS03_001.tscf ! Reference the SWMM (1D) Control File
  2. Comment out the 'Map Cuttoff Depth' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).
    ! Map Cutoff Depth == 0.05


TUFLOW Boundary Control File (TBC)

  1. Open TS03_001.tbc. If using Notepad++, right click the file reference in TS03_5m_001.tcf and select 'Open File'.
  2. Comment out the 'Global Rainfall BC' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).
    ! Global Rainfall BC == RF_FC04
  3. Add the following additional command:
    Read GIS SA == 2d_sa_TS03_001_R ! Reads in 2D source area - Excluding SWMM areas


TUFLOW SWMM Control File (TSCF)

  1. Open TS03_001.tscf. If using Notepad++, right click the file reference in TS03_5m_001.tcf and select 'Open File'.
  2. Replace Read SWMM == swmm\sw02_001.inp with the following command:
    Read SWMM == swmm\sw03_001.inp
  3. Add the following additional command:
    Read BC Timeseries == RF_FC04 | RF_FC07 ! TUFLOW BC Database / SWMM Rain Gage Linkage


Running the Simulation

  1. Save a copy of _run_TS02_HPC.bat as _run_TS03_HPC.bat in the TUFLOW_SWMM_Module_03\TUFLOW\runs folder.
  2. Update the batch file to reference the TS03_5m_001.tcf :
    set exe="..\..\..\exe\2023-03-AD\TUFLOW_iSP_w64.exe"
    set run=start "TUFLOW" /wait %exe% -b
    %run% TS03_5m_001.tcf
  3. Save the batch file and double click it in Windows File Explorer to run the simulation.
    If the model simulation doesn't run, here is a link to some common Troubleshooting advice.


Troubleshooting

Did your TUFLOW SWMM model fail to run successfully? If so, here is a link to a troubleshooting guide: TUFLOW SWMM Troubleshooting.

Check Files

Review the SWMM INP and simulation report file from the TUFLOW_SWMM_Module_03\TUFLOW\results folder to confirm the new hydrology inputs are being processed correctly:

  • View TS03_5m_001_swmm.inp in a text editor to confirm the combining of the two input INP files has occurred correctly. Also use the QGIS Processing tool, GeoPackage - Create from SWMM inp, to view the information in QGIS.
  • View TS03_5m_001_swmm_curves.inp in a text editor to confirm the rainfall time series that has been used by the SWMM hydrology engine matches the input dataset.
  • View TS03_5m_001_swmm.rpt in a text editor to confirm the model computation is healthy in term of mass conservation.

Results Output

Complete the steps outlined in following link to review the simulation results from the TUFLOW SWMM model simulation:

TUFLOW SWMM Tutorial 03 Results

Conclusion

  • EPA SWMM urban hydrology was added to the model (replacing 2D drect rainfall / rain-on-grid).
  • The 1D SWMM urban pipe network junction attributes were updated to accomodate for the change in model configuration, from 2D direct rainfall to 1D SWMM hydrology.
  • Check and result files associated with the SWMM hydrology modelling were inspected.

Other TUFLOW SWMM Tutorials


Up
Go-up.png Return to TUFLOW SWMM Tutorial Introduction Main Page