Difference between revisions of "TUFLOW SWMM Tutorial M01"

From Tuflow
Jump to navigation Jump to search
 
(284 intermediate revisions by 4 users not shown)
Line 2: Line 2:
 
In this module, three culverts are added to represent flow through three separate road embankments. EPA SWMM is used as the solution scheme for the 1D culvert flow calculations, dynamically linked with the TUFLOW HPC 2D solution scheme. <br>
 
In this module, three culverts are added to represent flow through three separate road embankments. EPA SWMM is used as the solution scheme for the 1D culvert flow calculations, dynamically linked with the TUFLOW HPC 2D solution scheme. <br>
  
−
TUFLOW SWMM Tutorial Module 1 builds from the model created in <u>[[Tutorial_M02 |TUFLOW Tutorial Module 2]]</u> (in the TUFLOW Only tutorial dataset). The completed Module 2 model is provided in the '''''TUFLOW_SWMM_Module_01\TUFLOW''''' folder of the download dataset as the starting point for this tutorial. If you are not already familiar with TUFLOW, we recommend first completing Module 1 and 2 of the <u>[[Tutorial_Introduction | "TUFLOW Only" Tutorials]]</u> to establish an understanding of 2D modelling, before progressing to learning how to link 1D EPA SWMM to 2D TUFLOW. <br>
+
TUFLOW SWMM Tutorial Module 1 builds from the model created in <u>[[Tutorial_M02 |TUFLOW Tutorial Module 2]]</u> (in the TUFLOW Only tutorial dataset). The completed TUFLOW Module 2 model is provided in the '''''TUFLOW_SWMM_Module_01\TUFLOW''''' folder of the download dataset as the starting point for this tutorial. If you are not already familiar with TUFLOW, we recommend first completing Module 1 and 2 of the <u>[[Tutorial_Introduction | "TUFLOW Only" Tutorials]]</u> to establish an understanding of 2D modeling, before progressing to learning how to link 1D EPA SWMM to 2D TUFLOW. <br>
  
−
= QGIS Project Initialization =
+
= Project Initialization =
−
QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3.9.0.49 or newer are required to access the SWMM Processing Tools described in the following sections. For installation, see <u>[https://wiki.tuflow.com/index.php?title=TUFLOW_QGIS_Plugin#Installation_of_Plugin Installation of TUFLOW Plugin]</u>.<br>
+
Three steps are required for the project initialization:
−
Define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace:
+
<ol>
 +
<li> Setting the  QGIS Project Coordinate Reference System (CRS).
 +
<li> Configuring the QGIS TUFLOW Plugin.
 +
<li> Establishing the new TUFLOW model GeoPackage file that will include new GIS inputs associated with this model update.
 +
</ol>
 +
 
 +
== QGIS ==
 +
QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3.11 or newer are required to access the SWMM Processing Tools described in the following sections. For installation, see <u>[https://wiki.tuflow.com/TUFLOW_QGIS_Plugin Installation of TUFLOW Plugin]</u>.<br>
 +
Firstly, define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace:
 
<ol>  
 
<ol>  
 
<li>Open QGIS.
 
<li>Open QGIS.
Line 16: Line 24:
 
</ol>
 
</ol>
 
<br>
 
<br>
−
{{Video|name=Animation_assign_projection_001.mp4|width=1235}}<br>
+
{{Video|name=Animation_TS1_Initialization_01a.mp4|width=1235}}<br>
  
−
Load in the project GIS layers:
+
==TUFLOW Model==
 +
===Load and Style TUFLOW Model Files===
 +
Load and Style the GIS layers from the TUFLOW model:
 
<ol>
 
<ol>
 
<li>Click on the ‘Load TUFLOW Layers from TCF’ symbol from the TUFLOW Plugin toolbar.
 
<li>Click on the ‘Load TUFLOW Layers from TCF’ symbol from the TUFLOW Plugin toolbar.
Line 24: Line 34:
 
[[File: Tuflow_plugin_load_tcf_layers.png]]<br>
 
[[File: Tuflow_plugin_load_tcf_layers.png]]<br>
 
<br>
 
<br>
−
<li>In File Explorer, navigate to the '''TUFLOW_SWMM_Module_01\TUFLOW\runs''' folder and select '''M02_5m_001.tcf'''.
+
<li>Navigate to the '''TUFLOW_SWMM_Module_01\TUFLOW\runs''' folder and select '''M02_5m_001.tcf'''.
 +
<li>In the Load Layers window, select:
 +
* Ordering Options: Alphabetical
 +
* Grouping Options: Group by control file
 +
* Raster Load Options: Load Normally
 
<li>Click ‘Open’ and ‘OK’.
 
<li>Click ‘Open’ and ‘OK’.
 
</ol>
 
</ol>
 
<br>
 
<br>
  
−
Style the TUFLOW layers as preferred. Common steps to do this are:
+
Style the TUFLOW layers however you desire. Common steps to do this are:
 
<ol>
 
<ol>
 
<li>Click on the ‘Apply TUFLOW Styles to Open Layers’ symbol from the TUFLOW Plugin toolbar.
 
<li>Click on the ‘Apply TUFLOW Styles to Open Layers’ symbol from the TUFLOW Plugin toolbar.
Line 36: Line 50:
 
<br>
 
<br>
 
<li>Change the symbology of the DEM:
 
<li>Change the symbology of the DEM:
−
*Right click on the '''DEM''' file in the Layers panel and select 'Properties'.
+
*Right click on the '''DEM''' file in the QGIS Layers Panel and select 'Properties'.
 
*From the Symbology tab, under 'Band Rendering' select the following options:
 
*From the Symbology tab, under 'Band Rendering' select the following options:
 
:*Render type: Singleband pseudocolor
 
:*Render type: Singleband pseudocolor
Line 45: Line 59:
 
*Click 'Apply' and 'OK'.
 
*Click 'Apply' and 'OK'.
 
<br>
 
<br>
−
{{Video|name=|width=1235}}<br>
+
{{Video|name=Animation_TS1_Initialization_03d.mp4|width=1235}}<br>
 
<li>Create a hillshade of the DEM:
 
<li>Create a hillshade of the DEM:
−
*Right click on the '''DEM''' file in the Layers panel and select 'Duplicate Layer'.
+
*Right click on the '''DEM''' file in the QGIS Layers Panel and select 'Duplicate Layer'.
 
*Right click on the '''DEM_copy''' and select 'Rename Layer'. Rename the layer to '''DEM_Hillshade'''.
 
*Right click on the '''DEM_copy''' and select 'Rename Layer'. Rename the layer to '''DEM_Hillshade'''.
−
*Right click on the '''DEM_Hillshade''' file and select 'Properties'.
+
*Right click on the '''DEM_Hillshade''' and select 'Properties'.
 
*From the Symbology tab, under 'Band Rendering' select the following options:
 
*From the Symbology tab, under 'Band Rendering' select the following options:
 
:*Render type: Hillshade
 
:*Render type: Hillshade
 
:*Z Factor: 3
 
:*Z Factor: 3
−
*From the Transparency tab, set the Global Opacity to 35%.
 
 
*Click 'Apply' and 'OK'.
 
*Click 'Apply' and 'OK'.
 
<br>
 
<br>
−
{{Video|name=|width=1235}}<br>
+
{{Video|name=Animation_TS1_Initialization_04b.mp4|width=1235}}<br>
 +
</ol>
 +
 
 +
===TUFLOW Plugin===
 +
Next we need to configure the QGIS TUFLOW Plugin settings to link with the project folder where we will build our model:<br>
 +
<ol>
 +
<li>Open the 'Configure TUFLOW Project' tool by selecting Plugins > TUFLOW > Editing > Configure / Create TUFLOW Project.
 +
<li>Set the CRS (Coordinate Reference System) by selecting one of the vector layers associated with the opened model using the drop menu list. For example, ''2d_bc_M01_001_L''.
 +
<li>To set the location of the TUFLOW folder, click 'Browse...' and navigate to the '''TUFLOW_SWMM_Module_01''' folder. Click 'Select Folder'.
 +
<li>To set the location of the TUFLOW single precision executable file, click 'Browse...' and navigate to the '''exe\2023-03-AF''' folder. Select '''TUFLOW_iSP_w64.exe''' and click 'Open'.
 +
<li>Select 'GPKG' as the GIS Format.
 +
<li>Select 'TUFLOW Classic / HPC' as the TUFLOW Engine.
 +
<li>Tick on 'Save Default Settings Globally'.
 +
<li>Click 'OK'.<br>
 +
<br>
 +
[[File: TS1_Configure_Project_01a.png]]<br>
 +
</ol>
 +
<br>
 +
 
 +
=== Increment Model GeoPackage File ===
 +
We will now save a copy of '''M02_001.gpkg''' with a new name, '''TS01_001.gpkg'''. This project initialization step is recommended so prior model versions from a project are not broken as a result of changes being made to GIS inputs.
 +
 
 +
<ol>
 +
<li>In the QGIS Layers Panel, select (left click) '''2d_bc_M01_001_L'''.
 +
<li>Click on the 'Increment Selected Layer' symbol from the TUFLOW Plugin toolbar. This opens the dialog shown below.
 +
<br>
 +
[[File:tuflow_plugin_increment_layer.png]]<br>
 +
<br>
 +
:*Source Layer: Automatically set to the selected layer, '''2d_bc_M01_001_L'''.
 +
:*Output Database: Click 'Browse...'. This will automatically open to the '''TUFLOW\model\gis''' folder. Set the new output database name to '''TS01_001.gpkg''' and click 'Save'.
 +
:*Output Layer Name: This will automatically increment to '''2d_bc_M01_00''2''_L'''. Change the name back to '''2d_bc_M01_00''1''_L'''.
 +
:*Delete the pre-filled 'Incremented Layer' entry in the table. We do not wish to modify the version number associated with the 2d_bc file. This current exercise will not change the version number of any of the GIS layer inputs, it is simply establishing a copy of the existing GeoPackage where future edits will be saved to.
 +
:*Select 'Remove Source Layer from Workspace'.
 +
:*Select 'Increment Layer and Preserve Database'.
 +
<li>Click 'OK'.
 +
<li>The GeoPackage database, '''TS01_001.gpkg''' will now be in the '''TUFLOW_SWMM_Module_01\TUFLOW\model\gis''' folder. <br>
 +
<br>
 +
{{Video|name=Animation_TS1_Initialization_05c.mp4|width=1235}}
 +
<br>
 +
</ol>
 +
 
 +
===Save QGIS Project Workspace===
 +
<ol>
 +
<li>Go to Project > Save As.
 +
<li>Navigate to the '''TUFLOW_SWMM_Module_01''' folder and type '''SWMM_M01''' as the filename with the extension .qgz.
 
</ol>
 
</ol>
 +
<br>
  
−
= SWMM Inputs and 1D/2D Linking=
+
= GIS Inputs =
 
==Create SWMM GeoPackage Spatial Database==  
 
==Create SWMM GeoPackage Spatial Database==  
 
Create a new folder in the '''TUFLOW_SWMM_Module_01\TUFLOW\model''' folder called '''swmm'''. This is the location where all SWMM inputs will be saved.<br>
 
Create a new folder in the '''TUFLOW_SWMM_Module_01\TUFLOW\model''' folder called '''swmm'''. This is the location where all SWMM inputs will be saved.<br>
Line 65: Line 123:
 
In QGIS, create the SWMM GeoPackage Database:
 
In QGIS, create the SWMM GeoPackage Database:
 
<ol>  
 
<ol>  
−
<li>Go to Processing > Toolbox from the top drop menu options to open the Processing Toolbox panel.
+
<li>Go to Processing > Toolbox from the top dropdown menu options to open the Processing Toolbox.
−
<li>Go to '''TUFLOW > SWMM''' in the processing tool list and select 'GeoPackage-Create'. This opens the dialog shown below.
+
<li>Go to TUFLOW >> SWMM in the processing tool list and select '<u>[[QGIS_SWMM_GeoPackage_Create |GeoPackage - Create]]</u>'. This opens the dialog shown below.
 
:*To set the ‘CRS for GeoPackage’: Click the drop down menu and select ‘Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S’.
 
:*To set the ‘CRS for GeoPackage’: Click the drop down menu and select ‘Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S’.
−
:*To set the ‘Initial SWMM Sections’: Click the …, and tick on: '''Title''', '''Options''', '''Nodes--Junctions''', '''Nodes--Outfalls''', '''Links--Conduits''', '''Streets''', '''Inlets''' and '''Report'''.
+
:*To set the ‘Initial SWMM Sections’: Click …, and tick on (if not already ticked):
−
:*To define the ‘GPKG filename to create’: Click the …, select ‘Save to File’. Navigate to the '''TUFLOW\model\swmm''' folder and save the GeoPackage Database as '''TS01_001.gpkg'''.
+
::*'''Project--Title''', '''Project--Options''', '''Project --Report.'''
 +
::*'''Nodes--Junctions''', '''Nodes--Outfalls.''', '''Nodes--Storage.'''  
 +
::*'''Links--Conduits, Links--Streets'''.  
 +
:*To define the ‘GPKG filename to create’: Click …, select ‘Save to File’. Navigate to the '''TUFLOW\model\swmm''' folder and save the GeoPackage database as '''sw01_001.gpkg'''.
 +
 
 +
 
 
<li>Click ‘Run’.  
 
<li>Click ‘Run’.  
−
<li>Once to tool has finished, click ‘Close’.
+
<li>Once the tool has finished, click ‘Close’.
−
<li>In File Explorer, navigate to the '''TUFLOW\model\swmm''' folder and drag and drop '''TS01_001.gpkg''' into QGIS.  
+
<li>In Windows File Explorer, navigate to the '''TUFLOW\model\swmm''' folder and drag and drop '''sw01_001.gpkg''' into QGIS.  
−
<li>When prompted by QGIS, select '''Links--Conduits''', '''Nodes--Junctions''', '''Nodes--Outfalls''' and '''Options''' (hold Ctrl to select multiple layers). Click ‘Add Layers’.  
+
<li>When prompted by QGIS, under 'Options', tick on 'Add layers to group', then select 'Add Layers' to open all vectors within '''sw01_001.gpkg'''. By default, all items in the available list should have been selected.
 +
<li>In the QGIS Layers Panel, move '''sw01_001.gpkg''' to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project.  
 
</ol>
 
</ol>
 
<br>
 
<br>
−
{{Video|name=Animation_create_TS01_002.mp4|width=1235}}
+
{{Video|name=Animation_TS1_SWMM_Inputs_01g.mp4|width=1236}}
 
<br>
 
<br>
 
<br>
 
<br>
Line 82: Line 146:
 
== GIS Data Entry ==
 
== GIS Data Entry ==
  
−
A GeoPackage called '''SWMM_Culverts.gpkg''' is provided in the '''TUFLOW_SWMM_Module_01\Tutorial_Data''' folder. It contains three layers:  
+
A GeoPackage database called '''SWMM_Culverts.gpkg''' is provided in the '''TUFLOW_SWMM_Module_01\Tutorial_Data''' folder. It contains three layers:  
 
:*'''Conduits:''' defines the culvert location, type and geometry.
 
:*'''Conduits:''' defines the culvert location, type and geometry.
−
:*'''Junctions:''' defines the upstream culverts inverts.
 
 
:*'''Outfalls:''' defines the downstream culvert inverts.
 
:*'''Outfalls:''' defines the downstream culvert inverts.
 +
:*'''Storage_nodes:''' defines the upstream culvert inverts.
 
<br>
 
<br>
−
To populate the GeoPackage created in the previous section:
+
To populate the GeoPackage database created in the previous section:
 
<ol>
 
<ol>
−
<li>In Windows Explorer, navigate to the '''TUFLOW_SWMM_Module_01\Tutorial_Data''' folder. Drag and drop the '''SWMM_Culverts.gpkg''' into QGIS and select the following layers (hold Ctrl to select multiple):
+
<li>In Windows File Explorer, navigate to the '''TUFLOW_SWMM_Module_01\Tutorial_Data''' folder. Drag and drop the '''SWMM_Culverts.gpkg''' into QGIS.
−
*'''Conduits'''
+
<li>When prompted by QGIS, under 'Options', tick on 'Add layers to group'. By default, all items in the GeoPackage database will be selected. Click 'Add Layers'.
−
*'''Junctions'''
+
<li>In the QGIS Layers Panel, right click on the '''SWMM_Culverts >> Conduits''' layer and select 'Zoom to Layer(s)'.
−
*'''Outfalls'''
 
−
<li>In the QGIS Layers Panel, right click on the '''Conduits''' layer and select 'Zoom to Layer'.
 
 
<li>Use the 'Select Features' tool to highlight all items included in '''Conduits'''.
 
<li>Use the 'Select Features' tool to highlight all items included in '''Conduits'''.
−
<li>Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down manu.  
+
<li>Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.  
−
<li>Select the '''Links--Conduits''' layer in the Layers Panel by left clicking on it once.  
+
<li>In the QGIS Layers Panel, select (left click) the '''sw01_001.gpkg >> Links--Conduits''' layer.  
 
<li>Make the '''Links--Conduits''' layer editable by clicking the 'Toggle Editing' symbol [[File:toggle_editing_icon.png|27x27px]].
 
<li>Make the '''Links--Conduits''' layer editable by clicking the 'Toggle Editing' symbol [[File:toggle_editing_icon.png|27x27px]].
 
<li>Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
 
<li>Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
 
<li>Toggle the editing off to save the edits.<br>
 
<li>Toggle the editing off to save the edits.<br>
 
<br>
 
<br>
−
{{Video|name=Animation_copy_conduit_001.mp4|width=1235}}
+
{{Video|name=Animation_TS1_SWMM_Inputs_02f.mp4|width=1236}}
 
<br>
 
<br>
−
<li>Copy the objects from '''Junctions''' into '''Nodes--Junctions'''. Junctions are considered inlets, and should be defined at the upstream end of culverts.
+
<li>Similarly, copy the objects from '''Storage_nodes''' into '''Nodes--Storage'''. Junctions and storage nodes are allowed at the upstream end of culverts. Storage nodes are preferred for culverts receiving 2D flows not through a storm drain inlet.
−
<li>Copy the objects from '''Outfalls''' into '''Nodes--Outfalls'''. Outfalls are treated as outlets, and are required at the downstream end of culverts.
+
<li>Also copy the objects from '''Outfalls''' into '''Nodes--Outfalls'''. Outfalls are treated as outlets, and are required at the downstream end of culverts.
−
<li>Close '''SWMM_Culverts.gpkg'''  
+
<li> Toggle off editing and save the edits.
 +
<li>Remove '''SWMM_Culverts.gpkg'''.
 
<br><br>
 
<br><br>
−
{{Video|name=Animation_copy_junctions_outfalls_001.mp4|width=1235}}
+
{{Video|name=Animation_TS1_SWMM_Inputs_03f.mp4|width=1236}}
 
<br>
 
<br>
 
<li>Inspect the attribute information within the respective layers to familiarize yourself with the data.
 
<li>Inspect the attribute information within the respective layers to familiarize yourself with the data.
 
<br><br>
 
<br><br>
−
{{Video|name=Animation_attribute_info_001.mp4|width=1235}}
+
{{Video|name=Animation_TS1_SWMM_Inputs_04f.mp4|width=1236}}
 
</ol>
 
</ol>
 
<br>
 
<br>
  
 
== GIS Data Updates ==
 
== GIS Data Updates ==
−
The provided GIS data requires numerous updates, prior to our model simulation. We have built these updates into this tutorial to demonstrate some of the available TUFLOW SWMM model built processing tools.  
+
The provided GIS data requires numerous updates before proceeding to a model simulation. We have intentionally built these updates into this tutorial to demonstrate some of the available TUFLOW SWMM model build processing tools. The following updates are being made to objects and layers within '''sw01_001.gpkg'''.
−
 
 
−
The following updates are being made to Objects and Layers within '''TS01_001.gpkg'''  
 
 
===Update Conduit Details===
 
===Update Conduit Details===
−
Step 1 involves updating the ''From Node'' and ''To Node'' attribute information in '''Links-Conduits'''. This information is necessary to "build" the 1D SWMM network. It defines the Link/Node connections. The information we will be adding to '''Links-Conduits''' is extracted from '''Nodes--Junction''' and '''Nodes--Outfall''' automatically using the '''Conduits - Assign Node Fields''' tool from the Processing Toolbox.
+
==== Node Details ====
−
 
+
Stage 1 of building the 1D SWMM network involves updating the 'From Node' and 'To Node' attribute information in '''Links--Conduits'''. This information defines the Link/Node connections. <br>
−
# Select (Left mouse click) '''Links--Conduits''' in the QGIS Layers panel and Toggle Editing on.
+
The information we will be adding to '''Links--Conduits''' is extracted from '''Nodes--Storage''' and '''Nodes--Outfalls''' automatically using the '<u>[[QGIS_SWMM_Conduits_Assign_Node_Fields |Conduits - Assign node fields]]</u>' tool from the Processing Toolbox.
−
# From the Processing Toolbox, select '''Editing in place'''. This allows the editing of an existing Layer, instead of the creation of a new Layer.
+
<ol>
−
# Select the '''Conduits - Assign Node Fields''' processing tool.
+
<li>In the QGIS Layers Panel, select (left click) '''Links--Conduits''' and toggle on editing.
−
# Select '''Nodes--Junction''' and '''Nodes--Outfall''' in the SWMM Node Layers field.
+
<li>In the Processing Toolbox, select the 'Edit Features In-Place' tool [[File:edit_features_in_place_icon.png]]. This allows the editing of an existing layer, instead of the creation of a new layer.
−
# Select '''Modify All Features'''.
+
<li>Go to TUFLOW >> SWMM in the processing tool list and select '<u>[[QGIS_SWMM_Conduits_Assign_Node_Fields |Conduits - Assign node fields]]</u>'. This opens the dialog shown below. 
−
# Close the '''Conduits - Assign Node Fields''' processing tool.
+
:*SWMM Node Layers: Tick on '''sw01_001 >> Nodes--Storage''' and '''sw01_001 >> Nodes--Outfalls'''. Click 'OK'.  
−
# View the attributes associated within Links-Conduits to verify the data processing has been completed correctly. The ''From Node'' and ''To Node'' attribute information is now configured correctly.
+
<li>Select 'Modify All Features'.
−
Tip: If you wish to only update select objects during a future modelling project, instead of the entire Link--Conduits dataset, select the target objects first using the Feature by Area tool. The ''Conduits - Assign Node Fields'' tool will provide an option to ''Modify Selected Features'', instead of ''Modify All Features.''
+
<li>Once the tool has finished, click 'Close'.
 +
<li>Turn off editing to save the edits.
 +
<li>View the attributes associated within '''Links--Conduits''' to verify the data processing has been completed correctly. The 'From Node' and 'To Node' attribute information is now configured correctly. For a broader understanding of the other attributes associated with the '''Links--Conduits''' layer, refer to <u>[https://docs.tuflow.com/classic-hpc/release/2023-03-AD/SWMM-Input-Detailed-1.html#tab:tab-SWMM-Input-Conduits TUFLOW 2023-03-AD Release Notes (Table A.19)]</u> and the <u>[https://downloads.tuflow.com/SWMM/SWMM5_Reference_Manual_Volume2_Hydaulics_P100S9AS.pdf SWMM Reference Manual - Volume 2 (Hydraulics)]</u>. <br>
 +
<br>
 +
'''Tip 1:''' If you wish to only update a selection of objects, instead of selecting the entire '''Links--Conduits''' dataset, select the target objects first using the 'Select Features' tool. The '<u>[[QGIS_SWMM_Conduits_Assign_Node_Fields |Conduits - Assign node fields]]</u>' tool will provide an option to 'Modify Selected Features', instead of 'Modify All Features.'<br>
 +
'''Tip 2:''' Unique Node ID's are required for the SWMM network to function error free. If you are following this workflow for a project model build, please ensure the '''Nodes--Storage''' and '''Nodes--Outfalls''' object ID information is unique. If duplicate ID values are assigned to multiple objects, consider using the '<u>[[QGIS_SWMM_Integrity_Make_Object_Names_Unique |Integrity - Make object names unique ]]</u>' TUFLOW SWMM processing tool to ensure all ID values are unique before using '<u>[[QGIS_SWMM_Conduits_Assign_Node_Fields |Conduits - Assign node fields]]</u>'.
 
<br><br>
 
<br><br>
−
{{Video|name=Animation_update_conduit_001.mp4|width=1235}}
+
{{Video|name=Animation_TS1_SWMM_Inputs_05g.mp4|width=1236}}
 
<br>
 
<br>
  
−
===Update Losses===
 
  
−
Step 2, update the loss attributes in the '''Links-Conduits''' Layer. These values will be entered manually in this example using default values. Variation to the default values can be used in project models to reflect site specific information if desired.
+
</ol>
  
−
# Select (Left mouse click) '''Links--Conduits''' in the QGIS Layers panel and Toggle Editing on.
+
====Update Losses====
−
# Right mouse click '''Links--Conduits''' in the QGIS Layers panel and select Open Attribute Table.
+
Stage 2 involves updating the loss attributes in the '''Links--Conduits''' layer. In this example, default loss values are used and will be entered manually. These loss values can be adjusted in your project models to reflect site specific information if desired.
−
# Set:
+
<ol>
−
#* losses_Kentry = 0.5
+
<li>In the QGIS Layers Panel, select (left click) '''Links--Conduits''' and toggle on editing.
−
#* losses_kexit = 1.0
+
<li>Right click '''Links--Conduits''' and select 'Open Attribute Table'.
−
#* losses_Kavg = 0.0
+
<li>For each conduit, update the following fields:
−
# Save '''Links--Conduits'''
+
:*losses_Kentry: 0.5
 +
:*losses_Kexit: 1.0
 +
:*losses_Kavg: 0.0
 +
The video below demonstrates how to do this one entry at a time, or via the bulk attribute update options in QGIS.
 +
<li>Turn off editing to save the edits.
 +
<br><br>
 +
{{Video|name=Animation_TS1_SWMM_Inputs_06f.mp4|width=1236}}
 +
</ol>
 +
<br>
  
 +
Since all the 1D SWMM inputs in this model are embankment culverts that all use the same loss parameters, it's not necessary to specify different loss attributes. The <u>[[TUFLOW_SWMM_Tutorial_M02 | TUFLOW SWMM Module 2]]</u> will demonstrate an urban pipe network added to the model, with different loss attributes required for the road culverts and underground storm pipe network links. To simplify this step, Module 2 uses the '<u>[[QGIS_SWMM_Conduits_Assign_Node_Fields |Conduits - Assign node fields]]</u>' processing tool.
 
<br>
 
<br>
−
{{Video|name=Animation_update_losses_001.mp4|width=1235}}
 
 
<br>
 
<br>
−
 
−
An urban pipe network is added to the model in TUFLOW SWMM Module 2. In that situation, different loss attributes are required for the road culverts and underground stormwater pipe network links. To simplify the loss attibute update step in that situation, we will be introducing the '''Conduits - Assign Node Fields''' processing tool. It is however, not necessary for this Module 1 tutorial because all the 1D SWMM inputs are embankment culverts.
 
  
 
=== Create 1D/2D Connections===
 
=== Create 1D/2D Connections===
−
The following instructions introduce a new tool that automates the creation of 1D/2D connections. For 1D SWMM, HX lines are required from the upstream end of the culvert, and SX connections are used at the downstream end of the culvert.
+
The following instructions introduce a new tool that automates the creation of 1D/2D connections. Due to the limitations of SWMM boundary conditions, HX lines are required for the upstream end of the culvert (rather than SX), and SX connections are used at the downstream end of the culvert.<br>
 
<ol>
 
<ol>
−
<li>Select (Left mouse click) '''Links-Conduits''' in the QGIS Layers panel.
+
<li>In the QGIS Layers Panel, select (left click) '''Links--Conduits'''.
−
<li>Use the select the Feature by Area tool to select all culvert objects in '''Links-Conduits'''.
+
<li>In the Processing Toolbox, go to TUFLOW >> SWMM and select '<u>[[QGIS_SWMM_BC_Create_Channel_Endpoint_1D/2D_Connections |BC - Create channel endpoint 1D/2D connections]]</u>'. This opens the dialog shown below.  <br>
−
 
+
'''Note:''' Ensure the 'Edit Features In-Place' tool has been turned off.
−
<li>In the search box of the '''Processing Toolbox''' panel, type '''SWMM'''.
+
:*Input Conduits Layer: '''Links--Conduits'''
−
 
+
:*Create connections at: 'Both ends'.
−
<li>From the SWMM list, choose the '''BC - Create channel endpoint 1D/2D connections'''.  
+
:*Offset Distance: 2
−
 
+
:*Length of BC lines: 10
−
<li>Select the following options:
+
:*Tick on 'Set 2D cell elevation to 1D culvert invert at 1D/2D connection cells if needed'.
−
*'''Input Conduits Layer''' = Links Conduits
+
:*Output Layer:
−
*'''Offset distance''' = 2
+
<ol>
−
*'''Length of BC lines''' = 10
+
::<li>Click the ... and select 'Save to GeoPackage'.
−
*'''Output Layer'''= Select: '''Save to GeoPackage'''. Choose '''TS01_001.gpkg''' in the '''model\swmm''' folder and click Save. A Layer Name Window will open. Provide the following name: '''2d_bc_SWMM_Connections_001_L'''.<br></ol>
+
::<li>Navigate to the '''TUFLOW\model\gis''' folder and select '''TS01_001.gpkg'''. Click Save.
 +
::<li>A dialog will open. In the Layer name field, write '''2d_bc_SWMM_Culvert_Connections_001_L'''.
 +
::<li>Click 'OK'.
 +
</ol>
 +
<li>Click 'Run'.
 +
<li>Once the tool is finished, click 'Close'.
 +
<li>The '''2d_bc_SWMM_Culvert_Connections_001_L''' appears in the QGIS Layers Panel. Select 'Apply TUFLOW Styles to Current Layer'.
 +
<br><br>
 +
{{Video|name=Animation_TS1_SWMM_Inputs_07f.mp4|width=1236}}
 +
</ol>
 +
<br>
 +
'''Note:''' The positions of the HX and SX connections may not be in the optimum location or extent using the generalized automated tool. As such, it is recommended to check the output from this processing step. In this module, the 1D/2D connections associated with '''2d_bc_SWMM_Culvert_Connections_001_L''' are checked in <u>[[TUFLOW SWMM Tutorial M01 Check QGIS|TUFLOW SWMM Tutorial 01 Check Files]]</u>.
 
<br>
 
<br>
−
{{Video|name=Animation_1D2D_connections_001.mp4|width=1235}}
 
 
<br>
 
<br>
  
−
===Update Junction Details===
+
===Update Storage Node Details===
−
 
+
The attributes of the storage nodes need to be modified to represent the storage of the connected HX cells since these cells do not represent storage themselves. The area associated with the storage nodes should be similar to the areas of the HX cells. To set the area, we will use a "PYRAMIDAL" shape with the SWMM side slope (run/rise) (Z) set to 0 to represent vertical walls. As the cell size is 5m, and the length of each polyline is 10m, the length (L) will be set to 10m and the width (W) to 5m. These sizes will be modified later when we change the boundary conditions.
−
# Select (Left mouse click) '''Node--Junctions''' in the QGIS Layers panel and Toggle Editing on.
 
−
# From the Processing Toolbox, select '''Editing in place'''. This allows the editing of an existing Layer, instead of the creation of a new Layer.
 
−
# Select the '''Junctions - Set attributes''' processing tool. Select the following:
 
−
#* '''Input bc connections layer''' = 2d_bc_SWMM_Connections_001_L
 
−
#* '''Nodes connected to 2D without Inlets (Ysur )''' = 0
 
−
#* '''Nodes connected to 2D without Inlets (Apond )''' = 50
 
−
# Select '''Modify All Features.'''
 
−
# Close the '''Junctions - Set attributes'''  processing tool.
 
−
# View the attributes associated within '''Node--Junctions''' to verify the data processing has been completed correctly.
 
  
 +
<ol>
 +
<li> In the QGIS Layers Panel, select (left click) '''Nodes--Storage''' and toggle on editing.
 +
<li> Right click '''Nodes--Storage''' and select 'Open Attribute Table'.
 +
<li> Set the following attributes:
 +
:* YMax: 50.0 (this is a value greater than the expected water level. It is required to allow water to fill node)
 +
:* TYPE: 'PYRAMIDAL'
 +
:* L: 10
 +
:* W: 5
 +
:* Z: 0.0
 +
<li> Turn off editing to save the edits.
 +
 
 +
<br><br>
 +
{{Video|name=Animation_TS1_SWMM_Inputs_08g.mp4|width=1236}}
 
<br>
 
<br>
−
{{Video|name=Animation_update_junctions_001.mp4|width=1235}}
+
</ol>
−
<br><br>
 
  
 
==SWMM Options==
 
==SWMM Options==
 
<ol>
 
<ol>
−
<li> Select the '''Options''' Layer in '''TS01_001.gpkg''' file.
+
<li>In the QGIS Layers Panel, select (left click) '''Project--Options''' and toggle on editing.
−
<li> Select Toggle Editing to enable changes to be made to the Layer.
+
<li>Right click '''Project--Options''' and select 'Open Attribute Table'.
 +
<li>Update the following options:
 +
*'''START_DATE''': 2020-01-01 (Date Format: YYYY-MM-DD)
 +
*'''REPORT_STEP''': 00:01:00
 +
<li>Turn off editing to save the edits.
 +
</ol>
  
−
<li>Right click the '''Options''' layer in the Layers Panel and select '''Open Attribute Table'''.</li><li> Update the following option:
+
{{Video|name=Animation_TS1_SWMM_Inputs_09f.mp4|width=1236}}
−
*'''Start Date''': 01/01/2020 (USA Date Format: MM/DD/YYY)
+
<br>Save the QGIS Project Workspace:
−
*'''Report step''': 00:05:00
+
 
−
<li>Save and Toggle Editing off.
+
# Go to Project > Save. This will update '''SWMM_M01.qgz''', which was created previously in the folder '''TUFLOW_SWMM_Module_01'''.<br>
−
</ol>
+
 
 +
== Export SWMM INP File ==
 +
SWMM is not able to read the '''sw01_001.gpkg''' database directly, therefore, we need to convert the GeoPackage file to a SWMM INP file format.
  
−
{{Video|name=Animation_update_options_001.mp4|width=1235}}
+
<ol>
 +
<li>In the QGIS Layers Panel, right click '''Links--Conduits''' (or any of the SWMM layers) and select 'TUFLOW' > 'SWMM - Export inp file'.
 +
<li>This will open the '<u>[[QGIS_SWMM_GeoPackage_Write_to_SWMM_inp |GeoPackage - Write to SWMM inp]]</u>' processing tool, prepopulated with the filename of the layer's GeoPackage. <br>
 +
'''Note:''' This tool can also be activated from the Processing Toolbox.
 +
<li>Click 'Run'.
 +
<li>Once the tool is finished, click 'Close'.
 +
<li>This tool will save the SWMM inp file in the same folder location and with the same name as the GeoPackage input file. In this case, it will save '''sw01_001.inp''' to the '''TUFLOW\model\swmm''' folder.
 
<br><br>
 
<br><br>
 +
{{Video|name=Animation_TS1_SWMM_Inputs_10e.mp4|width=1236}}
 +
</ol><br>
  
−
== Export SWMM INP File ==
+
= Simulation Control Files =
−
SWMM does not read '''TS01_001.gpkg''' directly as an input GIS file. SWMM requires a INP file.
+
The following steps will require use of a text editor. The tutorial demonstration uses Notepad++. For its configuration information refer to <u>[[NotepadPlusPlus_Tips | Notepad++ Tips]]</u>. <br>
 +
 
 +
To differentiate the TUFLOW SWMM tutorials from the TUFLOW/ESTRY tutorials, 'TS' is used as the file prefix in this series of tutorials. To avoid the potential risk of overwriting existing control files accidentally, we will start by saving new control files where we will be making subsequent syntax updates during the following steps. <br>
  
 +
Set up the simulation control files:
 
<ol>
 
<ol>
−
<li>Right click '''Links--Conduits''' in the QGIS Layers panel, and select '''''TUFLOW >> SWMM - Export inp file'''''.
+
<li>In Windows File Explorer, navigate to the '''TUFLOW_SWMM_Module_01\TUFLOW\runs''' folder and open '''M02_5m_001.tcf''' in a Text Editor (Notepad++ is recommended).
−
<li>Select '''TS01_001.gpkg''' as the GeoPackage Input File.
+
<li>Save the file as '''TS01_5m_001.tcf''' in the '''TUFLOW_SWMM_Module_01\TUFLOW\runs''' folder.
−
<li>Set the SWMM output filename to '''TS01_001.inp''' in the '''''TUFLOW/model/swmm''''' folder.
+
<li>Open '''M01_001.tbc''' using the 'Open File' function in Notepad++. Save the file as '''TS01_001.tbc''' in the '''TUFLOW_SWMM_Module_01\TUFLOW\model''' folder.
−
<li>Select "Run", then "Close" after the processing is complete.
+
<li>Create a new blank text file called '''TS01_001.tscf''' and save it in the '''TUFLOW_SWMM_Module_01\TUFLOW\model''' folder.
 +
<br><br>
 +
{{Video|name=Animation_TS1_Sim_Control_00a.mp4|width=1235}}<br>
 
</ol>
 
</ol>
−
<br>
 
−
{{Video|name=Animation_create_inp_001.mp4|width=1235}}
 
  
−
= Simulation Control Files =
+
=== TUFLOW Control File (TCF) ===
−
To differentiate the TUFLOW SWMM tutorials from the TUFLOW/ESTRY tutorials, TS will be used as the new file prefix in this series of tutorials.
 
 
<ol>
 
<ol>
−
<li>
+
<li>Open '''TS01_5m_001.tcf''' in a Text Editor (Notepad++ is recommended) and make the following reference updates:  <br>
−
Save a copy of the '''M02_5m_001.tcf''' as '''TS01_5m_001.tcf''' in the '''''TUFLOW_SWMM_Module_01\TUFLOW\runs''''' folder.
+
<font color="blue"><tt>Spatial Database </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt> ..\model\gis\TS01_001.gpkg </tt></font> <font color="green"><tt> ! Specify the location of the GeoPackage Spatial Database</tt></font><br>
 +
<font color="blue"><tt>BC Control File </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>..\model\TS01_001.tbc</tt></font> <font color="green"><tt>  ! Reference the TUFLOW Boundary Conditions Control File</tt></font>
 +
<li>Add the following line in the '<font color="green"><tt>Model Inputs</tt></font>' section:  <br>
 +
<font color="blue"><tt>SWMM Control File </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt> ..\model\TS01_001.tscf </tt></font> <font color="green"><tt>  ! Reference the SWMM (1D) Control File</tt></font>
 +
<li>Add the following line in the '<font color="green"><tt>Output Settings</tt></font>' section: <br>
 +
<font color="blue"><tt>NetCDF Output Start Date </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>2020-01-01 00:00 </tt></font> <font color="green"><tt>! Sets the output units for the NetCDF time variable</tt></font>
 +
<li>Save the TCF.
 +
<br><br>
 +
{{Video|name=Animation_TS1_Sim_Control_01c.mp4|width=1235}}<br>
 
</ol>
 
</ol>
  
 
=== TUFLOW Boundary Control File (TBC) ===
 
=== TUFLOW Boundary Control File (TBC) ===
 
<ol>
 
<ol>
−
<li>Save '''M01_001.tbc''' as '''TS01_001.tbc''' in the '''''TUFLOW_SWMM_Module_01\TUFLOW\model''''' folder.
+
<li>From '''TS01_001.tcf''', right click '''TS01_001.tbc''' and select 'Open File'. This opens '''TS01_001.tbc''' into a new tab in Notepad ++.
−
<li>Open '''TS01_001.tbc''' in a text editor and add the additional lines: <br>
+
<li>Add the following command line after '<font color="blue"><tt>Read GIS SA </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>2d_sa_M01_001_R</tt></font>':  <br>
−
<font color="blue"><tt>Spatial Database</tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>swmm\TS01_001.gpkg</tt></font><br>
+
<font color="blue"><tt>Read GIS BC </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>2d_bc_SWMM_Culvert_Connections_001_L</tt></font> <font color="green"><tt>     ! Links 1D SWMM culverts to the 2D TUFLOW domain</tt></font>  
−
<font color="blue"><tt>Read GIS BC </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>2d_bc_SWMM_Connections_001_L</tt></font> <font color="green"><tt> ! Links the 1D culverts to the 2D domain</tt></font> <br>
 
 
<li>Save the TBC.
 
<li>Save the TBC.
 +
<br><br>
 +
{{Video|name=Animation_TS1_Sim_Control_02c.mp4|width=1235}}<br>
 
</ol>
 
</ol>
−
<font color="red">'''<< Add video >>'''</font>
 
  
 
=== TUFLOW SWMM Control File (TSCF) ===
 
=== TUFLOW SWMM Control File (TSCF) ===
−
A new control file, the TUFLOW SWMM Control File (TSCF), is introduced. SWMM is a 1D hydraulic solver. All 1D SWMM files and commands are referenced in the TUFLOW SWMM Control File.<br>
+
A new control file, the TUFLOW SWMM Control File (TSCF), is used to control the SWMM input data. All 1D SWMM files and commands are referenced in the TUFLOW SWMM Control File.<br>
 
<ol>
 
<ol>
−
<li>Create a new text file called '''TS01_001.tscf''', saved in the '''''TUFLOW_SWMM_Module_01\TUFLOW\model''''' folder.
+
<li>From '''TS01_001.tcf''', right click '''TS01_001.tscf''' and select 'Open File'. This opens '''TS01_001.tscf''' into a new tab in Notepad ++.
−
<li>Add the following command lines: <br>
+
<li>Add the following command: <br>
−
<font color="blue"><tt>Read SWMM </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>swmm\TS01_001.inp</tt></font> <font color="green"><tt>  ! 1D SWMM input file</tt></font> <br>
+
<font color="blue"><tt>Read SWMM </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>swmm\sw01_001.inp</tt></font> <font color="green"><tt>  ! 1D SWMM culvert input file</tt></font> <br>
−
<li>Save the TSCF. <br>
+
<li>Save the TSCF.
 +
<br><br>
 +
{{Video|name=Animation_TS1_Sim_Control_03c.mp4|width=1235}}<br>
 
</ol>
 
</ol>
−
<font color="red">'''<< Add video >>'''</font>
+
<br>
−
 
 
−
=== TUFLOW Control File (TCF) ===
 
−
<ol>
 
−
<li>Open the '''TS01_5m_001.tcf''' in a text editor:<br>
 
−
Add the following line in the 'Model Inputs' section:  <br>
 
−
<font color="blue"><tt>SWMM Control File </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt> ..\model\TS01_001.tscf </tt></font> <font color="green"><tt>  ! Reference the SWMM (1D) Control File</tt></font> <br>
 
−
Add the following line in the 'Output Settings' section: <br>
 
−
<font color="blue"><tt>NetCDF Output Start Date </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>2020-01-01 00:00 </tt></font> <font color="green"><tt>! Sets the output units for the NetCDF time variable</tt></font> <br>
 
−
<li>Make the following reference update:  <br>
 
−
<font color="blue"><tt>BC Control File </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>..\model\TS01_001.tbc</tt></font> <font color="green"><tt>  ! Reference the TUFLOW Boundary Conditions Control File</tt></font> <br>
 
−
<li>Save the TCF.
 
−
</ol>
 
−
<font color="red">'''<< Add video >>'''</font>
 
  
 
= Running the Simulation =
 
= Running the Simulation =
 
<ol>
 
<ol>
−
<li>Save a copy of '''_run_M02_HPC.bat''' as '''_run_TS01_HPC.bat''' in the '''''TUFLOW_SWMM_Module_01\TUFLOW\runs''''' folder.
+
<li>Save a copy of '''_run_M02_HPC.bat''' as '''_run_TS01_HPC.bat''' in the '''TUFLOW_SWMM_Module_01\TUFLOW\runs''' folder.
 
<li>Update the batch file to reference the '''TS01_5m_001.tcf''' :<br>
 
<li>Update the batch file to reference the '''TS01_5m_001.tcf''' :<br>
−
<font color="blue"><tt>'''set'''</tt></font> <font color="black"><tt>exe</tt></font><font color="red"><tt>=</tt></font><font color="black"><tt>"..\..\..\exe\2023-03-AD\TUFLOW_iSP_w64.exe"</tt></font><br>
+
<font color="blue"><tt>'''set'''</tt></font> <font color="black"><tt>exe</tt></font><font color="red"><tt>=</tt></font><font color="black"><tt>"..\..\..\exe\2023-03-AF\TUFLOW_iSP_w64.exe"</tt></font><br>
 
<font color="blue"><tt>'''set'''</tt></font> <font color="black"><tt>run</tt></font><font color="red"><tt>=</tt></font><font color="black"><tt>start "TUFLOW" /wait</tt></font> <font color="orange"><tt> %exe%</tt></font> <font color="black"><tt> -b</tt></font> <br>
 
<font color="blue"><tt>'''set'''</tt></font> <font color="black"><tt>run</tt></font><font color="red"><tt>=</tt></font><font color="black"><tt>start "TUFLOW" /wait</tt></font> <font color="orange"><tt> %exe%</tt></font> <font color="black"><tt> -b</tt></font> <br>
 
<font color="orange"><tt>%run% </tt></font> <font color="black"><tt>TS01_5m_001.tcf </tt></font>  
 
<font color="orange"><tt>%run% </tt></font> <font color="black"><tt>TS01_5m_001.tcf </tt></font>  
  
−
<li>Double click the batch file in Windows file explorer to run the simulation.  
+
<li>Save the batch file and double click it in Windows File Explorer to run the simulation.  
 +
<br>
 +
If the model simulation doesn't run:
 +
<ol>
 +
<li> Check in the screen output or the tlf file near the end for "For SWMM Model Errors see:". This indicates that there is something wrong with the SWMM inputs. Reviewing that file will provide feedback on what is wrong.
 +
<li> Review this link for common <u>[[TUFLOW_SWMM_Troubleshooting | TUFLOW SWMM Troubleshooting]]</u> advice.
 +
</ol>
 +
<br><br>
 +
{{Video|name=Animation_TS1_Run_Sim_01d.mp4|width=1236}}<br>
 
</ol>
 
</ol>
−
<font color="red">'''<< Add video >>'''</font>
 
−
<br>
 
−
If your model simulation did not run. Here is a link to some comon <u>[[Tutorial_Troubleshooting_QGIS | Tutorial Trouble Shooting]]</u> advice.
 
  
 
= Check Files and Results Output=
 
= Check Files and Results Output=
−
Complete the steps outlines in the following link to review check files and simulation results from the TUFLOW SWMM model simulation:
+
Complete the steps outlined in following links to review check files and simulation results from the TUFLOW SWMM model simulation:
  
−
[[TUFLOW_SWMM_Tutorial_M01_Check_QGIS | TUFLOW SWMM Tutorial 01 Check Files]] <br>
+
<u>[[TUFLOW_SWMM_Tutorial_M01_Check_QGIS | TUFLOW SWMM Tutorial 01 Check Files]]</u> <br>
−
[[TUFLOW_SWMM_Tutorial_M01_Results_QGIS | TUFLOW SWMM Tutorial 01 Results]] <br>
+
<u>[[TUFLOW_SWMM_Tutorial_M01_Results_QGIS | TUFLOW SWMM Tutorial 01 Results]]</u><br>
  
 
= Conclusion =
 
= Conclusion =
−
:*EPA SWMM Culverts were added to convey water through the structures under the three roads in the tutorial model.
+
*EPA SWMM culverts were added to convey water through the structures under the three roads in the tutorial model.
−
:*Check files were used to review the application of the boundary links.
+
*Check files were used to review the inclusion of 1D SWMM culverts to a 2D TUFLOW model.
−
:*Results through the 1D network structures were assessed.
+
*Results through the 1D culverts were assessed.
 
<br>
 
<br>
 +
 +
=Other TUFLOW SWMM Tutorials=
 +
*<u>[[TUFLOW_SWMM_Tutorial_M01 | TUFLOW SWMM Module 1]]</u>  - 1D SWMM Culverts
 +
*<u>[[TUFLOW_SWMM_Tutorial_M02 | TUFLOW SWMM Module 2]]</u>  - 1D SWMM Pipe Network / 2D TUFLOW Direct Rainfall Hydrology
 +
*<u>[[TUFLOW_SWMM_Tutorial_M03 | TUFLOW SWMM Module 3]]</u>  - 1D SWMM Pipe Network / 1D SWMM Urban Hydrology
 +
*<u>[[TUFLOW_SWMM_Tutorial_M04 | TUFLOW SWMM Module 4]]</u>  - 1D SWMM Pipe Network / 1D SWMM Urban Hydrology: Executing multiple different event simulations from a single model control file.
 +
*<u>[[XPSWMM_to_TUFLOW-SWMM | XPSWMM to TUFLOW SWMM]]</u>  - How to convert an XPSWMM model to TUFLOW SWMM.
 +
 
{{Tips Navigation
 
{{Tips Navigation
−
|uplink=[[TUFLOW_SWMM_Tutorial_Introduction| Back to TUFLOW SWMM Tutorial Introduction Main Page]]
+
|uplink=[[TUFLOW_SWMM_Tutorial_Introduction#Tutorial_Modules| Return to TUFLOW SWMM Tutorial Introduction Main Page]]
 
}}
 
}}

Latest revision as of 12:15, 19 July 2024

Introduction

In this module, three culverts are added to represent flow through three separate road embankments. EPA SWMM is used as the solution scheme for the 1D culvert flow calculations, dynamically linked with the TUFLOW HPC 2D solution scheme.

TUFLOW SWMM Tutorial Module 1 builds from the model created in TUFLOW Tutorial Module 2 (in the TUFLOW Only tutorial dataset). The completed TUFLOW Module 2 model is provided in the TUFLOW_SWMM_Module_01\TUFLOW folder of the download dataset as the starting point for this tutorial. If you are not already familiar with TUFLOW, we recommend first completing Module 1 and 2 of the "TUFLOW Only" Tutorials to establish an understanding of 2D modeling, before progressing to learning how to link 1D EPA SWMM to 2D TUFLOW.

Project Initialization

Three steps are required for the project initialization:

  1. Setting the QGIS Project Coordinate Reference System (CRS).
  2. Configuring the QGIS TUFLOW Plugin.
  3. Establishing the new TUFLOW model GeoPackage file that will include new GIS inputs associated with this model update.

QGIS

QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3.11 or newer are required to access the SWMM Processing Tools described in the following sections. For installation, see Installation of TUFLOW Plugin.
Firstly, define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace:

  1. Open QGIS.
  2. Go to Project > Properties…
  3. In the CRS tab, type ‘WGS 84 / UTM Zone 60S’.
  4. Select the matching projection in the 'Predefined Coordinate Reference Systems' section.
  5. Click ‘Apply’ and ‘OK’.
  6. Ensure that the projection is set correctly by viewing the bottom right hand corner of the workspace. It should read ‘EPSG:32760’.



TUFLOW Model

Load and Style TUFLOW Model Files

Load and Style the GIS layers from the TUFLOW model:

  1. Click on the ‘Load TUFLOW Layers from TCF’ symbol from the TUFLOW Plugin toolbar.
    Tuflow plugin load tcf layers.png

  2. Navigate to the TUFLOW_SWMM_Module_01\TUFLOW\runs folder and select M02_5m_001.tcf.
  3. In the Load Layers window, select:
    • Ordering Options: Alphabetical
    • Grouping Options: Group by control file
    • Raster Load Options: Load Normally
  4. Click ‘Open’ and ‘OK’.


Style the TUFLOW layers however you desire. Common steps to do this are:

  1. Click on the ‘Apply TUFLOW Styles to Open Layers’ symbol from the TUFLOW Plugin toolbar.
    Tuflow plugin styles open layers.png

  2. Change the symbology of the DEM:
    • Right click on the DEM file in the QGIS Layers Panel and select 'Properties'.
    • From the Symbology tab, under 'Band Rendering' select the following options:
    • Render type: Singleband pseudocolor
    • Color ramp: Spectral
    • Color ramp: Invert Color Ramp
    • Mode: Equal Interval
    • From the Transparency tab, set the Global Opacity to 75%.
    • Click 'Apply' and 'OK'.


  3. Create a hillshade of the DEM:
    • Right click on the DEM file in the QGIS Layers Panel and select 'Duplicate Layer'.
    • Right click on the DEM_copy and select 'Rename Layer'. Rename the layer to DEM_Hillshade.
    • Right click on the DEM_Hillshade and select 'Properties'.
    • From the Symbology tab, under 'Band Rendering' select the following options:
    • Render type: Hillshade
    • Z Factor: 3
    • Click 'Apply' and 'OK'.


TUFLOW Plugin

Next we need to configure the QGIS TUFLOW Plugin settings to link with the project folder where we will build our model:

  1. Open the 'Configure TUFLOW Project' tool by selecting Plugins > TUFLOW > Editing > Configure / Create TUFLOW Project.
  2. Set the CRS (Coordinate Reference System) by selecting one of the vector layers associated with the opened model using the drop menu list. For example, 2d_bc_M01_001_L.
  3. To set the location of the TUFLOW folder, click 'Browse...' and navigate to the TUFLOW_SWMM_Module_01 folder. Click 'Select Folder'.
  4. To set the location of the TUFLOW single precision executable file, click 'Browse...' and navigate to the exe\2023-03-AF folder. Select TUFLOW_iSP_w64.exe and click 'Open'.
  5. Select 'GPKG' as the GIS Format.
  6. Select 'TUFLOW Classic / HPC' as the TUFLOW Engine.
  7. Tick on 'Save Default Settings Globally'.
  8. Click 'OK'.

    TS1 Configure Project 01a.png


Increment Model GeoPackage File

We will now save a copy of M02_001.gpkg with a new name, TS01_001.gpkg. This project initialization step is recommended so prior model versions from a project are not broken as a result of changes being made to GIS inputs.

  1. In the QGIS Layers Panel, select (left click) 2d_bc_M01_001_L.
  2. Click on the 'Increment Selected Layer' symbol from the TUFLOW Plugin toolbar. This opens the dialog shown below.
    Tuflow plugin increment layer.png

    • Source Layer: Automatically set to the selected layer, 2d_bc_M01_001_L.
    • Output Database: Click 'Browse...'. This will automatically open to the TUFLOW\model\gis folder. Set the new output database name to TS01_001.gpkg and click 'Save'.
    • Output Layer Name: This will automatically increment to 2d_bc_M01_002_L. Change the name back to 2d_bc_M01_001_L.
    • Delete the pre-filled 'Incremented Layer' entry in the table. We do not wish to modify the version number associated with the 2d_bc file. This current exercise will not change the version number of any of the GIS layer inputs, it is simply establishing a copy of the existing GeoPackage where future edits will be saved to.
    • Select 'Remove Source Layer from Workspace'.
    • Select 'Increment Layer and Preserve Database'.
  3. Click 'OK'.
  4. The GeoPackage database, TS01_001.gpkg will now be in the TUFLOW_SWMM_Module_01\TUFLOW\model\gis folder.


Save QGIS Project Workspace

  1. Go to Project > Save As.
  2. Navigate to the TUFLOW_SWMM_Module_01 folder and type SWMM_M01 as the filename with the extension .qgz.


GIS Inputs

Create SWMM GeoPackage Spatial Database

Create a new folder in the TUFLOW_SWMM_Module_01\TUFLOW\model folder called swmm. This is the location where all SWMM inputs will be saved.

In QGIS, create the SWMM GeoPackage Database:

  1. Go to Processing > Toolbox from the top dropdown menu options to open the Processing Toolbox.
  2. Go to TUFLOW >> SWMM in the processing tool list and select 'GeoPackage - Create'. This opens the dialog shown below.
    • To set the ‘CRS for GeoPackage’: Click the drop down menu and select ‘Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S’.
    • To set the ‘Initial SWMM Sections’: Click …, and tick on (if not already ticked):
    • Project--Title, Project--Options, Project --Report.
    • Nodes--Junctions, Nodes--Outfalls., Nodes--Storage.
    • Links--Conduits, Links--Streets.
    • To define the ‘GPKG filename to create’: Click …, select ‘Save to File’. Navigate to the TUFLOW\model\swmm folder and save the GeoPackage database as sw01_001.gpkg.
  3. Click ‘Run’.
  4. Once the tool has finished, click ‘Close’.
  5. In Windows File Explorer, navigate to the TUFLOW\model\swmm folder and drag and drop sw01_001.gpkg into QGIS.
  6. When prompted by QGIS, under 'Options', tick on 'Add layers to group', then select 'Add Layers' to open all vectors within sw01_001.gpkg. By default, all items in the available list should have been selected.
  7. In the QGIS Layers Panel, move sw01_001.gpkg to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project.




GIS Data Entry

A GeoPackage database called SWMM_Culverts.gpkg is provided in the TUFLOW_SWMM_Module_01\Tutorial_Data folder. It contains three layers:

  • Conduits: defines the culvert location, type and geometry.
  • Outfalls: defines the downstream culvert inverts.
  • Storage_nodes: defines the upstream culvert inverts.


To populate the GeoPackage database created in the previous section:

  1. In Windows File Explorer, navigate to the TUFLOW_SWMM_Module_01\Tutorial_Data folder. Drag and drop the SWMM_Culverts.gpkg into QGIS.
  2. When prompted by QGIS, under 'Options', tick on 'Add layers to group'. By default, all items in the GeoPackage database will be selected. Click 'Add Layers'.
  3. In the QGIS Layers Panel, right click on the SWMM_Culverts >> Conduits layer and select 'Zoom to Layer(s)'.
  4. Use the 'Select Features' tool to highlight all items included in Conduits.
  5. Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.
  6. In the QGIS Layers Panel, select (left click) the sw01_001.gpkg >> Links--Conduits layer.
  7. Make the Links--Conduits layer editable by clicking the 'Toggle Editing' symbol Toggle editing icon.png.
  8. Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
  9. Toggle the editing off to save the edits.


  10. Similarly, copy the objects from Storage_nodes into Nodes--Storage. Junctions and storage nodes are allowed at the upstream end of culverts. Storage nodes are preferred for culverts receiving 2D flows not through a storm drain inlet.
  11. Also copy the objects from Outfalls into Nodes--Outfalls. Outfalls are treated as outlets, and are required at the downstream end of culverts.
  12. Toggle off editing and save the edits.
  13. Remove SWMM_Culverts.gpkg.


  14. Inspect the attribute information within the respective layers to familiarize yourself with the data.


GIS Data Updates

The provided GIS data requires numerous updates before proceeding to a model simulation. We have intentionally built these updates into this tutorial to demonstrate some of the available TUFLOW SWMM model build processing tools. The following updates are being made to objects and layers within sw01_001.gpkg.

Update Conduit Details

Node Details

Stage 1 of building the 1D SWMM network involves updating the 'From Node' and 'To Node' attribute information in Links--Conduits. This information defines the Link/Node connections.
The information we will be adding to Links--Conduits is extracted from Nodes--Storage and Nodes--Outfalls automatically using the 'Conduits - Assign node fields' tool from the Processing Toolbox.

  1. In the QGIS Layers Panel, select (left click) Links--Conduits and toggle on editing.
  2. In the Processing Toolbox, select the 'Edit Features In-Place' tool Edit features in place icon.png. This allows the editing of an existing layer, instead of the creation of a new layer.
  3. Go to TUFLOW >> SWMM in the processing tool list and select 'Conduits - Assign node fields'. This opens the dialog shown below.
    • SWMM Node Layers: Tick on sw01_001 >> Nodes--Storage and sw01_001 >> Nodes--Outfalls. Click 'OK'.
  4. Select 'Modify All Features'.
  5. Once the tool has finished, click 'Close'.
  6. Turn off editing to save the edits.
  7. View the attributes associated within Links--Conduits to verify the data processing has been completed correctly. The 'From Node' and 'To Node' attribute information is now configured correctly. For a broader understanding of the other attributes associated with the Links--Conduits layer, refer to TUFLOW 2023-03-AD Release Notes (Table A.19) and the SWMM Reference Manual - Volume 2 (Hydraulics).

    Tip 1: If you wish to only update a selection of objects, instead of selecting the entire Links--Conduits dataset, select the target objects first using the 'Select Features' tool. The 'Conduits - Assign node fields' tool will provide an option to 'Modify Selected Features', instead of 'Modify All Features.'
    Tip 2: Unique Node ID's are required for the SWMM network to function error free. If you are following this workflow for a project model build, please ensure the Nodes--Storage and Nodes--Outfalls object ID information is unique. If duplicate ID values are assigned to multiple objects, consider using the 'Integrity - Make object names unique ' TUFLOW SWMM processing tool to ensure all ID values are unique before using 'Conduits - Assign node fields'.



Update Losses

Stage 2 involves updating the loss attributes in the Links--Conduits layer. In this example, default loss values are used and will be entered manually. These loss values can be adjusted in your project models to reflect site specific information if desired.

  1. In the QGIS Layers Panel, select (left click) Links--Conduits and toggle on editing.
  2. Right click Links--Conduits and select 'Open Attribute Table'.
  3. For each conduit, update the following fields:
    • losses_Kentry: 0.5
    • losses_Kexit: 1.0
    • losses_Kavg: 0.0
    The video below demonstrates how to do this one entry at a time, or via the bulk attribute update options in QGIS.
  4. Turn off editing to save the edits.


Since all the 1D SWMM inputs in this model are embankment culverts that all use the same loss parameters, it's not necessary to specify different loss attributes. The TUFLOW SWMM Module 2 will demonstrate an urban pipe network added to the model, with different loss attributes required for the road culverts and underground storm pipe network links. To simplify this step, Module 2 uses the 'Conduits - Assign node fields' processing tool.

Create 1D/2D Connections

The following instructions introduce a new tool that automates the creation of 1D/2D connections. Due to the limitations of SWMM boundary conditions, HX lines are required for the upstream end of the culvert (rather than SX), and SX connections are used at the downstream end of the culvert.

  1. In the QGIS Layers Panel, select (left click) Links--Conduits.
  2. In the Processing Toolbox, go to TUFLOW >> SWMM and select 'BC - Create channel endpoint 1D/2D connections'. This opens the dialog shown below.
    Note: Ensure the 'Edit Features In-Place' tool has been turned off.
    • Input Conduits Layer: Links--Conduits
    • Create connections at: 'Both ends'.
    • Offset Distance: 2
    • Length of BC lines: 10
    • Tick on 'Set 2D cell elevation to 1D culvert invert at 1D/2D connection cells if needed'.
    • Output Layer:
    1. Click the ... and select 'Save to GeoPackage'.
    2. Navigate to the TUFLOW\model\gis folder and select TS01_001.gpkg. Click Save.
    3. A dialog will open. In the Layer name field, write 2d_bc_SWMM_Culvert_Connections_001_L.
    4. Click 'OK'.
  3. Click 'Run'.
  4. Once the tool is finished, click 'Close'.
  5. The 2d_bc_SWMM_Culvert_Connections_001_L appears in the QGIS Layers Panel. Select 'Apply TUFLOW Styles to Current Layer'.


Note: The positions of the HX and SX connections may not be in the optimum location or extent using the generalized automated tool. As such, it is recommended to check the output from this processing step. In this module, the 1D/2D connections associated with 2d_bc_SWMM_Culvert_Connections_001_L are checked in TUFLOW SWMM Tutorial 01 Check Files.

Update Storage Node Details

The attributes of the storage nodes need to be modified to represent the storage of the connected HX cells since these cells do not represent storage themselves. The area associated with the storage nodes should be similar to the areas of the HX cells. To set the area, we will use a "PYRAMIDAL" shape with the SWMM side slope (run/rise) (Z) set to 0 to represent vertical walls. As the cell size is 5m, and the length of each polyline is 10m, the length (L) will be set to 10m and the width (W) to 5m. These sizes will be modified later when we change the boundary conditions.

  1. In the QGIS Layers Panel, select (left click) Nodes--Storage and toggle on editing.
  2. Right click Nodes--Storage and select 'Open Attribute Table'.
  3. Set the following attributes:
    • YMax: 50.0 (this is a value greater than the expected water level. It is required to allow water to fill node)
    • TYPE: 'PYRAMIDAL'
    • L: 10
    • W: 5
    • Z: 0.0
  4. Turn off editing to save the edits.  


SWMM Options

  1. In the QGIS Layers Panel, select (left click) Project--Options and toggle on editing.
  2. Right click Project--Options and select 'Open Attribute Table'.
  3. Update the following options:
    • START_DATE: 2020-01-01 (Date Format: YYYY-MM-DD)
    • REPORT_STEP: 00:01:00
  4. Turn off editing to save the edits.



Save the QGIS Project Workspace:

  1. Go to Project > Save. This will update SWMM_M01.qgz, which was created previously in the folder TUFLOW_SWMM_Module_01.

Export SWMM INP File

SWMM is not able to read the sw01_001.gpkg database directly, therefore, we need to convert the GeoPackage file to a SWMM INP file format.

  1. In the QGIS Layers Panel, right click Links--Conduits (or any of the SWMM layers) and select 'TUFLOW' > 'SWMM - Export inp file'.
  2. This will open the 'GeoPackage - Write to SWMM inp' processing tool, prepopulated with the filename of the layer's GeoPackage.
    Note: This tool can also be activated from the Processing Toolbox.
  3. Click 'Run'.
  4. Once the tool is finished, click 'Close'.
  5. This tool will save the SWMM inp file in the same folder location and with the same name as the GeoPackage input file. In this case, it will save sw01_001.inp to the TUFLOW\model\swmm folder.


Simulation Control Files

The following steps will require use of a text editor. The tutorial demonstration uses Notepad++. For its configuration information refer to Notepad++ Tips.

To differentiate the TUFLOW SWMM tutorials from the TUFLOW/ESTRY tutorials, 'TS' is used as the file prefix in this series of tutorials. To avoid the potential risk of overwriting existing control files accidentally, we will start by saving new control files where we will be making subsequent syntax updates during the following steps.

Set up the simulation control files:

  1. In Windows File Explorer, navigate to the TUFLOW_SWMM_Module_01\TUFLOW\runs folder and open M02_5m_001.tcf in a Text Editor (Notepad++ is recommended).
  2. Save the file as TS01_5m_001.tcf in the TUFLOW_SWMM_Module_01\TUFLOW\runs folder.
  3. Open M01_001.tbc using the 'Open File' function in Notepad++. Save the file as TS01_001.tbc in the TUFLOW_SWMM_Module_01\TUFLOW\model folder.
  4. Create a new blank text file called TS01_001.tscf and save it in the TUFLOW_SWMM_Module_01\TUFLOW\model folder.


TUFLOW Control File (TCF)

  1. Open TS01_5m_001.tcf in a Text Editor (Notepad++ is recommended) and make the following reference updates:
    Spatial Database == ..\model\gis\TS01_001.gpkg  ! Specify the location of the GeoPackage Spatial Database
    BC Control File == ..\model\TS01_001.tbc ! Reference the TUFLOW Boundary Conditions Control File
  2. Add the following line in the 'Model Inputs' section:
    SWMM Control File == ..\model\TS01_001.tscf ! Reference the SWMM (1D) Control File
  3. Add the following line in the 'Output Settings' section:
    NetCDF Output Start Date == 2020-01-01 00:00 ! Sets the output units for the NetCDF time variable
  4. Save the TCF.


TUFLOW Boundary Control File (TBC)

  1. From TS01_001.tcf, right click TS01_001.tbc and select 'Open File'. This opens TS01_001.tbc into a new tab in Notepad ++.
  2. Add the following command line after 'Read GIS SA == 2d_sa_M01_001_R':
    Read GIS BC == 2d_bc_SWMM_Culvert_Connections_001_L ! Links 1D SWMM culverts to the 2D TUFLOW domain
  3. Save the TBC.


TUFLOW SWMM Control File (TSCF)

A new control file, the TUFLOW SWMM Control File (TSCF), is used to control the SWMM input data. All 1D SWMM files and commands are referenced in the TUFLOW SWMM Control File.

  1. From TS01_001.tcf, right click TS01_001.tscf and select 'Open File'. This opens TS01_001.tscf into a new tab in Notepad ++.
  2. Add the following command:
    Read SWMM == swmm\sw01_001.inp ! 1D SWMM culvert input file
  3. Save the TSCF.



Running the Simulation

  1. Save a copy of _run_M02_HPC.bat as _run_TS01_HPC.bat in the TUFLOW_SWMM_Module_01\TUFLOW\runs folder.
  2. Update the batch file to reference the TS01_5m_001.tcf :
    set exe="..\..\..\exe\2023-03-AF\TUFLOW_iSP_w64.exe"
    set run=start "TUFLOW" /wait %exe% -b
    %run% TS01_5m_001.tcf
  3. Save the batch file and double click it in Windows File Explorer to run the simulation.
    If the model simulation doesn't run:
    1. Check in the screen output or the tlf file near the end for "For SWMM Model Errors see:". This indicates that there is something wrong with the SWMM inputs. Reviewing that file will provide feedback on what is wrong.
    2. Review this link for common TUFLOW SWMM Troubleshooting advice.




Check Files and Results Output

Complete the steps outlined in following links to review check files and simulation results from the TUFLOW SWMM model simulation:

TUFLOW SWMM Tutorial 01 Check Files
TUFLOW SWMM Tutorial 01 Results

Conclusion

  • EPA SWMM culverts were added to convey water through the structures under the three roads in the tutorial model.
  • Check files were used to review the inclusion of 1D SWMM culverts to a 2D TUFLOW model.
  • Results through the 1D culverts were assessed.


Other TUFLOW SWMM Tutorials

Up
Go-up.png Return to TUFLOW SWMM Tutorial Introduction Main Page
Retrieved from "https://wiki.tuflow.com/w/index.php?title=TUFLOW_SWMM_Tutorial_M01&oldid=39861"