TUFLOW SWMM Tutorial M03: Difference between revisions
Content deleted Content added
Chris Huxley (talk | contribs)  | 
				|||
| (150 intermediate revisions by 4 users not shown) | |||
Line 1: 
= Introduction = 
This tutorial, Module 3 of the TUFLOW 
= Project Initialization = 
==QGIS== 
QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3. 
Define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace: 
<ol>  
Line 16: 
<br> 
{{Video|name=Animation_TS1_Initialization_01a.mp4|width=1235}}<br> 
==TUFLOW Model== 
Line 37 ⟶ 25: 
[[File: Tuflow_plugin_load_tcf_layers.png]]<br> 
<br> 
<li> 
<li>In the Load Layers window, select: 
* Ordering Options: Alphabetical 
Line 45 ⟶ 33: 
</ol> 
<br> 
Style the TUFLOW layers. Suggested styling steps were provided in <u>[[TUFLOW_SWMM_Tutorial_M01# 
<br> 
===TUFLOW Plugin=== 
Next we need to configure the QGIS TUFLOW Plugin settings to link with the project folder where we will build our model:<br> 
<ol> 
<li>Open the 'Configure TUFLOW Project' tool by selecting Plugins > TUFLOW > Editing > Configure / Create TUFLOW Project. 
<li>Set the CRS (Coordinate Reference System) by selecting one of the vector layers associated with the opened model using the drop menu list. For example, ''2d_bc_M01_001_L''. 
<li>To set the location of the TUFLOW folder, click 'Browse...' and navigate to the '''TUFLOW_SWMM_Module_03''' folder. Click 'Select Folder'.  
<li>To set the location of the TUFLOW single precision executable file, click 'Browse...' and navigate to the '''exe\2023-03-AF''' folder. Select '''TUFLOW_iSP_w64.exe''' and click 'Open'. 
<li>Select 'GPKG' as the GIS Format.  
<li>Select 'TUFLOW Classic / HPC' as the TUFLOW Engine. 
<li>Tick on 'Save Default Settings Globally'. 
<li>Click 'OK'.<br> 
<br> 
[[File: TS3_Configure_Project_01a.png]]<br> 
</ol> 
<br> 
=== Increment TUFLOW GeoPackage File ===  
<ol> 
<li>In the QGIS Layers Panel, select (left click) '''2d_bc_M01_001_L'''. 
<li>Click on the  
<br> 
[[File:tuflow_plugin_increment_layer.png]]<br> 
<br> 
:*Source Layer: Automatically set to the selected layer, '''2d_bc_M01_001_L'''. 
:*Output Database: Click 'Browse...'. This will automatically open to the '''TUFLOW\model\gis''' folder. Set the new output database name to ''' 
:*Output Layer Name: This  
:*Delete the pre-filled 'Incremented Layer' entry in the table. We do not wish to modify the version number associated with the 2d_bc file. This current exercise will not change the version number of any of the GIS layer inputs, it is simply establishing a copy of the existing GeoPackage where future edits will be saved to. 
:*Select 'Remove Source Layer from Workspace'. 
:*Select 'Increment Layer and Preserve Database'. 
<li>Click 'OK'. 
<li>The GeoPackage database, '''TS03_001.gpkg''' will now be in the '''TUFLOW_SWMM_Module_03\TUFLOW\model\gis''' folder. 
<br><br> 
{{Video|name=Animation_TS3_Initialization_02b.mp4|width=1236}} 
<br> 
</ol> 
=== Increment SWMM GeoPackage File ===  
SWMM pipe network junction attributes need to be updated when converting a TUFLOW 2D direct rainfall / SWMM 1D model <u>([[TUFLOW_SWMM_Tutorial_M02|TUFLOW SWMM Tutorial Module 2]]</u>). into a format that uses SWMM hydrology instead of direct rainfall. Similar to  
<ol> 
<li> In the QGIS Layers Panel, open the '''TS02_001.tscf''' group. In the '''sw02_001.inp''' group, right click '''Links--Conduits'''. 
<li>  
:*Existing GeoPackage Layers: 'Unload -- do not move'. 
<li> Select 'OK'. 
<li> The tool will automatically load '''sw03_001.gpkg''' into the QGIS workspace and remove '''sw02_001.inp''' from the QGIS workspace. 
<li> In the QGIS Layers Panel, move '''sw03_001.gpkg''' to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project.  
<br><br> 
{{Video|name=Animation_TS3_Initialization_03b.mp4|width=1236}} 
<br> 
</ol> 
===Save QGIS Project Workspace=== 
<ol> 
<li>Go to Project > Save As. 
Line 85 ⟶ 96: 
<br> 
=  
==Update SWMM GeoPackage Spatial Database==  
In previous tutorials we have created new SWMM GeoPackage databases for our new entries. This tutorial will demonstrate a different update approach. Instead of creating a new SWMM GeoPackage database, we will update  
<ol> 
<li>Go to  
<li>Go to  
:*GPKG filename modify: Click the ... and navigate to the '''TUFLOW_SWMM_Module_03\TUFLOW\model\swmm''' folder. Select '''sw03_001.gpkg'''. 
:*CRS for GeoPackage: Click the drop down menu and select 'Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S'. 
:*SWMM Sections to add: Click the ..., and tick on: 
: 
::*'''Hydrology--Subcatchments''' 
<li>Click 'Run'. 
<li>Once the tool is finished, click 'Close'. 
<br><br> 
{{Video|name=Animation_TS3_SWMM_Inputs_01b.mp4|width=1236}} 
<br> 
</ol> 
The above steps have added the new  
<ol> 
<li>In  
<li> 
<li> 
<li> 
<li>In the QGIS Layers Panel, within the '''sw03_001''' group, move '''Hydrology--Subcatchments''' to the bottom. This will ensure that the other data within this database can be seen.  
<br><br> 
{{Video|name=Animation_TS3_SWMM_Inputs_02b.mp4|width=1236}} 
<br> 
</ol> 
== SWMM GIS Data Entry == 
A GeoPackage called '''Urban_Hydrology.gpkg''' is provided in the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. It contains one SWMM input layer and one TUFLOW input layer:  
:*'''SWMM_Subcatchments''':  
:*'''TUFLOW_Subcatchments''': defines the remaining 2D TUFLOW catchment hydrology subcatchment delineation.<br> 
To populate the SWMM GeoPackage created in the previous section: 
<ol> 
<li>In Windows File Explorer, navigate to the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. Drag and drop the '''Urban_Hydrology.gpkg''' into QGIS.  
<li>When prompted by QGIS select '''SWMM_Subcatchments'''. Click 'Add Layers'. 
<li>In the QGIS Layers  
<li>Use the 'Select Features' tool to highlight all items included in '''SWMM_Subcatchments'''. 
<li>Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.  
<li> 
<li>Make the '''sw03_001 >> Hydrology--Subcatchments''' layer editable by clicking the 'Toggle Editing' symbol [[File:toggle_editing_icon.png|27x27px]]. 
<li>Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu. 
<li>Toggle the editing off to save the edits. 
<li>Remove '''Urban_Hydrology 
<br><br> 
{{Video|name=Animation_TS3_SWMM_Inputs_03b.mp4|width=1236}} 
<br> 
</ol> 
==SWMM GIS Data Updates== 
The following updates  
===Update SWMM Hydrology 
The text information within '''Hydrology-- 
'''Note:''' 'Gage' is the American spelling of 'Gauge' in Oxford English. 
<ol> 
<li> 
<li> 
<li> 
{| class="wikitable" width="60%" 
!style="background-color:#005581; font-weight:bold; color:white;"| Name  
Line 155 ⟶ 170: 
!style="background-color:#005581; font-weight:bold; color:white;"| Tseries  
|- 
| RF_G1 || Volume || 0. 
|- 
| RF_G2 || Volume || 0. 
|} 
For a summary of the attributes associated with '''Hydrology--Raingages''', refer to <u>[https://docs.tuflow.com/classic-hpc/release/2023-03-AD/SWMM-Input-Detailed-1.html#tab:tab-SWMM-Input-Raingages TUFLOW 2023-03-AD Release Notes (Table A.11)]</u> and the <u>[https://downloads.tuflow.com/SWMM/SWMM5_Reference_Manual_Volume1_Hydrology_P100NYRA.pdf SWMM5 Reference Manual - Volume 1 (Hydrology)]</u>.<br> 
Note, the spatial locations where the gage information is applied is covered in the following section. 
<li> Turn off editing and save the information. 
<br><br> 
{{Video|name=Animation_TS3_SWMM_Inputs_04b.mp4|width=1236}} 
<br> 
</ol> 
===Update SWMM Hydrology Subcatchments=== 
The information within '''Hydrology--Subcatchments''' defines the subcatchment parameters (including catchment area, width, slope, percent impervious, outlet specification and infiltration details). All required data entries have been pre-filled in the supplied dataset except the 'Area' information, which we will determine using QGIS. SWMM requires the hydrology subcatchment area information in hectares. 
<ol> 
<li> 
<li> 
<li> 
:* 'area($geometry) ': Extracts the area of each region (subcatchment) in '''Hydrology--Subcatchments'''. 
:* '/ 10000': Converts the area values into hectares.<br> 
'''Note:''' The projection used in these tutorials is measured in meters. Thus, when QGIS extracts the area from a region, it reports the area in m<sup>2</sup>. If using a projection that is measured in feet, QGIS would extract the area in ft<sup>2</sup>. 
<li>Click 'Update All'. 
<li>Turn off editing and save the information. 
<li>Inspect the attribute information within '''Hydrology--Subcatchments''' to familiarize yourself with the data. A few demonstration features have been included in the dataset.  
:*Two rainfall gages are linked to the subcatchments. Downstream subcatchments linked to rain gage 'RF_G1'. Upstream subcatchments are linked to rain gage 'RF_G2'. 
:*Subcatchments 'SPit11A' and 'SPit11A' are being routed to subcatchment 'SPit11C' before entering the SWMM pipe network. All other hydrology subcatchments route directly to a SWMM '''Node--Junctions'''.<br> 
For a summary of the attributes associated with the layer, refer to <u>[https://docs.tuflow.com/classic-hpc/release/2023-03-AD/SWMM-Input-Detailed-1.html#tab:tab-SWMM-Input-Subcatchments TUFLOW 2023-03-AD Release Notes (Table A.38)]</u> and the <u>[https://downloads.tuflow.com/SWMM/SWMM5_Reference_Manual_Volume1_Hydrology_P100NYRA.pdf SWMM5 Reference Manual - Volume 1 (Hydrology)]</u>.  
<br><br> 
{{Video|name=Animation_TS3_SWMM_Inputs_05b.mp4|width=1236}} 
<br> 
</ol> 
===SWMM  
SWMM '''Project--Options'''  
:* 
:* 
When TUFLOW processes SWMM inputs, it combines the multiple INP files into one single INP prior to simulation. For this model, the simulation control parameters defined in Module 1 ( 
:* 
:* 
We need to change the SWMM hydrology timestep details. Updating this setting in the '''sw01_001.inp''' does not impact any of the previous tutorial modules, as they did not include any hydrology components.  
<ol> 
<li>In the QGIS Layers  
<li>Right click '''Project--Options''' and select 'Open Attribute Table'. 
<li>Update the following hydrology timestep options:  
:*WET_STEP: 00:01:00 
:*DRY_STEP: 00:01:00 
<li>Turn off editing to save the edits. 
<br><br> 
{{Video|name=Animation_TS3_SWMM_Inputs_06b.mp4|width=1236}} 
<br> 
</ol> 
== Export SWMM INP File == 
We will now  
<ol> 
<li> 
<li>This will open the '<u>[[QGIS_SWMM_GeoPackage_Write_to_SWMM_inp |GeoPackage - Write to SWMM inp]]</u>' processing tool, prepopulated with the filename of the layer's GeoPackage. <br> 
'''Note:''' This tool can also be activated from the Processing Toolbox.  
<li>Click 'Run'. 
<li>Once the tool is finished, update the 'GeoPackage Input File' parameter. Click '...', and navigate to the '''TUFLOW\model\gis''' folder. Select '''sw01_001.gpkg'''. 
<li>Click 'Run'. 
<li>Once the tool is finished, click 'Close'. 
<li>This tool will save the SWMM inp files in the same folder location and with the same name as the GeoPackage input file. In this case, it will save '''sw03_001.inp''' and '''sw01_001.inp''' to the '''TUFLOW\model\swmm''' folder. 
<br><br> 
{{Video|name=Animation_TS3_SWMM_Inputs_07b.mp4|width=1236}} 
<br> 
</ol> 
==TUFLOW GIS Updates== 
We will be reverting the TUFLOW model back to a configuration that uses inflows from an external hydrology model (as per Module 1), instead of 2D direct rainfall (Module 2), in the areas not covered by SWMM urban hydrology.  
<ol> 
<li>Click on the ‘Import Empty File’ symbol from the TUFLOW plugin toolbar. <br> 
[[File:tuflow_plugin_import_empty_file.png]]<br> 
<br> 
<li>Select '2d_sa' from the Empty Type list. 
<li>In the Run ID box write 'TS03_001'. 
<li>Tick the 'Regions' Geometry Type. 
<li>In the Spatial Database Options, select 'All to one'. Navigate to the '''TUFLOW_SWMM_Module_03\TUFLOW\model\gis''' folder and select '''TS03_001.gpkg'''. Click Save and hit 'OK'. 
<li>The ''' 
<br> 
[[File:TS3_import_empty_2d_sa_01a.png]]<br> 
<br> 
<li>In Windows File Explorer, navigate to the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder. Drag and drop the '''Urban_Hydrology.gpkg''' into QGIS.  
<li>When prompted by QGIS, select '''TUFLOW_Subcatchments'''. Click 'Add Layers'. 
<li>In the QGIS Layers Panel, select (left click) the '''TUFLOW_Subcatchments''' layer. 
<li>Use the 'Select Features' tool to highlight the four regions included in '''TUFLOW_Subcatchments'''. 
<li>Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.  
<li> 
<li>Make the '''2d_sa_TS03_001_R''' layer editable by clicking the 'Toggle Editing' symbol [[File:toggle_editing_icon.png|27x27px]]. 
<li>Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu. 
<li>Toggle  
<li>Remove '''Urban_Hydrology.gpkg''' 
The polygon entry we have updated refers to a new subcatchment name for the region adjacent to the SWMM subcatchments. The new name is 'FC06.62', instead of 'FC06'. When we update the TUFLOW Control files we will configure the file references so we are sourcing data from a new flow file obtained from an external hydrology model that has been updated with the reduced catchment area, in recognition of SWMM being used for the flow estimate in the proposed urban development area. <br> 
'''Note:''' Common hydrology software used in combination with TUFLOW by modelers include: HEC-HMS, RORB, Drains, WBNM, URBS and more.'' 
<br><br> 
{{Video|name=Animation_TS3_TUFLOW_Inputs_01b.mp4|width=1236}} 
<br> 
</ol> 
==TUFLOW Boundary Updates== 
As a result of the changes 
<ol> 
<li>Copy '''bc_dbase_TS03_001.csv''' and '''TS03_01p2hr.csv''' from the '''TUFLOW_SWMM_Module_03\Tutorial_Data''' folder to the '''TUFLOW_SWMM_Module_03\TUFLOW\bc_dbase''' folder.  
<br><br> 
{{Video|name=Animation_TS3_TUFLOW_Boundary_01b.mp4|width=1236}} 
<br> 
</ol> 
=Simulation Control Files= 
Line 278 ⟶ 288: 
:*Open '''TS02_001.tscf,'''  and save the file as '''TS03_001.tscf''' in the '''TUFLOW\model''' folder. 
<br> 
</ol> 
===TUFLOW Control File (TCF)=== 
<ol> 
<li>Edit '''TS03_5m_001.tcf''' by making the following reference updates:<br> 
<font color="blue"><tt>Spatial Database </tt></font> <font color="red"><tt>== </tt></font> <font color="black"><tt>..\model\gis\TS03_001.gpkg</tt></font> <font color="green"><tt>  ! Specify the location of the GeoPackage Spatial Database</tt></font><br> 
<font color="blue"><tt>BC Control File</tt></font> <font color="red"><tt> == </tt></font> <font color="black"><tt>..\model\TS03_001.tbc</tt></font> <font color="green"><tt>  ! Reference the TUFLOW Boundary Condition Control File</tt></font><br> 
<font color="blue"><tt>BC Database</tt></font> <font color="red"><tt> == </tt></font> <font color="black"><tt>..\bc_dbase\bc_dbase_TS03_001.csv</tt></font> <font color="green"><tt>  ! Reference the Boundary Condition Database</tt></font><br> 
<font color="blue"><tt>SWMM Control File</tt></font> <font color="red"><tt> == </tt></font> <font color="black"><tt>..\model\TS03_001.tscf</tt></font> <font color="green"><tt>  ! Reference the SWMM (1D) Control File</tt></font 
<li> Add the following command to the '<tt><font color="green">Time Control</font></tt>' section. This command is necessary for many TUFLOW-SWMM models, especially when using SWMM hydrology. The 2D timestep dictates the SWMM 1D timestep. Generally, this timestep is adequate for SWMM but in cases where the flows are contained in the 1D, the timestep may become too large for SWMM. This command forces it into the appropriate range. If this command is neglected, some models will experience very high mass errors. The range of timesteps used is reported in the SWMM .rpt file ('''TS03_5m_001_swmm.rpt''') in the '''TUFLOW\results''' folder.<br> 
< 
<li> Comment out the 'Map Cuttoff Depth' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).<br> 
<font color="green"><tt>! Map Cutoff Depth == 0.05</tt></font><br> 
<br> 
{{Video|name=Animation_TS3_Sim_Control_01b.mp4|width=1236}} 
<br> 
</ol> 
===TUFLOW Boundary Control File (TBC)=== 
<ol> 
<li> 
<li> 
<font color="green"><tt>! Global Rainfall BC == RF_FC04</tt></font> 
<br> 
<li>Add the following additional command:<br> 
<font color="blue"><tt>Read GIS SA</tt></font><font color="red"><tt> == </tt></font><font color="black"><tt>2d_sa_TS03_001_R </tt></font><font color="green"><tt>! Reads in 2D source area - Excluding SWMM areas</tt></font><br> 
<br> 
{{Video|name=Animation_TS3_Sim_Control_02c.mp4|width=1236}} 
<br> 
</ol> 
===TUFLOW SWMM Control File (TSCF)=== 
<ol> 
<li> 
<li>Replace <font color="blue"><tt>Read SWMM 
<font color="blue"><tt> 
<li>As we are pushing flows from the subcatchments straight to the pipe network, the water level of the ponded water at the nodes can become much higher than the 2D water levels. The inlet will surcharge but the flow is throttled. The following command will pull water out of the 2D if the 1D ponded water level goes beyond 0.1 m higher than the 2D (not needed for rain on grid simulations). Add the following command:<br> 
<font color="blue"><tt>Maximum Inlet Ponded Depth</tt></font><font color="red"><tt> == </tt></font><font color="black"><tt>0.1 </tt></font><font color="green"><tt>! Pull ponded water out of the 1D domain as needed</tt></font><br> 
<li>Add the following command:<br> 
<font color="blue"><tt>Read BC Timeseries</tt></font><font color="red"><tt> == </tt></font><font color="black"><tt>RF_FC04 | RF_FC07 </tt></font><font color="green"><tt>! TUFLOW BC Database / SWMM Rain Gage Linkage</tt></font><br> 
<br> 
{{Video|name=Animation_TS3_Sim_Control_03c.mp4|width=1236}} 
<br> 
</ol> 
Line 321 ⟶ 337: 
<li>Save a copy of '''_run_TS02_HPC.bat''' as '''_run_TS03_HPC.bat''' in the '''TUFLOW_SWMM_Module_03\TUFLOW\runs''' folder. 
<li>Update the batch file to reference the '''TS03_5m_001.tcf''' :<br> 
<font color="blue"><tt>'''set'''</tt></font> <font color="black"><tt>exe</tt></font><font color="red"><tt>=</tt></font><font color="black"><tt>"..\..\..\exe\2023-03- 
<font color="blue"><tt>'''set'''</tt></font> <font color="black"><tt>run</tt></font><font color="red"><tt>=</tt></font><font color="black"><tt>start "TUFLOW" /wait</tt></font> <font color="orange"><tt> %exe%</tt></font> <font color="black"><tt> -b</tt></font> <br> 
<font color="orange"><tt>%run% </tt></font> <font color="black"><tt>TS03_5m_001.tcf </tt></font>  
<li> 
<li>Did your TUFLOW-SWMM model fail to run successfully? If so, here is a link to a troubleshooting guide: <u>[[TUFLOW_SWMM_Troubleshooting | TUFLOW SWMM Troubleshooting]]</u>.<br> 
<br><br> 
{{Video|name=Animation_TS3_Run_Sim_01c.mp4|width=1236}}<br> 
</ol> 
= Check Files =  
Review the SWMM INP and simulation report  
* View '''TS03_5m_001_swmm.inp''' in a text editor to confirm the  
* View '''TS03_5m_001_swmm_curves.inp''' in a text editor to confirm the rainfall time series that has been used by the SWMM hydrology engine matches the input dataset. 
* View '''TS03_5m_001_swmm.rpt''' in a text editor to confirm the model computation is healthy in term of mass conservation. 
= Results Output = 
Complete the steps outlined in following link to review the simulation results from the TUFLOW SWMM model simulation: 
<u>[[TUFLOW_SWMM_Tutorial_M03_Results_QGIS | TUFLOW SWMM Tutorial 03 Results]]</u> <br> 
= Conclusion = 
*Check and result files associated with the SWMM hydrology modelling were inspected. 
*For further training opportunities see <u>[https://tuflow.com/training/training-course-catalogue/ TUFLOW Training Catalogue]</u> and/or contact <u>[mailto:training@tuflow.com training@tuflow.com]</u>. 
<br> 
=Other TUFLOW SWMM Tutorials= 
*<u>[[TUFLOW_SWMM_Tutorial_M01 | TUFLOW SWMM Module 1]]</u>  - 1D SWMM Culverts 
*<u>[[TUFLOW_SWMM_Tutorial_M02 | TUFLOW SWMM Module 2]]</u>  - 1D SWMM Pipe Network / 2D TUFLOW Direct Rainfall Hydrology 
*<u>[[TUFLOW_SWMM_Tutorial_M03 | TUFLOW SWMM Module 3]]</u>  - 1D SWMM Pipe Network / 1D SWMM Urban Hydrology 
*<u>[[TUFLOW_SWMM_Tutorial_M04 | TUFLOW SWMM Module 4]]</u>  - 1D SWMM Pipe Network / 1D SWMM Urban Hydrology: Executing multiple different event simulations from a single model control file. 
*<u>[[XPSWMM_to_TUFLOW-SWMM | XPSWMM to TUFLOW SWMM]]</u>  - How to convert an XPSWMM model to TUFLOW SWMM. 
<br> 
{{Tips Navigation 
 | |||