TUFLOW SWMM Tutorial M03

From Tuflow
Jump to navigation Jump to search

Introduction

This tutorial, Module 3 of the TUFLOW-SWMM tutorial dataset, demonstrates how to add SWMM urban hydrology to a 1D SWMM stormwater pipe network / 2D TUFLOW HPC catchment model. TUFLOW-SWMM Tutorial Module 3 builds from the model created in TUFLOW SWMM Tutorial Module 2. The completed TUFLOW-SWMM Module 2 model is provided in the TUFLOW_SWMM_Module_03\TUFLOW folder of the download dataset as the starting point for this tutorial. If you are not already familiar with TUFLOW-SWMM linking, we recommend completing TUFLOW-SWMM Modules 1 and 2 prior to starting this tutorial.

Project Initialization

QGIS

QGIS Version 3.34 or newer, and QGIS TUFLOW Plugin 3.11 or newer are required to access the SWMM Processing Tools described in the following sections. For installation, see Installation of TUFLOW Plugin.
Define the Coordinate Reference System (CRS), also called ‘Projection’, for the QGIS workspace:

  1. Open QGIS.
  2. Go to Project > Properties…
  3. In the CRS tab, type ‘WGS 84 / UTM Zone 60S’.
  4. Select the matching projection in the 'Predefined Coordinate Reference Systems' section.
  5. Click ‘Apply’ and ‘OK’.
  6. Ensure that the projection is set correctly by viewing the bottom right hand corner of the workspace. It should read ‘EPSG:32760’.



TUFLOW Model

Load and Style TUFLOW Model Files

Load in the project GIS layers:

  1. Click on the ‘Load TUFLOW Layers from TCF’ symbol from the TUFLOW Plugin toolbar.
    Tuflow plugin load tcf layers.png

  2. Navigate to the TUFLOW_SWMM_Module_03\TUFLOW\runs folder and select TS02_5m_001.tcf.
  3. In the Load Layers window, select:
    • Ordering Options: Alphabetical
    • Grouping Options: Group by control file
    • Raster Load Options: Load Normally
  4. Click ‘Open’ and ‘OK’.


Style the TUFLOW layers. Suggested styling steps were provided in TUFLOW SWMM Tutorial M01. They have not been duplicated here.

TUFLOW Plugin

Next we need to configure the QGIS TUFLOW Plugin settings to link with the project folder where we will build our model:

  1. Open the 'Configure TUFLOW Project' tool by selecting Plugins > TUFLOW > Editing > Configure / Create TUFLOW Project.
  2. Set the CRS (Coordinate Reference System) by selecting one of the vector layers associated with the opened model using the drop menu list. For example, 2d_bc_M01_001_L.
  3. To set the location of the TUFLOW folder, click 'Browse...' and navigate to the TUFLOW_SWMM_Module_03 folder. Click 'Select Folder'.
  4. To set the location of the TUFLOW single precision executable file, click 'Browse...' and navigate to the exe\2023-03-AF folder. Select TUFLOW_iSP_w64.exe and click 'Open'.
  5. Select 'GPKG' as the GIS Format.
  6. Select 'TUFLOW Classic / HPC' as the TUFLOW Engine.
  7. Tick on 'Save Default Settings Globally'.
  8. Click 'OK'.

    TS3 Configure Project 01a.png


Increment TUFLOW GeoPackage File

We will now save a copy of TS02_001.gpkg with a new name, TS03_001.gpkg. This project initialization step is recommended so prior model versions from a project are not broken as a result of changes being made to GIS inputs.

  1. In the QGIS Layers Panel, select (left click) 2d_bc_M01_001_L.
  2. Click on the 'Increment Selected Layer' symbol from the TUFLOW Plugin toolbar. This opens the dialog shown below.
    Tuflow plugin increment layer.png

    • Source Layer: Automatically set to the selected layer, 2d_bc_M01_001_L.
    • Output Database: Click 'Browse...'. This will automatically open to the TUFLOW\model\gis folder. Set the new output database name to TS03_001.gpkg and click 'Save'.
    • Output Layer Name: This will automatically increment to 2d_bc_M01_002_L. Change the name back to 2d_bc_M01_001_L.
    • Delete the pre-filled 'Incremented Layer' entry in the table. We do not wish to modify the version number associated with the 2d_bc file. This current exercise will not change the version number of any of the GIS layer inputs, it is simply establishing a copy of the existing GeoPackage where future edits will be saved to.
    • Select 'Remove Source Layer from Workspace'.
    • Select 'Increment Layer and Preserve Database'.
  3. Click 'OK'.
  4. The GeoPackage database, TS03_001.gpkg will now be in the TUFLOW_SWMM_Module_03\TUFLOW\model\gis folder.


Increment SWMM GeoPackage File

SWMM pipe network junction attributes need to be updated when converting a TUFLOW 2D direct rainfall / SWMM 1D model (TUFLOW SWMM Tutorial Module 2). into a format that uses SWMM hydrology instead of direct rainfall. Similar to above (incrementing the TUFLOW GeoPackage file), we will increment the SWMM pipe network database name so we do not alter the inputs necessary for TS02_5m_001.tcf to function without issue.

  1. In the QGIS Layers Panel, open the TS02_001.tscf group. In the sw02_001.inp group, right click Links--Conduits.
  2. Select TUFLOW > SWMM - Increment GeoPackage. This opens the dialog shown below.
    • Output File: Click the '...'. This will automatically open to the TUFLOW\model\swmm folder. Set the output database name to sw03_001.gpkg and click 'Save'.
    • Existing GeoPackage Layers: 'Unload -- do not move'.
  3. Select 'OK'.
  4. The tool will automatically load sw03_001.gpkg into the QGIS workspace and remove sw02_001.inp from the QGIS workspace.
  5. In the QGIS Layers Panel, move sw03_001.gpkg to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project.


Save QGIS Project Workspace

  1. Go to Project > Save As.
  2. Navigate to the TUFLOW_SWMM_Module_03 folder and type SWMM_M03 as the filename with the extension .qgz.


GIS Inputs

Update SWMM GeoPackage Spatial Database

In previous tutorials we have created new SWMM GeoPackage databases for our new entries. This tutorial will demonstrate a different update approach. Instead of creating a new SWMM GeoPackage database, we will update the existing database, sw03_001.gpkg by adding new SWMM Sections for the hydrology elements we will be incorporating into the model in this tutorial.

  1. Go to Processing > Toolbox from the top dropdown menu options to open the Processing Toolbox.
  2. Go to TUFLOW >> SWMM in the processing tool list and select 'GeoPackage - Add sections'. This opens the dialog shown below.
    • GPKG filename modify: Click the ... and navigate to the TUFLOW_SWMM_Module_03\TUFLOW\model\swmm folder. Select sw03_001.gpkg.
    • CRS for GeoPackage: Click the drop down menu and select 'Project CRS: EPSG:32760 - WGS 84 / UTM zone 60S'.
    • SWMM Sections to add: Click the ..., and tick on:
    • Hydrology--Raingages
    • Hydrology--Subcatchments
  3. Click 'Run'.
  4. Once the tool is finished, click 'Close'.


The above steps have added the new sections to the SWMM GeoPackage database, sw03_001.gpkg. However, the new sections are not currently displayed in the QGIS Layers Panel. We need to close the database and reopen it to view the changes.

  1. In the QGIS Layers Panel, right click sw03_001 and select 'Remove Group...'.
  2. In Windows File Explorer, navigate to the TUFLOW\model\swmm folder and drag and drop sw03_001.gpkg into QGIS.
  3. When prompted by QGIS, under 'Options', tick on 'Add layers to group', then select 'Add Layers' to open all vectors within sw03_001.gpkg. By default, all items in the available list should have been selected.
  4. In the QGIS Layers Panel, move sw03_001.gpkg to the top of the list. This will ensure the data within this database file is displayed above all other layers in the project when we are making edits.
  5. In the QGIS Layers Panel, within the sw03_001 group, move Hydrology--Subcatchments to the bottom. This will ensure that the other data within this database can be seen.


SWMM GIS Data Entry

A GeoPackage called Urban_Hydrology.gpkg is provided in the TUFLOW_SWMM_Module_03\Tutorial_Data folder. It contains one SWMM input layer and one TUFLOW input layer:

  • SWMM_Subcatchments: defines the 1D SWMM urban hydrology subcatchment delineation and associated parameters.
  • TUFLOW_Subcatchments: defines the remaining 2D TUFLOW catchment hydrology subcatchment delineation.

To populate the SWMM GeoPackage created in the previous section:

  1. In Windows File Explorer, navigate to the TUFLOW_SWMM_Module_03\Tutorial_Data folder. Drag and drop the Urban_Hydrology.gpkg into QGIS.
  2. When prompted by QGIS select SWMM_Subcatchments. Click 'Add Layers'.
  3. In the QGIS Layers Panel, right click on the SWMM_Subcatchments layer and select 'Zoom to Layer(s)'.
  4. Use the 'Select Features' tool to highlight all items included in SWMM_Subcatchments.
  5. Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.
  6. In the QGIS Layers Panel, select (left click) the sw03_001 >> Hydrology--Subcatchments layer.
  7. Make the sw03_001 >> Hydrology--Subcatchments layer editable by clicking the 'Toggle Editing' symbol Toggle editing icon.png.
  8. Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
  9. Toggle the editing off to save the edits.
  10. Remove Urban_Hydrology from the QGIS Layers Panel.


SWMM GIS Data Updates

The following updates are being made to the objects and layers within sw03_001.gpkg.

Update SWMM Hydrology Raingages

The text information within Hydrology--Raingages defines the pluviographs in the catchment. We will link to two different rain gages in this example.
Note: 'Gage' is the American spelling of 'Gauge' in Oxford English.

  1. In the QGIS Layers Panel, select (left click) Hydrology--Raingages and toggle on editing.
  2. Right click Hydrology--Raingages and select 'Open Attribute Table'.
  3. Click 'Add Feature' twice. Enter the following attributes (leave all other fields as NULL):
    Name Form Intevl SnowCatchDeficiency Format Tseries
    RF_G1 Volume 0.1 1 TIMESERIES RF_FC04
    RF_G2 Volume 0.1 1 TIMESERIES RF_FC07

    For a summary of the attributes associated with Hydrology--Raingages, refer to TUFLOW 2023-03-AD Release Notes (Table A.11) and the SWMM5 Reference Manual - Volume 1 (Hydrology).
    Note, the spatial locations where the gage information is applied is covered in the following section.

  4. Turn off editing and save the information.


Update SWMM Hydrology Subcatchments

The information within Hydrology--Subcatchments defines the subcatchment parameters (including catchment area, width, slope, percent impervious, outlet specification and infiltration details). All required data entries have been pre-filled in the supplied dataset except the 'Area' information, which we will determine using QGIS. SWMM requires the hydrology subcatchment area information in hectares.

  1. In the QGIS Layers Panel, select (left click) Hydrology--Subcatchments and toggle on editing.
  2. Right click Hydrology--Subcatchments and select 'Open Attribute Table'.
  3. Choose 'Area' as the target field and type the calculation expression, 'area($geometry) / 10000'.
    • 'area($geometry) ': Extracts the area of each region (subcatchment) in Hydrology--Subcatchments.
    • '/ 10000': Converts the area values into hectares.
    Note: The projection used in these tutorials is measured in meters. Thus, when QGIS extracts the area from a region, it reports the area in m2. If using a projection that is measured in feet, QGIS would extract the area in ft2.
  4. Click 'Update All'.
  5. Turn off editing and save the information.
  6. Inspect the attribute information within Hydrology--Subcatchments to familiarize yourself with the data. A few demonstration features have been included in the dataset.
    • Two rainfall gages are linked to the subcatchments. Downstream subcatchments linked to rain gage 'RF_G1'. Upstream subcatchments are linked to rain gage 'RF_G2'.
    • Subcatchments 'SPit11A' and 'SPit11A' are being routed to subcatchment 'SPit11C' before entering the SWMM pipe network. All other hydrology subcatchments route directly to a SWMM Node--Junctions.
    For a summary of the attributes associated with the layer, refer to TUFLOW 2023-03-AD Release Notes (Table A.38) and the SWMM5 Reference Manual - Volume 1 (Hydrology).


SWMM Options

SWMM Project--Options defines the SWMM simulation controls, such as hydrology computation timestep. Project--Options are not required in the new GeoPackage database we are creating for this Tutorial. This is because this model will be constructed from multiple SWMM input (INP) files:

  • sw01_001.inp (road culverts).
  • sw03_001.inp (underground pipe network inputs and SWMM hydrology).

When TUFLOW processes SWMM inputs, it combines the multiple INP files into one single INP prior to simulation. For this model, the simulation control parameters defined in Module 1 (sw01_001 > Project--Options) will apply. The options relevant to this tutorial that have already been defined in the Module 1 input include:

  • flow_units: set to metric.
  • infiltration method: set to Green Ampt.

We need to change the SWMM hydrology timestep details. Updating this setting in the sw01_001.inp does not impact any of the previous tutorial modules, as they did not include any hydrology components.

  1. In the QGIS Layers Panel, open the TS02_001.tscf group and select (left click) sw01_001 >> Project--Options and toggle on editing.
  2. Right click Project--Options and select 'Open Attribute Table'.
  3. Update the following hydrology timestep options:
    • WET_STEP: 00:01:00
    • DRY_STEP: 00:01:00
  4. Turn off editing to save the edits.


Export SWMM INP File

We will now create a new INP file for the pipe network and SWMM urban hydrology inputs and update sw01_001.inp to reflect the changes made to the hydrology options above.

  1. In the QGIS Layers Panel, right click Hydrology--Subcatchments (or any other SWMM layer in the same GeoPackage) and select 'TUFLOW' > 'SWMM - Export inp file'.
  2. This will open the 'GeoPackage - Write to SWMM inp' processing tool, prepopulated with the filename of the layer's GeoPackage.
    Note: This tool can also be activated from the Processing Toolbox.
  3. Click 'Run'.
  4. Once the tool is finished, update the 'GeoPackage Input File' parameter. Click '...', and navigate to the TUFLOW\model\gis folder. Select sw01_001.gpkg.
  5. Click 'Run'.
  6. Once the tool is finished, click 'Close'.
  7. This tool will save the SWMM inp files in the same folder location and with the same name as the GeoPackage input file. In this case, it will save sw03_001.inp and sw01_001.inp to the TUFLOW\model\swmm folder.


TUFLOW GIS Updates

We will be reverting the TUFLOW model back to a configuration that uses inflows from an external hydrology model (as per Module 1), instead of 2D direct rainfall (Module 2), in the areas not covered by SWMM urban hydrology. Instead of reusing the input from Module 1, we will need to use a new TUFLOW source area inflow layer. This will ensure that we do not double count the flow generated over the area now represented by SWMM.

  1. Click on the ‘Import Empty File’ symbol from the TUFLOW plugin toolbar.
    Tuflow plugin import empty file.png

  2. Select '2d_sa' from the Empty Type list.
  3. In the Run ID box write 'TS03_001'.
  4. Tick the 'Regions' Geometry Type.
  5. In the Spatial Database Options, select 'All to one'. Navigate to the TUFLOW_SWMM_Module_03\TUFLOW\model\gis folder and select TS03_001.gpkg. Click Save and hit 'OK'.
  6. The 2d_sa_TS03_001_R appears in the QGIS Layers Panel.

    TS3 import empty 2d sa 01a.png

  7. In Windows File Explorer, navigate to the TUFLOW_SWMM_Module_03\Tutorial_Data folder. Drag and drop the Urban_Hydrology.gpkg into QGIS.
  8. When prompted by QGIS, select TUFLOW_Subcatchments. Click 'Add Layers'.
  9. In the QGIS Layers Panel, select (left click) the TUFLOW_Subcatchments layer.
  10. Use the 'Select Features' tool to highlight the four regions included in TUFLOW_Subcatchments.
  11. Select 'Edit' from the top QGIS tab and 'Copy Features' from the drop down menu.
  12. In the QGIS Layers Panel, select (left click) the 2d_sa_TS03_001_R layer.
  13. Make the 2d_sa_TS03_001_R layer editable by clicking the 'Toggle Editing' symbol Toggle editing icon.png.
  14. Select 'Edit' from the top QGIS tab and click 'Paste Features' from the drop down menu.
  15. Toggle off editing to save the edits.
  16. Remove Urban_Hydrology.gpkg.
    The polygon entry we have updated refers to a new subcatchment name for the region adjacent to the SWMM subcatchments. The new name is 'FC06.62', instead of 'FC06'. When we update the TUFLOW Control files we will configure the file references so we are sourcing data from a new flow file obtained from an external hydrology model that has been updated with the reduced catchment area, in recognition of SWMM being used for the flow estimate in the proposed urban development area.
    Note: Common hydrology software used in combination with TUFLOW by modelers include: HEC-HMS, RORB, Drains, WBNM, URBS and more.


TUFLOW Boundary Updates

As a result of the changes made to the TUFLOW inflows, new TUFLOW Boundary Condition csv files are also needed. Updated files have been provided in the TUFLOW_SWMM_Module_03\Tutorial_Data folder. These files provide the values and model linkages to the new hydrology inflows, which include the 'FC06.62' entry.

  1. Copy bc_dbase_TS03_001.csv and TS03_01p2hr.csv from the TUFLOW_SWMM_Module_03\Tutorial_Data folder to the TUFLOW_SWMM_Module_03\TUFLOW\bc_dbase folder.


Simulation Control Files

To avoid the potential risk of overwriting existing control files accidentally, we will start by saving new control files where we will be making subsequent syntax updates during the following steps.

  1. Open TS02_5m_001.tcf in a Text Editor (Notepad++ is recommended). Save the file as TS03_5m_001.tcf in the TUFLOW_SWMM_Module_03\TUFLOW\runs folder.
  2. Using the 'Open File' function in Notepad++:
    • Open TS02_001.tbc, and save the file as TS03_001.tbc in the TUFLOW\model folder.
    • Open TS02_001.tscf, and save the file as TS03_001.tscf in the TUFLOW\model folder.

TUFLOW Control File (TCF)

  1. Edit TS03_5m_001.tcf by making the following reference updates:
    Spatial Database == ..\model\gis\TS03_001.gpkg ! Specify the location of the GeoPackage Spatial Database
    BC Control File == ..\model\TS03_001.tbc ! Reference the TUFLOW Boundary Condition Control File
    BC Database == ..\bc_dbase\bc_dbase_TS03_001.csv ! Reference the Boundary Condition Database
    SWMM Control File == ..\model\TS03_001.tscf ! Reference the SWMM (1D) Control File
  2. Add the following command to the 'Time Control' section. This command is necessary for many TUFLOW-SWMM models, especially when using SWMM hydrology. The 2D timestep dictates the SWMM 1D timestep. Generally, this timestep is adequate for SWMM but in cases where the flows are contained in the 1D, the timestep may become too large for SWMM. This command forces it into the appropriate range. If this command is neglected, some models will experience very high mass errors. The range of timesteps used is reported in the SWMM .rpt file (TS03_5m_001_swmm.rpt) in the TUFLOW\results folder.
    Timestep Maximum == 3 ! Specifies a maximum timestep of 3 seconds
  3. Comment out the 'Map Cuttoff Depth' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).
    ! Map Cutoff Depth == 0.05


TUFLOW Boundary Control File (TBC)

  1. Edit TS03_001.tbc.
  2. Comment out the 'Global Rainfall BC' command by placing a '!' at the beginning of the line. This command is only necessary for 2D direct rainfall (rain on grid) modelling (SWMM Tutorial 2).
    ! Global Rainfall BC == RF_FC04
  3. Add the following additional command:
    Read GIS SA == 2d_sa_TS03_001_R ! Reads in 2D source area - Excluding SWMM areas


TUFLOW SWMM Control File (TSCF)

  1. Edit TS03_001.tscf.
  2. Replace Read SWMM == swmm\sw02_001.inp with the following command:
    Read SWMM == swmm\sw03_001.inp
  3. As we are pushing flows from the subcatchments straight to the pipe network, the water level of the ponded water at the nodes can become much higher than the 2D water levels. The inlet will surcharge but the flow is throttled. The following command will pull water out of the 2D if the 1D ponded water level goes beyond 0.1 m higher than the 2D (not needed for rain on grid simulations). Add the following command:
    Maximum Inlet Ponded Depth == 0.1 ! Pull ponded water out of the 1D domain as needed
  4. Add the following command:
    Read BC Timeseries == RF_FC04 | RF_FC07 ! TUFLOW BC Database / SWMM Rain Gage Linkage


Running the Simulation

  1. Save a copy of _run_TS02_HPC.bat as _run_TS03_HPC.bat in the TUFLOW_SWMM_Module_03\TUFLOW\runs folder.
  2. Update the batch file to reference the TS03_5m_001.tcf :
    set exe="..\..\..\exe\2023-03-AF\TUFLOW_iSP_w64.exe"
    set run=start "TUFLOW" /wait %exe% -b
    %run% TS03_5m_001.tcf
  3. Save the batch file and double click it in Windows File Explorer to run the simulation.
  4. Did your TUFLOW-SWMM model fail to run successfully? If so, here is a link to a troubleshooting guide: TUFLOW SWMM Troubleshooting.



Check Files

Review the SWMM INP and simulation report file from the TUFLOW_SWMM_Module_03\TUFLOW\results folder to confirm the new hydrology inputs are being processed correctly:

  • View TS03_5m_001_swmm.inp in a text editor to confirm the combining of the two input INP files has occurred correctly. Also use the QGIS Processing tool, GeoPackage - Create from SWMM inp , to view the information in QGIS.
  • View TS03_5m_001_swmm_curves.inp in a text editor to confirm the rainfall time series that has been used by the SWMM hydrology engine matches the input dataset.
  • View TS03_5m_001_swmm.rpt in a text editor to confirm the model computation is healthy in term of mass conservation.

Results Output

Complete the steps outlined in following link to review the simulation results from the TUFLOW SWMM model simulation:

TUFLOW SWMM Tutorial 03 Results

Conclusion

  • EPA SWMM urban hydrology was added to the model (replacing 2D drect rainfall / rain-on-grid).
  • The 1D SWMM pipe urban pipe network junction attributes were updated to accomodate for the change in model configuration, from 2D direct rainfall to 1D SWMM hydrology.
  • Check and result files associated with the SWMM hydrology modelling were inspected.

Other TUFLOW SWMM Tutorials


Up
Go-up.png Return to TUFLOW SWMM Tutorial Introduction Main Page
Retrieved from "https://wiki.tuflow.com/w/index.php?title=TUFLOW_SWMM_Tutorial_M03&oldid=41020"