ARR 2019 Ensembles Processing - Revision history

Emilie Nielsen: /* Processing Batch File Tips */

2025-03-17T23:24:17Z

Processing Batch File Tips

← Older revision		Revision as of 09:24, 18 March 2025
Line 51:		Line 51:
	pause		pause
	</pre>		</pre>

			<br>
			{{Tips Navigation
			\|uplink=[[ TUFLOW_Modelling_Guidance \| Back to TUFLOW Modelling Guidance]]
			}}

Abigail.lillo: /* Introduction */

2024-06-25T23:32:08Z

Introduction

← Older revision		Revision as of 09:32, 26 June 2024
Line 1:		Line 1:
	==Introduction==		==Introduction==
	The Australian Rainfall and Runoff (ARR) ~~2016~~ guideline requires the use of ten temporal patterns for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the required number of design simulations by ten and requires additional processing compared to the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for using the latest ARR ~~2016~~ guideline ensemble approach.		The Australian Rainfall and Runoff (ARR) 2019 guideline requires the use of ten temporal patterns for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the required number of design simulations by ten and requires additional processing compared to the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for using the latest ARR 2019 guideline ensemble approach.

	==Choice of Output==		==Choice of Output==
	As the model result folder can get large in size with the additional simulations, the preferred maximum grid output format is FLT, which can be done directly from the TUFLOW simulation. FLT files are ESRI binary (float) version of the ASC files, their size is about 1/5 of an ASC file. Binary files can also be processed faster by TUFLOW utilities.<br>		As the model result folder can get large in size with the additional simulations, the preferred maximum grid output format is FLT, which can be done directly from the TUFLOW simulation. FLT files are ESRI binary (float) version of the ASC files, their size is about 1/5 of an ASC file. Binary files can also be processed faster by TUFLOW utilities.<br>

Abigail.lillo: Abigail.lillo moved page ARR 2016 Ensembles Processing to ARR 2019 Ensembles Processing

2024-06-25T23:31:47Z

Abigail.lillo moved page ARR 2016 Ensembles Processing to ARR 2019 Ensembles Processing

← Older revision		Revision as of 09:31, 26 June 2024
(No difference)

Pavlina Monhartova: /* Choice of Output */

2021-03-05T06:41:39Z

Choice of Output

← Older revision		Revision as of 16:41, 5 March 2021
Line 2:		Line 2:
	The Australian Rainfall and Runoff (ARR) 2016 guideline requires the use of ten temporal patterns for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the required number of design simulations by ten and requires additional processing compared to the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for using the latest ARR 2016 guideline ensemble approach.		The Australian Rainfall and Runoff (ARR) 2016 guideline requires the use of ten temporal patterns for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the required number of design simulations by ten and requires additional processing compared to the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for using the latest ARR 2016 guideline ensemble approach.
	==Choice of Output==		==Choice of Output==
	As the model result folder can get large in size with the additional simulations, the preferred maximum grid output format is FLT, which can be done directly from the TUFLOW simulation. FLT files are ESRI binary (float) version of the ASC files~~. Their~~ their size is about 1/5 of an ASC file. Binary files can also be processed faster by TUFLOW utilities.<br>		As the model result folder can get large in size with the additional simulations, the preferred maximum grid output format is FLT, which can be done directly from the TUFLOW simulation. FLT files are ESRI binary (float) version of the ASC files, their size is about 1/5 of an ASC file. Binary files can also be processed faster by TUFLOW utilities.<br>
	Commands in the TCF:<br>		Commands in the TCF:<br>
	:<font color="blue"><tt>Map Output Format </tt></font> <font color="red"><tt>== </tt></font><tt>FLT</tt><br>		:<font color="blue"><tt>Map Output Format </tt></font> <font color="red"><tt>== </tt></font><tt>FLT</tt><br>

Chris Huxley at 04:06, 17 September 2018

2018-09-17T04:06:05Z

← Older revision		Revision as of 14:06, 17 September 2018
Line 1:		Line 1:
	==Introduction==		==Introduction==
	The ARR 2016 ~~guidelines~~ ~~require~~ the use of ten temporal patterns ~~to be applied~~ for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the number of design simulations by ten and requires additional processing in ~~comparison with~~ the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for the latest ARR 2016 ~~guidelines~~.		The Australian Rainfall and Runoff (ARR) 2016 guideline requires the use of ten temporal patterns for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the required number of design simulations by ten and requires additional processing compared to the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for using the latest ARR 2016 guideline ensemble approach.
	==Choice of Output==		==Choice of Output==
	As the model result folder can get large in size with the additional simulations, the preferred ~~method of~~ maximum grid output is ~~to use~~ FLT, which can be done directly from the TUFLOW simulation. FLT files are ESRI binary (float) version of the ASC files ~~and~~ their size is about 1/5 of an ASC file. Binary files can also be processed faster by TUFLOW utilities.<br>		As the model result folder can get large in size with the additional simulations, the preferred maximum grid output format is FLT, which can be done directly from the TUFLOW simulation. FLT files are ESRI binary (float) version of the ASC files. Their their size is about 1/5 of an ASC file. Binary files can also be processed faster by TUFLOW utilities.<br>
	Commands in the TCF:<br>		Commands in the TCF:<br>
	:<font color="blue"><tt>Map Output Format </tt></font> <font color="red"><tt>== </tt></font><tt>FLT</tt><br>		:<font color="blue"><tt>Map Output Format </tt></font> <font color="red"><tt>== </tt></font><tt>FLT</tt><br>
	:<font color="blue"><tt>Map Output Date Types </tt></font> <font color="red"><tt>== </tt></font><tt>h, d, V</tt><br>		:<font color="blue"><tt>Map Output Date Types </tt></font> <font color="red"><tt>== </tt></font><tt>h, d, V</tt><br>
	:<font color="blue"><tt>FLT Map Output Interval </tt></font> <font color="red"><tt>== </tt></font><tt>0</tt><br>		:<font color="blue"><tt>FLT Map Output Interval </tt></font> <font color="red"><tt>== </tt></font><tt>0</tt><br>
	If using only time-series outputs (xmdf, dat) an extra step will be required to ~~export~~ maximum grids (FLT or ASC) ~~with~~ TUFLOW_to_GIS utility.		If using only time-series outputs (xmdf, dat) an extra step will be required to create these maximum grids (FLT or ASC). This can be done using TUFLOW_to_GIS utility.

	==Median==		==Median==
	Use <u>[https://wiki.tuflow.com/index.php?title=ASC_to_ASC#.22-statMedian.22 ASC_to_ASC utility (-statMedian switch)]</u> to create median of required ~~values~~ (water level, depth, velocity, hazard, ...) for each AEP and storm duration combination.		Use <u>[https://wiki.tuflow.com/index.php?title=ASC_to_ASC#.22-statMedian.22 ASC_to_ASC utility (-statMedian switch)]</u> to create the median result of required output (water level, depth, velocity, hazard, ...) for each AEP and storm duration combination.

	==Maximums==		==Maximums==
	Use <u>[https://wiki.tuflow.com/index.php?title=ASC_to_ASC#Maximum ASC_to_ASC utility (-max switch)]</u> to create maximum envelope of the median results for each AEP.		Use <u>[https://wiki.tuflow.com/index.php?title=ASC_to_ASC#Maximum ASC_to_ASC utility (-max switch)]</u> to create the maximum envelope of the median results for each AEP.
	==Processing Batch File Tips==		==Processing Batch File Tips==
	*~~Batch~~ file is recommended to be ~~located~~ in the same folder as the result files. This will enable the use of relative path for the input and output files to make the command shorter.<br>		*The location of the batch file is recommended to be in the same folder as the result files. This will enable the use of relative path for the input and output files to make the command syntax shorter.<br>
	:<u>Example:</u><br>		:<u>Example:</u><br>
	:This method would be preferable:<br>		:This method would be preferable:<br>

Pavlina Monhartova: Pavlina Monhartova moved page 2016 ARR Ensembles Processing to ARR 2016 Ensembles Processing

2018-09-17T03:05:42Z

Pavlina Monhartova moved page 2016 ARR Ensembles Processing to ARR 2016 Ensembles Processing

← Older revision		Revision as of 13:05, 17 September 2018
(No difference)

Pavlina Monhartova at 02:54, 17 September 2018

2018-09-17T02:54:52Z

← Older revision		Revision as of 12:54, 17 September 2018
Line 1:		Line 1:
	<span style="color:#FF0000">
	<font size = 18>Page Under Construction</font>
	</span>

	==Introduction==		==Introduction==
	The ARR 2016 guidelines require the use of ten temporal patterns to be applied for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the number of design simulations by ten and requires additional processing in comparison with the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for the latest ARR 2016 guidelines.		The ARR 2016 guidelines require the use of ten temporal patterns to be applied for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the number of design simulations by ten and requires additional processing in comparison with the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for the latest ARR 2016 guidelines.

Pavlina Monhartova: /* Median */

2018-09-17T02:52:30Z

Median

← Older revision		Revision as of 12:52, 17 September 2018
Line 14:		Line 14:

	==Median==		==Median==
	Use <u>[https://wiki.tuflow.com/index.php?title=ASC_to_ASC#.22-statMedian.22 ASC_to_ASC utility (-statMedian switch)]</u> to create median of required values (water level, depth, velocity, hazard, ...) for each ~~storm duration~~ and ~~each~~ ~~AEP~~.		Use <u>[https://wiki.tuflow.com/index.php?title=ASC_to_ASC#.22-statMedian.22 ASC_to_ASC utility (-statMedian switch)]</u> to create median of required values (water level, depth, velocity, hazard, ...) for each AEP and storm duration combination.

	==Maximums==		==Maximums==

Pavlina Monhartova at 01:40, 17 September 2018

2018-09-17T01:40:55Z

← Older revision		Revision as of 11:40, 17 September 2018
Line 3:		Line 3:
	</span>		</span>

	This page summarizes recommended approach for processing a large amount of ARR 2016 ensembles.
	==Introduction==		==Introduction==
	The ARR 2016 guidelines require the use of ten temporal patterns to be applied for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the number of design simulations by ten and requires additional processing in comparison with the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for the latest ARR 2016 guidelines.		The ARR 2016 guidelines require the use of ten temporal patterns to be applied for each design Annual Exceedance Probability (AEP) and storm duration combination. This multiplies the number of design simulations by ten and requires additional processing in comparison with the previous approach recommended in ARR 1987. As a consequence, the model result folders can get very large and the post processing of the results can be time intensive. The below page provides recommendations to minimise the effort and footprint of running TUFLOW for the latest ARR 2016 guidelines.

Ellis Symons: /* Processing Batch File Tips */

2018-09-14T06:18:15Z

Processing Batch File Tips

← Older revision		Revision as of 16:18, 14 September 2018
Line 22:		Line 22:
	*Batch file is recommended to be located in the same folder as the result files. This will enable the use of relative path for the input and output files to make the command shorter.<br>		*Batch file is recommended to be located in the same folder as the result files. This will enable the use of relative path for the input and output files to make the command shorter.<br>
	:<u>Example:</u><br>		:<u>Example:</u><br>
	:This method would be ~~preferred~~:		:This method would be preferable:<br>
	:<tt>"C:\TUFLOW\Utilities\asc_to_asc_w64.exe" -b -out ARR_Max.flt -max ARR_060m.flt ARR_120m.flt</tt><br>		:<tt>"C:\TUFLOW\Utilities\asc_to_asc_w64.exe" -b -out ARR_Max.flt -max ARR_060m.flt ARR_120m.flt</tt><br>
	:Instead of this method:<br>		:Instead of this method:<br>
Line 28:		Line 28:
	A wild card () can be used to avoid typing all the file names. Instead ASC_to_ASC utility will automatically read all the files with the same start and end of the filename.<br>		A wild card () can be used to avoid typing all the file names. Instead ASC_to_ASC utility will automatically read all the files with the same start and end of the filename.<br>
	:<u>Example:</u><br>		:<u>Example:</u><br>
			:This method would be preferable:<br>
	:<tt>"C:\TUFLOW\Utilities\asc_to_asc_w64.exe" -b -out ARR_Max.flt -max ARR_*.flt</tt><br>		:<tt>"C:\TUFLOW\Utilities\asc_to_asc_w64.exe" -b -out ARR_Max.flt -max ARR_*.flt</tt><br>
	:Instead:<br>		:Instead of this method:<br>
	:<tt>"C:\TUFLOW\Utilities\asc_to_asc_w64.exe" -b -out ARR_Max.flt -max ARR_060m.flt ARR_120m.flt ARR_180m.flt ARR_240m.flt ARR_300m.flt ARR_360m.flt</tt><br>		:<tt>"C:\TUFLOW\Utilities\asc_to_asc_w64.exe" -b -out ARR_Max.flt -max ARR_060m.flt ARR_120m.flt ARR_180m.flt ARR_240m.flt ARR_300m.flt ARR_360m.flt</tt><br>
	*Looping through variables in a batch file can also be used to make the processing more efficient. Example of such batch file is below:<br>		*Looping through variables in a batch file can also be used to make the processing more efficient. Example of such batch file is below:<br>