HSwish¶
Versioned name : HSwish-4
Category : Activation function
Short description : HSwish takes one input tensor and produces output tensor where the hard version of swish function is applied to the tensor elementwise.
Detailed description : For each element from the input tensor calculates corresponding element in the output tensor with the following formula:
\[HSwish(x) = x \cdot \frac{min(max(x + 3,\ 0),\ 6)}{6}\]
The HSwish operation is introduced in the following article.
Attributes : operation has no attributes.
Inputs :
1 : Multidimensional input tensor of type T. Required.
Outputs :
1 : The resulting tensor of the same shape and type as input tensor.
Types
T : arbitrary supported floating-point type.
Example
<layer ... type="HSwish">
<input>
<port id="0">
<dim>256</dim>
<dim>56</dim>
</port>
</input>
<output>
<port id="1">
<dim>256</dim>
<dim>56</dim>
</port>
</output>
</layer>