Funnel Activation implementation question

[ghost]

Hi,

The depthwise convolution you're using in your implementation of FRelu is this
the regular depthwise convolution or a depthwise separable convolution ? (a regular depthwise conv + 1x1 pointwise conv)

thanks

[nmaac]

the regular depthwise convolution (implementation here)

[ghost]

Thank you very much!