Implement remaining nn_activation ops in opperf

[connorgoggins]

Description

This PR serves to implement the remaining operators from the nn_activation category in opperf. To achieve this, I refactored the preexisting individual run_performance_test calls (for the four operators that had already been implemented) into a single generalized function call to run_op_benchmarks. I also implemented Softmax, SoftmaxActivation, softmin, and Activation ops, which are also called via the run_op_benchmarks function.

Checklist

Essentials

Please feel free to remove inapplicable items for your PR.

• Changes are complete (i.e. I finished coding on this PR)
• All changes have test coverage
• Code is well-documented
• To the best of my knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

• M benchmark/opperf/nd_operations/nn_activation_operators.py
• M benchmark/opperf/rules/default_params.py
• M benchmark/opperf/utils/op_registry_utils.py

Comments

Tested on c5.18xl & p2.16xl w/ubuntu 16.04 and Mac OS with:

1. Checkout branch and call function run_activation_operators_benchmarks - runs all activation ops on default data
2. Checkout branch and run opperf.py (full run of all ops)

[ChaiBapchya]

LGTM but pending the results

• All Opperf
• Category
  CPU & GPU

Thanks!

[connorgoggins]

Group of operator test - all NN Activation ops (CPU)
Full OpPerf test (CPU)

GPU results coming soon.

[connorgoggins]

Group of operator test - all NN Activation ops (GPU)
Full OpPerf test (GPU)

[connorgoggins]

@mxnet-label-bot add [pr-awaiting-review]

[ChaiBapchya]

Incorrect way to rebase @connorgoggins

First get your master branch updated

git remote add upstream https://github.com/apache/incubator-mxnet
git checkout master
git fetch upstream master
git merge upstream/master
git push origin master

Once your fork master is sync'ed with remote master, rebase your branch on master

git checkout <branchname>
git rebase master
git push origin <branchname>

Let me know if this works!

[access2rohit]

LGTM! Retriggered the failing builds