Kaspresso is a great framework for UI testing. Based on Espresso and UI Automator, Kaspresso provides a wide range of additional amazing features, such as:
- 100% stability, no flakiness.
- Jetpack Compose support [Early access].
- Significantly faster execution of UI Automator commands. With Kaspresso, some UI Automator commands run 10 times faster!
- Excellent readability due to human DSL.
- Incredible mechanism of interceptors that allows you to catch all actions and assertions in one place.
- Full logging.
- Ability to call ADB commands.
- UI tests writing philosophy, implemented with DSL.
- Features screenshotting.
- Robolectric support.
- Allure support.
And many more!
We like the syntax that Kakao applies to write UI tests. This wrapper over Espresso uses the Kotlin DSL approach, that makes the code significantly shorter and more readable. See the difference:
Espresso:
@Test
fun testFirstFeature() {
onView(withId(R.id.toFirstFeature))
.check(ViewAssertions.matches(
ViewMatchers.withEffectiveVisibility(
ViewMatchers.Visibility.VISIBLE)))
onView(withId(R.id.toFirstFeature)).perform(click())
}
Kakao:
@Test
fun testFirstFeature() {
mainScreen {
toFirstFeatureButton {
isVisible()
click()
}
}
}
We used the same approach to develop our own wrapper over UI Automator, and we called it Kautomator. Take a look at the code below:
UI Automator:
val instrumentation: Instrumentation = InstrumentationRegistry.getInstrumentation()
val uiDevice = UiDevice.getInstance(instrumentation)
val uiObject = uiDevice.wait(
Until.findObject(
By.res(
"com.kaspersky.kaspresso.sample_kautomator",
"editText"
)
),
2_000
)
uiObject.text = "Kaspresso"
assertEquals(uiObject.text, "Kaspresso")
Kautomator:
MainScreen {
simpleEditText {
replaceText("Kaspresso")
hasText("Kaspresso")
}
}
Since Kakao and Kautomator provide almost identical APIs, you don’t have to care about what is under the hood of your tests, either Espresso or UI Automator. With Kaspresso, you write the same tests for both.
Read about Kakao and Kautomator in details.
However, Kakao and Kautomator themselves don't help you to see the relation between the test and the corresponding test case. Also, a long test often becomes a giant piece of code that is impossible to split into smaller parts. That's why we have created an additional Kotlin DSL that allows you to read your test more easily.
See the example below:
@Test
fun shouldPassOnNoInternetScanTest() =
beforeTest {
// some things with the state
}.afterTest {
// some things with the state
}.run {
step("Open Simple Screen") {
MainScreen {
nextButton {
isVisible()
click()
}
}
}
step("Click button_1 and check button_2") {
SimpleScreen {
button1 {
click()
}
button2 {
isVisible()
}
}
}
step("Click button_2 and check edit") {
SimpleScreen {
button2 {
click()
}
edit {
flakySafely(timeoutMs = 7000) { isVisible() }
hasText(R.string.text_edit_text)
}
}
}
step("Check all possibilities of edit") {
scenario(
CheckEditScenario()
)
}
}
Sometimes your UI test passes ten times, then breaks on the eleventh attempt for some mysterious reason. It’s called flakiness.
The most popular reason for flakiness is the instability of the UI tests libraries, such as Espresso and UI Automator. To eliminate this instability, Kaspresso uses DSL wrappers and interceptors.
Also, some Kaspresso features can help you resolve a lot of typical problems in UI testing.
Let’s watch some short video that shows the difference between the original UI Automator (on the right) and the accelerated one (on the left).
Here is a short explanation of why it is possible.
We developed Kaspresso behavior interceptors on the base of Kakao/Kautomator Interceptors to catch failures.
Thanks to interceptors, you can do a lot of useful things, such as:
- add custom actions to each library operation like writing a log or taking a screenshot;
- overcome flaky library operations by re-running failed actions, scrolling the parent layout or removing the android system dialog;
and many more (see the manual).
Kaspresso writes its own logs, detailed and readable:
Espresso and UI Automator don't allow to call ADB commands from inside a test. To fix this problem, we developed Autotest AdbServer (see the wiki).
You can use Kaspresso classes to work with Android System.
For example, with the Device
class you can:
- push/pull files,
- enable/disable network,
- give permissions like a user does,
- emulate phone calls,
- take screenshots,
- enable/disable GPS,
- set geolocation,
- enable/disable accessibility,
- change the app language,
- collect and parse the logcat output.
(see more about the Device class).
If you develop an application that is available across the world, you have to localize it into different languages. When UI is localized, it’s important for the translator to see the context of a word or a phrase, that is the specific screen.
With Kaspresso, translators can automatically take a screenshot of any screen. It’s incredibly fast, even for legacy screens, and you don't have to refactor or mock anything (see the manual).
You can tune any part of Kaspresso (read more)
You can run your UI-tests on the JVM environment. Additionally, almost all interceptors improving stability, readability and other will work. Read more.
Kaspresso can generate very detailed Allure-reports for each test: More information is available here.
Now, you can write your Kaspresso tests for Jetpack Compose screens! DSL and all principles are the same. So, you will not see any difference between tests for View screens and for Compose screens. More information is available here.
Keep in mind it's early access that may contain bugs. Also, API can be changed, but we are going to avoid it. Be free to create relative issues if you've encountered with any kind of problem.
The tool itself, even the perfect one, can not solve all the problems in writing UI tests. It’s important to know how to write tests and how to organize the entire process. Our team has great experience in introducing autotests in different companies. We shared our knowledge on writing autotests.
For all information check Kaspresso wiki
To integrate Kaspresso into your project:
- If the
mavenCentral
repository does not exist, include it to your rootbuild.gradle
file:
allprojects {
repositories {
mavenCentral()
}
}
- Add a dependency to
build.gradle
:
dependencies {
androidTestImplementation 'com.kaspersky.android-components:kaspresso:<latest_version>'
// Allure support
androidTestImplementation "com.kaspersky.android-components:kaspresso-allure-support:<latest_version>"
// Jetpack Compose support
androidTestImplementation "com.kaspersky.android-components:kaspresso-compose-support:<latest_version>"
}
If you are still using the old Android Support libraries, we strongly recommend to migrate to AndroidX.
The last version with Android Support libraries is:
dependencies {
androidTestImplementation 'com.kaspersky.android-components:kaspresso:1.0.1-support'
}
All samples are available in the samples folder.
Most of the samples require AdbServer. To start AdbServer you should do the following steps:
- Go to the
Kaspresso
folder
cd ~/Workspace/Kaspresso
- Start
adbserver-desktop.jar
java -jar artifacts/adbserver-desktop.jar
Kaspresso can use external storage to save various data about executed tests. The example of such data is screenshots, xml dumps, logs, video and anymore. But, new Android OS provides absolutely new way to work with external storage - Scoped Storage. Currently, we are working on the support of Scoped Storage. While Scoped Storage support is on the way, there is an option to request different permissions to make an access to saved data possible on any Android OS. Here, it's a detailed instruction:
- AndroidManifest.xml (in your debug build variant to keep production manifest without any changes)
# Please, add these permissions
<uses-permission android:name="android.permission.WRITE_EXTERNAL_STORAGE"/>
<uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE"/>
<uses-permission android:name="android.permission.MANAGE_EXTERNAL_STORAGE"/>
<application
# storage support for Android API 29
android:requestLegacyExternalStorage="true"
...
</application>
- Your test class:
class SampleTest : TestCase(
kaspressoBuilder = Kaspresso.Builder.simple( // simple/advanced - it doesn't matter
customize = {
// storage support for Android API 30+
if (isAndroidRuntime) {
UiDevice
.getInstance(instrumentation)
.executeShellCommand("appops set --uid ${InstrumentationRegistry.getInstrumentation().targetContext.packageName} MANAGE_EXTERNAL_STORAGE allow")
}
}
)
) {
// storage support for Android API 29-
@get:Rule
val runtimePermissionRule: GrantPermissionRule = GrantPermissionRule.grant(
Manifest.permission.WRITE_EXTERNAL_STORAGE,
Manifest.permission.READ_EXTERNAL_STORAGE
)
//...
}
Remember, it's a temporary working solution. A little bit later, Kaspresso will use external storage only through Scoped Storage and you will not be forced to request all mentioned permissions.
- We've totally reworked AdbServer and Kaspresso 1.2.0 works only with new
artifacts/adbserver-desktop.jar
The old versionartifacts/desktop_1_1_0.jar
is also available for use with older versions of Kaspresso. - If you use
device.logcat
in your tests, you should calldevice.logcat.disableChatty
in thebefore
section of your test. In previous version of Kaspresso,device.logcat.disableChatty
was called automatically during initialization. This resulted in the need to always run AdbServer before tests.
- Kaspresso migrated to a new version of Kakao which has
io.github.kakaocup.kakao
package name. Replace all imports using commandfind . -type f \( -name "*.kt" -o -name "*.java" \) -print0 | xargs -0 sed -i '' -e 's/com.agoda/io.github.kakaocup/g'
or using global replacement tool in IDE.
Kaspresso is an open source project, so you are welcome to contribute (see the Contribution Guidelines).
Kaspresso is available under the Apache License, Version 2.0.