108 Commits

Author SHA1 Message Date
Stefan Ceriu
dc85cb10ed Stop running and publishing performance metrics to gh-pages 2024-09-05 13:49:56 +03:00
renovate[bot]
c132f67913 Update GitHub Actions 2024-09-03 18:21:22 +03:00
Stefan Ceriu
c73a60dca7 Revert "Update GitHub Actions"
This reverts commit a6cdbc3329d68021849342c059cc928a503c20b1.
2024-09-03 18:14:28 +03:00
renovate[bot]
a6cdbc3329 Update GitHub Actions 2024-09-03 15:50:57 +03:00
Doug
aa71f10b40
Run the integration tests on GitHub again. (#3052) 2024-07-17 10:16:43 +01:00
Doug
c92c6a28ae
Upgrade the project to use Xcode 15.4 (#3027)
* Update snapshots for Xcode 15.4

* Update CI.

* Fix crashing UI test.

* Fix compile error in Integration Tests.

* Try putting UI tests on GH runners again.
2024-07-11 17:38:32 +01:00
Doug
1178561853
Setup unit tests for Enterprise. (#2984)
* Fix Analytics on Enterprise.
2024-07-01 12:34:47 +01:00
Doug
5b58ea30f6
Add changelog labels to PRs from Localazy and Renovate. (#2981) 2024-06-27 15:50:41 +01:00
Doug
152ecc6f9c
Trigger a Danger run when labelling a PR too. (#2972) 2024-06-27 11:33:47 +01:00
Doug
82823c94ce
Replace Towncrier with GitHub releases + labels. (#2966)
* Set up GitHub generated release notes.

* Remove Towncrier from the release script.

* Add changelog failures for Labels with Danger and stop requesting a changelog file.

* Update changelog documentation.
2024-06-25 11:07:01 +00:00
renovate[bot]
8c68968e5b Update apple-actions/import-codesign-certs action to v3 2024-05-20 14:34:00 +01:00
renovate[bot]
3b82ce8def Update NejcZdovc/comment-pr action to v2 2024-05-20 12:48:15 +01:00
renovate[bot]
00f04df6c1 Update dependency macos to v14 2024-05-20 12:21:42 +01:00
renovate[bot]
19a8f60976 Update actions/upload-artifact action to v4 2024-05-20 11:19:12 +01:00
renovate[bot]
1ef3cbc5b9 Update peter-evans/create-pull-request action to v6 2024-05-20 11:16:59 +01:00
renovate[bot]
f197368dba Update actions/checkout action to v4 2024-05-20 11:14:18 +01:00
renovate[bot]
7d5d150d26 Update actions/cache action to v4 2024-05-20 11:11:46 +01:00
manuroe
a3ec0b8505
Codecov: Add token for codecov-action@v3 to fix coverage report (#2727)
Moving to v4 is blocked because of a fundamental issue with https://github.com/codecov/codecov-action/issues/1279 on our mac runners and because the reported coverage is [decreasing with v4](https://app.codecov.io/gh/element-hq/element-x-ios/pull/2719/flags)
2024-04-22 14:59:51 +02:00
Stefan Ceriu
48b06519f9 Replace deprecated danger-swift-with-swiftlint docker image 2024-04-15 10:43:17 +03:00
Stefan Ceriu
0fc0ad101e Remove the unit tests derived data caching step 2024-04-09 18:18:11 +03:00
Stefan Ceriu
98af0ae169
UI test shenanigans (#2611)
* Hardcode Xcode 15.2 as there are multiple versions available on the performance runner

* Remove the derived data caching step as it's not necessary on the performance runner.
2024-03-27 14:10:20 +02:00
Stefan Ceriu
92eaa7075a
UI test cleanup (#2598)
* Stop running the UI tests on the double localized pseudolanguage

* Fix UI tests signalling comms problem because the json key ordering wasn't defined and the messages wouldn't match.

* Remove UI tests that are now the same as preview tests (i.e. non flow based, only screen based), fixed the rest so they run on iOS 17.2, the iPhone 15 and iPad 10th gen simulators.

* Remove unnecessary gitignore instructions, change UI test snapshot naming convention to be more similar to the unit test ones

* Enable derived data and spm checkout caching for UI tests

* Switch UI tests back to the perf-only runner, moved the integration tests to the iPhone 15 Pro simulator.

* Address PR comments
2024-03-25 17:34:11 +02:00
Stefan Ceriu
bc869e7a40 Remove unnecessary ref from lfs checkout, switch to only using the major version 2024-03-25 12:30:10 +02:00
Stefan Ceriu
d65199a614 Cache Xcode derived data and SPM packages for unit tests 2024-03-25 12:30:10 +02:00
Stefan Ceriu
a64631270a Revert "Revert "Switch the UI tests to the github macos-14 runner""
This reverts commit 7903472e9b898c0eb652b7d7936339494fcac122.
2024-03-25 10:58:26 +02:00
Stefan Ceriu
83f5ae9192
Prefire multiple devices (#2543)
* Update Prefire, setup multiple snapshot devices and languages
Squashed commits:
[28cb4ae6d] Switch to macos-14, iOS 17 and the iPhone 15 simulator
[080fc82cb] Update snapshots
[c874ca9c7] Bump Compound and Prefire, reduce perceptual precission to 0.98
[a59b8a54c] Update snapshots after adding iPad and pseudolanguage snapshotting
[f30cc3277] Setup multi-language snapshotting
[aeb11c7e7] Update prefire template, setup multiple snapshot devices

* Update ruby dependencies and fastlane plugins

* Bump Compound, switch back to the original prefire - version 2.0.4

* Remove preview test simulator version specifiers
2024-03-12 13:08:54 +02:00
Doug
b0f109a023 Only install imagemagick when needed.
Workaround for issues installing python from brew on a runner right now.
2024-03-11 12:16:09 +00:00
Doug
b54d87efd5
Zip results from Unit Test failures (#2542)
* Zip uploaded unit test results on failure.

Add a failure to test.

Revert "Add a failure to test."
2024-03-07 18:55:02 +00:00
Doug
5f0c782ce2
Use xcresultparser in all workflows. (#2510)
* Fix integration tests.
2024-02-28 18:01:20 +00:00
Doug
a3b3aa8517
Move PreviewTests into their own scheme. (#2492)
* Use xcresultparser for coverage as there are 2 schemes now.
2024-02-22 15:13:52 +00:00
Mauro
6f0dd83b1e
improved workflow (#2488) 2024-02-20 13:05:31 +01:00
Doug
a64ad5ddf6
Add issue template for a new Task. 2024-01-19 11:37:45 +00:00
Stefan Ceriu
756b96f7ff
Translation workflow fix (#2271)
* Setup the translations workflow through ci_scripts
2023-12-19 19:50:04 +02:00
Doug
09b276d94b
Update most references of vector-im to element-hq (#2231)
Sonarcloud and codecov will follow in a later PR when confirmed working. Changelog ignored as it isn't particularly important with the redirect.
2023-12-12 14:34:44 +00:00
Doug
d03c97a02a
Switch to Xcode 15 (with the iOS 16.4 Simulator for tests still) (#2113)
* Use Xcode 15 in GitHub actions.

Use iOS 16.4 simulators from Xcode 14 as iOS 17.0.1 simulators are **super** slow.

* Fix failing preview snapshots.

Snapshot fix.

* Improve setup

* Regenerate snapshots that had a conflict.

---------

Co-authored-by: Alfonso Grillo <alfogrillo@gmail.com>
2023-11-21 16:25:18 +00:00
Mauro
341b177e23
Prefire basic implementation (#1743)
* prefire basic implementation

force the unit tests to run on iPhone 14

skipping plugin validation

archive artifacts

better workflow

removed the OS restriction

lfs

custom stencil

new test file

deleting

* git lfs

* lfs

* test

* customised the stencil to support our internal protocol

* for now we can remove the OS check from the stencil

* added a delay

* tests have been moved

* improvement

* recommit

* perceptual precision lowered

* updated snapshot testing and selected also iOS version

* added ios version control
2023-09-20 14:07:18 +02:00
Stefan Ceriu
63d90eeb3e Speed up unit tests by removing artifacts uploading (they're slow and we're not really using them) 2023-08-24 15:10:49 +03:00
Doug
dff18d7851
UI Tests fixes. (#1322)
* Fix broken UI tests and update snapshots.

* Tweak workflow.

* Update schedule and zip the result bundle.
2023-07-13 16:10:41 +01:00
Michael Kaye
448db8a8e9
Disabling automatic cancellation as it is affecting testing. (#1271) 2023-07-07 09:56:29 +01:00
Kat Gerasimova
eecf3234a2 Simplify automation for incoming issues
Use the modern helper actions now that they're available
2023-06-30 11:54:40 +03:00
Kat Gerasimova
3b114c28d6 Stop assigning new issues to Volker
Volker doesn't want to be assigned to all new issues any more
2023-06-29 14:05:34 +03:00
Michael Kaye
28d241d39b
Stop asserting integration test run time & move to performance testing runner. (#1132)
* Stop asserting integration test run time.
* Move integration testing to the perf runner.
2023-06-23 13:44:33 +01:00
Stefan Ceriu
4eb9ae7db6 Fixes #1123 - Cached LFS checkout 2023-06-22 07:52:18 +03:00
Michael Kaye
e8caacc85c
Parse output from IntegrationTests performance metrics (#1054)
* Parse output and leave as CSV on disk for later usage.
* Minor tweaks to step & file names

Co-authored-by: Stefan Ceriu <stefanc@matrix.org>
2023-06-09 08:44:50 +00:00
Stefan Ceriu
25e2b05a4a Fix bug reporting template 2023-05-29 17:34:19 +03:00
David Haberthür
c5c066b7b2 Adapt to how version is shown in Element X 2023-05-29 11:05:41 +03:00
Kat Gerasimova
428a3581f3 Update triage automation for signoff 2023-05-26 13:42:43 +03:00
Mauro
eb68f52a0f
Run single Test on CI for faster debugging (#896)
* let's disable autocorrection

* waiting some more time in flaky tests and updated the content of a test that was failing

* controlled delay waited a bit moe for the timeline to settle

* try await

* trying with a bit more waiting time after the tap and a slow velocity for the swipe

* let's try waiting more time

* workflow for a single ui test

* las try

* slow swiping tests

* commenting out flaky CI tests, for now we'll just disable them

* better description

* flaky test improvement

* disabling animations that are not needed in UITests

* code that already prevents animations in UI tests

* code improv
2023-05-17 16:15:43 +00:00
Mauro
a5d555a33d
Fixing Tests for Xcode 14.3 (#888)
* settting macOS to 13, and let's runa test of... the tests

* I want the artifacts of the test, might give me some more insight in Xcode

* archive artifact

* trying a thing with the xcode version

* push notifications alert makes this test fail

* test improvement

* let's try with a very long time

* let's disable autocorrection

* sleep

* 1 seconds fixed 90% of the issue, 2 should fix 100%

* waiting some more time in flaky tests and updated the content of a test that was failing

* updated a screenshot test that had a notification

* this integration test is a bit so flaky increased the timing

* controlled delay waited a bit moe for the timeline to settle

* try await

* MainActor everywhere

* milliseconds fix

* trying with a bit more waiting time after the tap and a slow velocity for the swipe

* let's try waiting more time
2023-05-15 13:42:40 +00:00
Stefan Ceriu
3468ed2a02
Various test fixes (#873)
* Switch back to macos-12 and see if the tests work

* Fix unit tests, add default invited, joined and active member counts to the mock room proxy

* Try running UI tests on 14.3 but on an existing iPad simulator

* Revert "Try running UI tests on 14.3 but on an existing iPad simulator"

This reverts commit b075e7fa384330a9070dc35ed4dded57e0af26e1.
2023-05-11 16:28:35 +03:00