EVOgeek
/
Vmeda.Online
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

MOBILE-3947 behat: Tag and omit failing behats due to Ionic7 migration

main
Pau Ferrer Ocaña 2023-12-13 13:01:45 +01:00
parent a2f49c5356
commit 373cf8f549
27 changed files with 61 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
.github/workflows/acceptance.yml vendored
View File

@ -6,7 +6,7 @@ on:
behat_tags:
description: 'Behat tags to execute'
required: true
default: '~@performance'
default: '~@performance&&~@ionic7_failure'
moodle_branch:
description: 'Moodle branch'
required: true
@ -27,7 +27,7 @@ jobs:
MOODLE_DOCKER_PHP_VERSION: '8.1'
MOODLE_BRANCH: ${{ github.event.inputs.moodle_branch || 'master' }}
MOODLE_REPOSITORY: ${{ github.event.inputs.moodle_repository || 'https://github.com/moodle/moodle' }}
BEHAT_TAGS: ${{ github.event.inputs.behat_tags || '~@performance' }}
BEHAT_TAGS: ${{ github.event.inputs.behat_tags || '~@performance&&~@ionic7_failure' }}
steps:
- uses: actions/checkout@v2

2
src/addons/block/timeline/tests/behat/basic_usage.feature
View File

@ -46,7 +46,7 @@ Feature: Timeline block.
| assign | C3 | assign24 | Assignment 24 | ##+1 year## |
| assign | C3 | assign25 | Assignment 25 | ##+1 year## |
@lms_from4.0
@lms_from4.0 @ionic7_failure
Scenario: See courses inside block
Given I entered the app as "student1"
Then I should find "Assignment 00" within "Timeline" "ion-card" in the app

1
src/addons/calendar/tests/behat/create_events.feature
View File

@ -20,6 +20,7 @@ Feature: Test creation of calendar events in app
| teacher1 | C1 | editingteacher |
| student1 | C1 | student |
@ionic7_failure
Scenario: Create user event as student from monthly view
Given I entered the app as "student1"
When I press "More" in the app

2
src/addons/competency/tests/behat/navigation.feature
View File

@ -297,6 +297,7 @@ Feature: Test competency navigation
Then I should find "Desserts are important" in the app
But I should not find "Cakes" in the app
@ionic7_failure
Scenario: Tablet navigation (student)
Given I entered the course "Course 1" as "student1" in the app
And I change viewport size to "1200x640" in the app
@ -382,6 +383,7 @@ Feature: Test competency navigation
Then I should find "Desserts are important" in the app
But I should not find "Cakes" in the app
@ionic7_failure
Scenario: Tablet navigation (teacher)
Given I entered the course "Course 1" as "teacher1" in the app
And I change viewport size to "1200x640" in the app

5
src/addons/messages/tests/behat/basic_usage.feature
View File

@ -19,6 +19,7 @@ Feature: Test basic usage of messages in app
| student1 | C1 | student |
| student2 | C1 | student |
@ionic7_failure
Scenario: View recent conversations and contacts
Given I entered the app as "teacher1"
When I press "Messages" in the app
@ -216,6 +217,7 @@ Feature: Test basic usage of messages in app
Then I should find "heeey student" in the app
And I should find "byee" in the app
@ionic7_failure
Scenario: Search for messages
Given I entered the app as "teacher1"
When I press "Messages" in the app
@ -280,6 +282,7 @@ Feature: Test basic usage of messages in app
Then I should find "Teacher teacher" in the app
And I should find "Student1 student1" in the app
@ionic7_failure
Scenario: User blocking feature
Given I entered the course "Course 1" as "student2" in the app
When I press "Participants" in the app
@ -317,6 +320,7 @@ Feature: Test basic usage of messages in app
Then I should find "test message" in the app
But I should not find "You are unable to message this user" in the app
@ionic7_failure
Scenario: Mute Unmute conversations
Given I entered the course "Course 1" as "student1" in the app
When I press "Participants" in the app
@ -344,6 +348,7 @@ Feature: Test basic usage of messages in app
Then I should find "test message" in the app
And I should find "Muted conversation" in the app
@ionic7_failure
Scenario: Self conversations
Given I entered the app as "student1"
When I press "Messages" in the app

1
src/addons/messages/tests/behat/navigation.feature
View File

@ -14,6 +14,7 @@ Feature: Test messages navigation in the app
| teacher | C1 | editingteacher |
| student | C1 | student |
@ionic7_failure
Scenario: Avoid recursive links to profile
Given I entered the app as "teacher"
When I press "Messages" in the app

1
src/addons/mod/assign/tests/behat/basic_usage.feature
View File

@ -58,6 +58,7 @@ Feature: Test basic usage of assignment activity in app
Then I should find "Online text submissions" in the app
And I should find "Submission test edited" in the app
@ionic7_failure
Scenario: Edit/Add submission (online text) & Add new attempt from previous submission & Submit for grading
# Submit first attempt as a student
Given I entered the assign activity "assignment1" on course "Course 1" as "student1" in the app

6
src/addons/mod/data/tests/behat/entries.feature
View File

@ -26,6 +26,7 @@ Feature: Users can manage entries in database activities
| data1 | text | URL | URL link |
| data1 | text | Description | Link description |
@ionic7_failure
Scenario: Create entry
Given I entered the data activity "Web links" on course "Course 1" as "student1" in the app
Then I should find "No entries yet" in the app
@ -37,6 +38,7 @@ Feature: Users can manage entries in database activities
Then I should find "https://moodle.org/" in the app
And I should find "Moodle community site" in the app
@ionic7_failure
Scenario: Browse entry
Given I entered the data activity "Web links" on course "Course 1" as "student1" in the app
@ -70,6 +72,7 @@ Feature: Users can manage entries in database activities
And I should find "Moodle community site" in the app
And I should find "Moodle Cloud" in the app
@ionic7_failure
Scenario: Students can not edit or delete other user's entries from list and single view in the app
Given I entered the data activity "Web links" on course "Course 1" as "student1" in the app
And I press "Add entries" in the app
@ -85,6 +88,7 @@ Feature: Users can manage entries in database activities
And "Edit" "link" should not exist
And "Delete" "link" should not exist
@ionic7_failure
Scenario: Delete entry (student) & Update entry (student)
Given I entered the data activity "Web links" on course "Course 1" as "student1" in the app
And I press "Add entries" in the app
@ -144,6 +148,7 @@ Feature: Users can manage entries in database activities
And I should not find "Moodle Cloud" in the app
And I should find "No entries yet" in the app
@ionic7_failure
Scenario: Delete entry (teacher) & Update entry (teacher)
Given I entered the data activity "Web links" on course "Course 1" as "student1" in the app
And I press "Add entries" in the app
@ -207,6 +212,7 @@ Feature: Users can manage entries in database activities
And I press "Delete" in the app
And I should not find "Moodle Cloud" in the app
@ionic7_failure
Scenario: Handle number 0 correctly when creating entries
Given the following "activities" exist:
| activity | name | intro | course | idnumber |

3
src/addons/mod/data/tests/behat/sync.feature
View File

@ -26,6 +26,7 @@ Feature: Users can store entries in database activities when offline and sync wh
| data1 | text | URL | URL link |
| data1 | text | Description | Link description |
@ionic7_failure
Scenario: Create entry (offline)
Given I entered the data activity "Web links" on course "Course 1" as "student1" in the app
And I switch network connection to offline
@ -45,6 +46,7 @@ Feature: Users can store entries in database activities when offline and sync wh
And I should find "Moodle community site" in the app
And I should not find "This Database has offline data to be synchronised" in the app
@ionic7_failure
Scenario: Update entry (offline) & Delete entry (offline)
Given I entered the data activity "Web links" on course "Course 1" as "student1" in the app
And I should find "No entries yet" in the app
@ -95,6 +97,7 @@ Feature: Users can store entries in database activities when offline and sync wh
And I should not find "Moodle Cloud" in the app
And I should not find "This Database has offline data to be synchronised" in the app
@ionic7_failure
Scenario: Students can undo deleting entries to a database in the app while offline
Given I entered the data activity "Web links" on course "Course 1" as "student1" in the app
And I should find "No entries yet" in the app

2
src/addons/mod/forum/tests/behat/basic_usage.feature
View File

@ -50,6 +50,7 @@ Feature: Test basic usage of forum activity in app
Then I should find "My happy subject" in the app
And I should find "An awesome message" inside the split-view content in the app
@ionic7_failure
Scenario: Reply a post
Given I entered the forum activity "Test forum name" on course "Course 1" as "student1" in the app
When I replace "/.*/" within ".addon-mod-forum-discussion-author p" with "[Publication date]"
@ -178,6 +179,7 @@ Feature: Test basic usage of forum activity in app
And I press "Save changes" in the app
Then I should find "Auto-test message edited" in the app
@ionic7_failure
Scenario: Delete a forum post (only online)
Given I entered the forum activity "Test forum name" on course "Course 1" as "student1" in the app
When I press "Add discussion topic" in the app

2
src/addons/mod/forum/tests/behat/groups.feature
View File

@ -105,6 +105,7 @@ Feature: Test usage of forum activity with groups in app
And I should find "Disc vis ALL" in the app
But I should not find "Disc vis G2" in the app
@ionic7_failure
Scenario: Student can only add discussions in his groups
Given I entered the forum activity "Separate groups forum" on course "Course 1" as "student1" in the app
When I press "Add discussion topic" in the app
@ -163,6 +164,7 @@ Feature: Test usage of forum activity with groups in app
And I press "All participants" in the app
Then I should find "My happy subject" in the app
@ionic7_failure
Scenario: Teacher can add discussion to any group
Given I entered the forum activity "Separate groups forum" on course "Course 1" as "teacher1" in the app
And I press "Separate groups" in the app

2
src/addons/mod/glossary/tests/behat/navigation.feature
View File

@ -211,7 +211,7 @@ Feature: Test glossary navigation
And I should find "Cashew" in the app
And I should find "Acerola" in the app
@ci_jenkins_skip
@ci_jenkins_skip @ionic7_failure
Scenario: Tablet navigation on glossary
Given I entered the course "Course 1" as "student1" in the app
And I change viewport size to "1200x640" in the app

2
src/addons/mod/quiz/tests/behat/basic_usage.feature
View File

@ -133,6 +133,7 @@ Feature: Attempt a quiz in app
And I should find "Question 1" in the app
And I should find "Question 2" in the app
@ionic7_failure
Scenario: Attempt a quiz (all question types)
Given I entered the quiz activity "Quiz 2" on course "Course 1" as "student1" in the app
When I press "Attempt quiz now" in the app
@ -190,6 +191,7 @@ Feature: Attempt a quiz in app
Then I should find "The correct answer is: Berlin" in the app
And I should find "Mark 1.00 out of 1.00" in the app
@ionic7_failure
Scenario: Submit a quiz & Review a quiz attempt
Given I entered the quiz activity "Quiz 1" on course "Course 1" as "student1" in the app
When I press "Attempt quiz now" in the app

4
src/addons/mod/survey/tests/behat/basic_usage.feature
View File

@ -20,6 +20,7 @@ Feature: Test basic usage of survey activity in app
| activity | name | intro | course | idnumber | groupmode |
| survey | Test survey name | Test survey | C1 | survey | 0 |
@ionic7_failure
Scenario: Answer a survey & View results (ATTLS)
Given I entered the survey activity "Test survey name" on course "Course 1" as "student1" in the app
And I set the following fields to these values in the app:
@ -78,6 +79,7 @@ Feature: Test basic usage of survey activity in app
And I should see "4th answer"
And I should see "5th answer"
@ionic7_failure
Scenario: Answer a survey & View results (Colles actual)
Given the following "activities" exist:
| activity | name | intro | template |course | idnumber | groupmode |
@ -120,6 +122,7 @@ Feature: Test basic usage of survey activity in app
Then I should see "You've completed this survey. The graph below shows a summary of your results compared to the class averages."
And I should see "1 people have completed this survey so far"
@ionic7_failure
Scenario: Answer a survey & View results (Colles preferred)
Given the following "activities" exist:
| activity | name | intro | template | course | idnumber | groupmode |
@ -162,6 +165,7 @@ Feature: Test basic usage of survey activity in app
Then I should see "You've completed this survey. The graph below shows a summary of your results compared to the class averages."
And I should see "1 people have completed this survey so far"
@ionic7_failure
Scenario: Answer a survey & View results (Colles preferred and actual)
Given the following "activities" exist:
| activity | name | intro | template | course | idnumber | groupmode |

2
src/addons/notifications/tests/behat/notifications.feature
View File

@ -39,6 +39,7 @@ Feature: Notifications
| Test 29 | student2 | student1 | 1649766628 | 1649766602 |
| Test 30 | student2 | student1 | 1649766629 | null |
@ionic7_failure
Scenario: Mobile navigation
Given I enter the app
And I log in as "student1"
@ -79,6 +80,7 @@ Feature: Notifications
Then I should find "Test 10 description" in the app
But I should not find "Test 09 description" in the app
@ionic7_failure
Scenario: Tablet navigation
Given I enter the app
And I change viewport size to "1200x640" in the app

4
src/core/features/comments/tests/behat/basic_usage.feature
View File

@ -26,6 +26,7 @@ Feature: Test basic usage of comments in app
| database | type | name | description |
| data1 | text | Test field name | Test field description |
@ionic7_failure
Scenario: Add comments & Delete comments (database)
# Create database entry and comment as a teacher
Given I entered the data activity "Data" on course "Course 1" as "teacher1" in the app
@ -64,6 +65,7 @@ Feature: Test basic usage of comments in app
When I press the back button in the app
Then I should find "Comments (1)" in the app
@ionic7_failure
Scenario: Add comments offline & Delete comments offline & Sync comments (database)
Given I entered the data activity "Data" on course "Course 1" as "teacher1" in the app
And I press "Add entries" in the app
@ -150,6 +152,7 @@ Feature: Test basic usage of comments in app
When I press the back button in the app
And I should find "Comments (1)" in the app
@ionic7_failure
Scenario: Add comments offline & Delete comments offline & Sync comments (glossary)
Given I entered the glossary activity "Test glossary" on course "Course 1" as "teacher1" in the app
And I press "Add a new entry" in the app
@ -228,6 +231,7 @@ Feature: Test basic usage of comments in app
When I press the back button in the app
Then I should find "Comments (0)" in the app
@ionic7_failure
Scenario: Add comments offline & Delete comments offline & Sync comments (blogs)
# Create blog as a teacher
Given the following "core_blog > entries" exist:

1
src/core/features/course/tests/behat/basic_usage.feature
View File

@ -80,6 +80,7 @@ Feature: Test basic usage of one course in app
And I click on "Move right" "link" in the "assignment" activity
And I log out
@ionic7_failure
Scenario: View course contents
When I entered the course "Course 1" as "student1" in the app
Then the header should be "Course 1" in the app

8
src/core/features/login/tests/behat/basic_usage.feature
View File

@ -25,6 +25,7 @@ Feature: Test basic usage of login in app
Then I should not find "Skip" in the app
And I should find "Connect to Moodle" in the app
@ionic7_failure
Scenario: Add a new account in the app & Site name in displayed when adding a new account
When I launch the app
And I set the field "Your site" to "$WWWROOT" in the app
@ -41,12 +42,14 @@ Feature: Test basic usage of login in app
And the UI should match the snapshot
But I should not find "Log in" in the app
@ionic7_failure
Scenario: Add a non existing account
When I launch the app
And I set the field "Your site" to "wrongsiteaddress" in the app
And I press "Connect to your site" in the app
Then I should find "Can't connect to site" in the app
@ionic7_failure
Scenario: Add a non existing account from accounts switcher
When I enter the app
And I log in as "student1"
@ -75,6 +78,7 @@ Feature: Test basic usage of login in app
Then I should find "Connect to Moodle" in the app
But I should not find "Acceptance test site" in the app
@ionic7_failure
Scenario: Require minium (previous) version of the app for a site
# Log in with a previous required version
Given the following config values are set as admin:
@ -82,6 +86,7 @@ Feature: Test basic usage of login in app
When I enter the app
Then I should not find "App update required" in the app
@ionic7_failure
Scenario: Require minium (future) version of the app for a site
# Log in with a future required version
Given the following config values are set as admin:
@ -89,6 +94,7 @@ Feature: Test basic usage of login in app
When I enter the app
Then I should find "App update required" in the app
@ionic7_failure
Scenario: Force password change
Given I force a password change for user "student1"
When I enter the app
@ -138,7 +144,7 @@ Feature: Test basic usage of login in app
When I press "Reconnect" in the app
Then I should find "Acceptance test site" in the app
@lms_from4.1
@ionic7_failure @lms_from4.1
Scenario: Forgot password
Given the following config values are set as admin:
| supportavailability | 2 |

5
src/core/features/login/tests/behat/signup.feature
View File

@ -8,6 +8,7 @@ Feature: Test signup in app
| auth_instructions | These are the authentication instructions. |
| passwordpolicy | 0 |
@ionic7_failure
Scenario: View auth instructions even if signup is disabled
Given the following config values are set as admin:
| registerauth | |
@ -18,6 +19,7 @@ Feature: Test signup in app
And I should find "These are the authentication instructions." in the app
But I should not find "Create new account" in the app
@ionic7_failure
Scenario: Basic signup
When I launch the app
@ -79,7 +81,7 @@ Feature: Test signup in app
Then I should find "Spain" in the app
And I should find "u1@u1.com" in the app
@lms_from3.10
@ionic7_failure @lms_from3.10
Scenario: Check password policy in signup
Given the following config values are set as admin:
| passwordpolicy | 1 |
@ -114,6 +116,7 @@ Feature: Test signup in app
And I press "Create my new account" in the app
Then I should find "An email should have been sent to your address" in the app
@ionic7_failure
Scenario: Signup with custom profile fields
# Use default options Yes/No for menu field because it's not possible to add new lines. See MDL-75788.
Given the following "custom profile fields" exist:

2
src/core/features/mainmenu/tests/behat/mainmenu.feature
View File

@ -32,7 +32,7 @@ Feature: Main Menu opens the right page
And "Dashboard" "text" should appear before "Site home" "text" in the ".core-tabs-bar" "css_element"
And "Home" "text" should appear before "My courses" "text" in the ".mainmenu-tabs" "css_element"
@lms_from4.0
@ionic7_failure @lms_from4.0
Scenario: Opens My Courses when defaulthomepage is set to My Courses
Given the following config values are set as admin:
| defaulthomepage | 3 |

1
src/core/features/reminders/tests/behat/activity_reminders.feature
View File

@ -16,6 +16,7 @@ Feature: Set a new reminder on activity
| assign | C1 | assign01 | Assignment 01 | ## yesterday ## | ## now +70 minutes ## |
| assign | C1 | assign02 | Assignment 02 | ## yesterday ## | ## 1 January 2050 ## |
@ionic7_failure
Scenario: Add, delete and update reminder on activity
Given I entered the assign activity "Assignment 01" on course "Course 1" as "student1" in the app

1
src/core/features/reminders/tests/behat/course_reminders.feature
View File

@ -12,6 +12,7 @@ Feature: Set a new reminder on course
| user | course | role |
| student1 | C1 | student |
@ionic7_failure
Scenario: Add, delete and update reminder on course
Given I entered the course "Course 1" as "student1" in the app
And I press "Course summary" in the app

2
src/core/features/reportbuilder/tests/behat/reportbuilder.feature
View File

@ -118,6 +118,7 @@ Feature: Report builder
| username | firstname | lastname | email | city |
| student1 | Lionel | Smith | lionel@example.com | Bilbao |
@ionic7_failure
Scenario: Open report in mobile
Given I enter the app
And I log in as "student1"
@ -131,6 +132,7 @@ Feature: Report builder
And I should find "Lionel Smith" in the app
But I should not find "My report 02" in the app
@ionic7_failure
Scenario: Open report in tablet
Given I enter the app
And I change viewport size to "1200x640" in the app

2
src/core/features/user/tests/behat/basic_usage.feature
View File

@ -6,6 +6,7 @@ Feature: Test basic usage of user features
| username | firstname | lastname | timezone |
| student1 | Student | Student | 99 |
@ionic7_failure
Scenario: Complete missing fields
Given the following "custom profile fields" exist:
| datatype | shortname | name | required | param1 |
@ -54,6 +55,7 @@ Feature: Test basic usage of user features
When I press "Reconnect" in the app
Then I should find "Acceptance test site" in the app
@ionic7_failure
Scenario: View profile
Given the following "custom profile fields" exist:
| datatype | shortname | name | required | param1 |

1
src/tests/behat/navigation_deeplinks.feature
View File

@ -23,6 +23,7 @@ Feature: It navigates properly using deep links.
| forcelogout | 1 | tool_mobile |
| defaulthomepage | 0 | |
@ionic7_failure
Scenario: Receive a push notification
Given I entered the app as "student2"
When I log out in the app

1
src/tests/behat/navigation_externallinks.feature
View File

@ -18,6 +18,7 @@ Feature: It opens external links properly.
| forum | user | name | message |
| Test forum | student1 | Forum topic | See <a href="https://moodle.org/">moodle.org external link</a> |
@ionic7_failure
Scenario: Click an external link
Given I entered the forum activity "Test forum" on course "Course 1" as "student1" in the app
When I press "Forum topic" in the app

1
src/tests/behat/navigation_splitview.feature
View File

@ -72,6 +72,7 @@ Feature: It navigates properly in pages with a split-view component.
And I should find "User account" in the app
But I should not find "Back" in the app
@ionic7_failure
Scenario: Navigate in grades tab on tablet
# Open user menu