aboutsummaryrefslogtreecommitdiffstats
path: root/Tests/system
Commit message (Collapse)AuthorAgeFilesLines
* Squish: Truncate productDisplayVersion's suffixHEADdevRobert Löhning2025-07-291-1/+1
| | | | | | | | | | | | | It used to only contain the version number, e.g. "17.14.5". Now it may contain a number-readable suffix, e.g. "17.14.9 (July 2025)". The old code crashed because it expected only integers separated by dots. The handling of the suffices is applied unconditionally because it is backward compatible with the old format. Change-Id: I12d20440bb917aef6ee23a0c2be0c6d41e7461f5 Reviewed-by: Christian Stenger <christian.stenger@qt.io>
* Squish: Fix crashing tests after updating MSVSRobert Löhning2025-06-121-2/+9
| | | | | | Change-Id: Ief7b663f1fc3145b4359506bf5be8502e99b8918 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Stabilize tst_new_project_editRobert Löhning2025-04-301-1/+4
| | | | | | | | | | The test could already switch to the next edit while the previous was still receiving the input. The input was then spread across both edits leading to unexpected names for project and solution. Change-Id: I8cce36a1a93d61547fd1da256f48e1e3e0204ff3 Reviewed-by: Christian Stenger <christian.stenger@qt.io>
* Squish: Log MSVS' versionRobert Löhning2025-03-241-0/+1
| | | | | | | Task-number: QTVSADDINBUG-1307 Change-Id: I5abab75397248058a7599dc71cb1724bd0c9d797 Reviewed-by: Christian Stenger <christian.stenger@qt.io>
* Squish: Revert "Expect compilation failure"Robert Löhning2025-03-191-5/+1
| | | | | | | | | | | The issue was fixed. This reverts commit ba76a5b469835e184c4d32b540a951d54f6987a0. Task-number: QTVSADDINBUG-1272 Change-Id: I8a1b2dd5382596f55f47fdd9821cac9ad9d607ab Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Update copyright comments to 2025Ali Demiralp2025-03-1819-57/+19
| | | | | Change-Id: I9ab1f8919a3d28cb546cd71bfdc8da1f6ae9e123 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Update for account creation dialogRobert Löhning2025-03-041-1/+1
| | | | | | | | The button now reads "Skip and add accounts later" Change-Id: I7db50b7a6deb5738f48cb90c3a5f28819b223627 Reviewed-by: Christian Stenger <christian.stenger@qt.io>
* Squish: Enable screenshotsRobert Löhning2025-02-282-0/+24
| | | | | | Change-Id: Ife0440cbc2dc205744e92b4341b5a6a60c39b2f6 Reviewed-by: Christian Stenger <christian.stenger@qt.io>
* Squish: Explicitly open the "Solution Explorer" viewRobert Löhning2025-02-272-0/+4
| | | | | | | | | | After creating a project, MSVS2022 used to show the "Solution Explorer" by default. Without any version update, it now shows a "GitHub Copilot Chat" in that place instead. Change-Id: I726c321ded8a7461ec72a99a15ea18ff175325de Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Expect compilation failureRobert Löhning2024-12-091-1/+5
| | | | | | Task-number: QTVSADDINBUG-1272 Change-Id: I58cbc3e1d50943881541c2f758971fe380d8420f Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Don't use workaround in fixed versions of MSVS2022Robert Löhning2024-12-051-1/+2
| | | | | | | | | | In the affected versions, MSVS2022 changed the default build location after creating the first project. See the link below for details: https://developercommunity.visualstudio.com/t/Changing-location-of-built-exe/10677463 Change-Id: I8f8af79b862ac6a06267b7cd158f358fb3223e83 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Wait for projects' files to be createdRobert Löhning2024-10-181-3/+3
| | | | | | | | | | | | Usually, the files are already present when the test arrives there. Only with CMake-based Qt Designer Custom Widget projects it may take several seconds until they were written. MSVS seems to display a progress bar during that time so this should not cause the test to fail. Instead, wait up to a couple of seconds until the files can be found. Change-Id: Ic03855c098283b6dd6d778896c2d8cb4e4c3357f Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Update installed Qt VS Tools' self-descriptionRobert Löhning2024-10-182-2/+3
| | | | | | | | Amends 07e5dd382ad2dd73b61d696991c6e38533103180 Change-Id: Ie02cacabe9321cd669e95719ee0fcfff604832be Reviewed-by: Leena Miettinen <riitta-leena.miettinen@qt.io> Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Make identification of main window more strictRobert Löhning2024-10-181-1/+2
| | | | | | | | The list of properties was very generic, so it could accidentally be used for other windows. Change-Id: Ifcb8f1874ca76c1ae28b4d249ae0b64bee2ec765 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Use proper object for the workflowHostViewRobert Löhning2024-10-183-10/+11
| | | | | | | | | Instead of that view, the main window's properties were used. This worked because the main window's identification is ambiguous. That will be fixed in a follow-up patch. Change-Id: Ica53235ea9d989e834111ea319ebafca825422eb Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Use correct object for "About" windowRobert Löhning2024-10-181-2/+4
| | | | | | | | | Instead of the "About MSVS" window's, the main window's properties were used. This worked because the main window's identification is ambiguous. That will be fixed in a follow-up patch. Change-Id: I513dbffde0c305976f6df64e87e3febf85da5939 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Use correct container for "Continue without code"Robert Löhning2024-10-181-1/+5
| | | | | | | | | Instead of the Quick Start window's, the main window's properties were used. This worked because the main window's identification is ambiguous. That will be fixed in a follow-up patch. Change-Id: Ifefa4d969a121fca05f52b4d7a70a176dc9c3154 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Use correct object for "Services.SignIn.WizardFrame"Robert Löhning2024-10-081-3/+8
| | | | | Change-Id: Idb9d813f5d7006771e1ea5efffb0f4cbb58336dd Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Test for files created by Qt Test Application projectRobert Löhning2024-09-091-4/+9
| | | | | | | | | | | By making the current state the expected behavior: - Except for project files, only QtTest<number>.cpp is created - QtTest<number>.cpp is opened in editor - Build target is QtTest<number>.exe Task-number: QTVSADDINBUG-1210 Change-Id: Idc1aff6080691a1577b4f22bbf7e90197b781abc Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Add missing importRobert Löhning2024-09-091-0/+1
| | | | | | | | | | The test currently works without it just beause TestSection is being used in config_utils.py and Squish's source() statement acts like a C-include. Change-Id: I3f61060fa4ff7afde13523f874c41266f6205558 Reviewed-by: Ali Can Demiralp <ali.demiralp@qt.io> Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Stabilize tst_debug on MSVS2019Robert Löhning2024-09-091-0/+5
| | | | | | | | | | | | When running the test on MSVS2019, Squish reliably switches to a different application context. Depending on the timing, the test may pass, fail or even crash. Eliminate this uncertainty by stopping the test until the context change happened and setting it back to the right context. When running on MSVS2022, none of this seems to happen. Change-Id: Ie1b1390afe274ae049aaf059014255249385fc63 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Update build location of CMake based projectsRobert Löhning2024-09-091-1/+1
| | | | | | | | Amends a326474e8aca29142b732ec3311c79c5b12d4ff8 Change-Id: Ica057e27fd2a04f289bec1fae5005f7614f31ec5 Reviewed-by: Ali Can Demiralp <ali.demiralp@qt.io> Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Stabilize tst_new_project_defaultsRobert Löhning2024-09-091-2/+2
| | | | | | | | | | | The template name label only has very generic properties so it can happen that Squish still finds a different label from the wizard's previous page. To the avoid that, the test now first waits for the edit controls which don't have such doppelgängers. Change-Id: I694080cfb643ef80ab70469ffd55c2eed77c06fa Reviewed-by: Ali Can Demiralp <ali.demiralp@qt.io> Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Update error message about invalid Qt versionRobert Löhning2024-09-091-1/+1
| | | | | | | | Amends 5982a104a18a35c9ca1a97bc55260f62f13d64de Change-Id: Ic579957dc77dba3405c16dec05f4190f2c761dbd Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io> Reviewed-by: Ali Can Demiralp <ali.demiralp@qt.io>
* Squish: Test wizard for new Qt Test ApplicationRobert Löhning2024-09-093-11/+23
| | | | | | | | This only updates the tests for the wizard itself. tst_new_project_file_creation still needs its own update. Change-Id: I8eb9aa04cc19579a16b7ee166d65b92b5a4e530c Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Work around invisible list items being inaccessibleRobert Löhning2024-09-092-0/+12
| | | | | | | | | | | | | That was not an issue earlier because the list of templates was not long enough. The addition of the "Qt Test Application" template then revealed the problem. tst_new_project_defaults and -edit do not need this, because they click one template after the other without closing the dialog. That implicitly scrolls down the view. Change-Id: Ie8edd4ba9ed91fa6852f75b88346cdb715300c2f Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Update for redesigned Qt version pageRobert Löhning2024-09-053-26/+44
| | | | | Change-Id: I8ccfc26ca9dc6c25e671b30d0eccdef82591a6e8 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Don't pass MSVS product line around when it's not neededRobert Löhning2024-09-0513-70/+62
| | | | | | | | | | | | Since we're not testing MSVS2017 anymore, there are much less differences between the product lines of MSVS. Most functions which still got the product line as a parameter didn't use it anymore. Instead, this now calls a function to get the product line only if, when and where it's needed. The called function stores the information so there is hardly any overhead but the code is cleaner. Change-Id: Ib9b4f53e9f1b5fcd7e09a6ea7dddf487b4b6d8c2 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Use version number for choosing extension manager codeRobert Löhning2024-09-051-9/+8
| | | | | | | | | | MSVS' extension manager changed in version 17.10.0. Instead of trying the old code first, then the new one, read the version number and directly use the right objects. Change-Id: I4a72d2fcacd185e535464f57cc6d887e9611253b Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io> Reviewed-by: Ali Can Demiralp <ali.demiralp@qt.io>
* Squish: Handle MSVS' build directory regressionRobert Löhning2024-09-052-3/+22
| | | | | | | | | | MSVS 2022 17.10.0 and higher only build the first project in the location which used to be the default. After that, every following msbuild-based project will by default be built one level further down in the folder hierarchy. Change-Id: Ib0641a0bc1edbe3225496ad05cbd7e4ef4c7b195 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Improve README: Clarify installation steps and convert to MarkdownKarsten Heimrich2024-07-222-31/+81
| | | | | | | | | | - Reformatted README as Markdown - Clarified environment variable setup and installation instructions - Added code block for manual installation command - Updated step-by-step guidance for running tests Change-Id: I83bc91cf601fe3b5db4a1a73c8ed29c9092156b5 Reviewed-by: Robert Löhning <robert.loehning@qt.io>
* Squish: Allow debugger test to run on Qt5Robert Löhning2024-07-111-1/+1
| | | | | | | | | | | | | | | | | | | | The test used to place a breakpoint in the line engine.load(QUrl(QStringLiteral("qrc:/qt/qml/qtquickapplication/main.qml"))); While Qt6 stops in that line once, Qt5 stops twice. Instead of handling that difference just place the breakpoint in the line if (engine.rootObjects().isEmpty()) instead. This is always hit just once. Thanks to Karsten Heimrich for the suggestion. Currently, the lines are found by counting from the top of main.cpp This shall be replaced by properly selecting the right line. Change-Id: I0ab84bb1817d7dac22695c09539c14a5a43be11c Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Update tests for verifying VS Tools' (un)installationRobert Löhning2024-07-116-9/+33
| | | | | | | | | | | | | | | MSVS2022 17.10.0 comes with a new extension manager which opens in an editor tab instead of a dialog. It also has a different layout. This only fixes the verification tests. The semiautomatic tests which actually (un)install the VS Tools still need to be updated. The tests still try using the old extension manager which makes them compatible with older versions, including MSVS2019. If that fails, they try using the new extension manager. Change-Id: I219e94b9ea38ab84a2a310740f33f7ecc9280a21 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Test debuggingRobert Löhning2024-07-104-2/+137
| | | | | | | | | | | | - Create a new Qt Quick Application project - Place in a breakpoint in main.cpp - Start debugger - Continue after breakpoint was hit - Close application running in debugger Task-number: QTVSADDINBUG-1035 Change-Id: I5c3cd1ad5b59056b3fc4017dafe05bb9609207c7 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Allow switching app context to other than devenvRobert Löhning2024-07-101-4/+4
| | | | | Change-Id: I89a247c64495caa35e5c5e836f566bdd294878ec Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Wait for application's shutdown before deleting filesRobert Löhning2024-05-271-0/+1
| | | | | | | Deleting may fail if devenv.exe is still using them. Change-Id: Ibf316f740f617e4eaa9c56fd09d061751a3284b8 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Mention problems with turned off screen in ReadmeRobert Löhning2024-05-271-0/+3
| | | | | Change-Id: I88c33c3f6fd765ecf0ac5c268a49eea5f2c9f39a Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Stabilize building CMake based projectsRobert Löhning2024-05-271-3/+4
| | | | | | | | | | | | | To determine whether MSVS is ready for building a project, the test checks the text of a label. Before this change, the execution proceeded when the label did not display a generic placeholder text. This was fragile because for an instant, the label might still display the previous project's name. Now, the test will wait for the current project's actual name. Change-Id: I6b9fa93050be49f7dfd4f7778563a83c420ff948 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Stabilize tst_new_project_file_creationRobert Löhning2024-05-271-0/+1
| | | | | | | | | For some reason, Squish sometimes cannot find the label on the source editor's tab. Waiting for a second in this case seems to solve that. Change-Id: I892e0a47f24e81628266f568eef4757bd7081517 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Update "Initializing" placeholder in menuRobert Löhning2024-05-271-1/+1
| | | | | | | | The readable text is now followed by a couple of line breaks and white spaces. Change-Id: I4034d43fa1123d089f5e1f0c305011b9e5b127df Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Fix application context to avoid exceptionRobert Löhning2024-05-273-26/+20
| | | | | Change-Id: If63dd0dbd5b9ad42af1cdb05c4cca138b9b0bf8a Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Clear Qt VS Tools' settings before running any testRobert Löhning2024-05-276-7/+28
| | | | | | | | Except for installation tests which expect the Qt VS Tools to not be installed. Change-Id: Ie7f5dbf3c5c0f77673bb9e207c4d40f78223a2f5 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Move OK button to globalnamesRobert Löhning2024-04-103-3/+3
| | | | | | | ...so it can be used anywhere. Change-Id: I0790e893363c91512fb75c5494f041d958b8c0a7 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Replace wait condition strings with lambdasRobert Löhning2024-04-086-17/+17
| | | | | Change-Id: I36519c083648e13b296d3ca9968f9146335862ae Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Test handling of invalid path to QtRobert Löhning2024-04-084-5/+27
| | | | | Change-Id: Ib806833c134677e5cfea7af4753522592515f312 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Improve tests for "Restart Required" messageRobert Löhning2024-04-084-7/+17
| | | | | | | | | | | | | | VS2022 changed the text of the message. I now split the test into two parts: - Is there a message at all, found using its ID? - Does that message have an expected text? This will make it easier to figure out why the tests fail, if they do. Change-Id: I0f1675a7981d1856af38a5cee8c642d0b4dad4dd Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Adjust timingsRobert Löhning2024-04-053-3/+3
| | | | | | | | | | | | | | | | | - When opening the "Qt VS Tools" menu while the add-on is still initializing, the "Initializing" placeholder might not appear immediately. Wait a moment for it to appear before assuming that initializing finished. - The "You must select a Qt version" message might need a couple of seconds to appear. Give it some more. - When creating a new project, the automatically opened editor never took longer than four seconds to appear here. Waiting for ten seconds should be sufficient before assuming it won't show. Change-Id: I4cc56452412639dd342e8805d642347bce73613f Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Test building projects with CMakeRobert Löhning2024-03-212-74/+135
| | | | | | | | | | | Task-number: QTVSADDINBUG-1035 Task-number: QTVSADDINBUG-1159 Task-number: QTVSADDINBUG-1160 Task-number: QTVSADDINBUG-1162 Task-number: QTVSADDINBUG-1177 Task-number: QTVSADDINBUG-1178 Change-Id: Ieb0a8faf6c3ff238d0a92e52924bbb3ea1143db9 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Change source license to LicenseRef-Qt-Commercial or GPL-3.0-onlyAli Can Demiralp2024-02-2818-18/+18
| | | | | | | | ... WITH Qt-GPL-exception. Fixes: QTVSADDINBUG-1179 Change-Id: I74fe451eec352af13436548cfd9a28f832fc0757 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
* Squish: Shorten object nameRobert Löhning2024-02-265-5/+5
| | | | | Change-Id: I2abd5f5f0aca0160a22b8b7489c86ca9e9498c69 Reviewed-by: Karsten Heimrich <karsten.heimrich@qt.io>
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-17 03:11:08 +0000