Questions tagged [automated-tests]

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process (wikipedia.org).

automated-tests
Filter by
Sorted by
Tagged with
15 votes
4 answers
14k views

Test runners for AngularJS - how to run the tests from eclipse IDE and CI server without too much complication?

I am trying to figure out a simple way to run tests on angularjs application. I am new to the testing world, so it's a little hard to understand all the options and the difference between them. My ...
Malki's user avatar
  • 2,375
15 votes
7 answers
10k views

How to automate testing of a browser-based app? [closed]

If it were a windows program, I would use Auto it to automate testing. Is there something similar for browser-based apps? Nothing too complex, it should just allow scripting (preferable for me to ...
Mawg's user avatar
  • 39.4k
15 votes
4 answers
51k views

Setting up appium for iOS app test automation [closed]

Looking far and wide for a step-by-step guide to set-up iOS Test Automation using appium, with scripts in Java (no ruby and/or cucumber). Note: The appium wiki is not helpful either.
Ethen Hunt's user avatar
15 votes
2 answers
4k views

Property based testing in PHP?

In various more functional based languages there are tools (like Quickcheck) which allow for property based testing. How would I go about property based testing in PHP? I would like to be able to ...
Ward Bekker's user avatar
  • 6,356
15 votes
1 answer
15k views

Cypress - have 1 test call another test and run it

We are using Cypress to automate unit, functional, and presentation layer tests. Our development methodology has been along the lines of blending Atomic design in a React environment. We are balancing ...
Roralee's user avatar
  • 548
15 votes
3 answers
32k views

What is the Java equivalent to PhantomJS? [closed]

I would like to know whether there is any Java library equivalent to PhantomJS. What I want to achieve is to be able to simulate form login and submit actions from a web page and also to do page ...
alextc's user avatar
  • 3,356
15 votes
2 answers
12k views

Jest - How to assert that all items in an array are objects and contain certain properties?

I'd like to assert in jest that an array contains objects with certain properties, such as: [ { id: 1, name: 'A' }, { id: 2, name: 'B' }, { id: 3 } // should throw assertion ...
adamsfamily's user avatar
  • 1,884
15 votes
2 answers
8k views

How to test binary compatibility automatically? [duplicate]

Can it be done before compiling, by comparing code? Is there any tools already doing this?
graphite's user avatar
  • 2,960
15 votes
2 answers
26k views

Cypress - check if the file is downloaded

I have a little problem with trying to check if a file is downloaded. Button click generates a PDF file and starts its download. I need to check if it works. Can Cypress do this?
Dominik Skála's user avatar
15 votes
3 answers
6k views

Is drag-and-drop possible in watir-webdriver?

I would like to drag-and-drop one element to the position of another, triggered from within a watir-webdriver script. By "drag-and-drop" I mean picking up a draggable element and releasing it on ...
kinofrost's user avatar
  • 768
15 votes
2 answers
5k views

Strategy for Automated UI testing on remote virtual machines

I'm using TeamCity for my CI builds, and I'd like to set up a second build for running automated UI tests on Windows XP and Windows 7 virtual machines. I imagine the build working as follows: ...
Paul Stovell's user avatar
  • 32.6k
15 votes
3 answers
8k views

Squish alternative for Qt [closed]

I'm looking for an app that does something similar to Squish. I'd like it to be able to test Qt apps, maybe a free/open-source app, maybe with acces to the Qt API and a scripting language like ...
Paul's user avatar
  • 21.4k
15 votes
2 answers
5k views

A Test For HTTP 1.1 Compliance [closed]

I wonder if there is a piece of software to allow automatically testing a webserver for compliance with the HTTP protocol? Ideally I'd like this program to work like this: I give it the address and ...
user avatar
15 votes
1 answer
1k views

How to automate upgrade testing for android

We have been using espresso for android automation, and that includes upgrade testing For upgrade testing, we need to perform 3 steps: Make some actions in the old version to prepare some data ...
Sugre's user avatar
  • 851
14 votes
6 answers
21k views

Run grouped tests sequentially using Playwright

I'm using Playwright with nodejs and I have grouped a couple of tests together like this import { test, expect } from '@playwright/test'; test.describe('Add a simple invoice test', () => { ...
Amrou's user avatar
  • 411
14 votes
5 answers
12k views

Why use Page Factory?

I am a new test engineer and have been reading about Page Object Model and implementing them and keep coming across Page Factory. I understand that Page Factory is a POM that provides additional ...
Haendler's user avatar
  • 313
14 votes
2 answers
10k views

Cypress - exclude tests from beforeEach

90% of my tests need to do one task before start so I made beforeEach function that works perfect. Rest 10% need to do something else before start. Is in Cypress some way to do beforeEach except ...
Dominik Skála's user avatar
14 votes
3 answers
26k views

How to test Keycloak authentication in Spring Boot application?

In a Spring Boot project we enabled Spring Security and applied Keycloak authentication with bearer token like described in the following articles: https://www.keycloak.org/docs/3.2/securing_apps/...
radistao's user avatar
  • 15.2k
14 votes
5 answers
14k views

Data driven testing in MSTest - problem with TestContext.DataRow

I'm having essentially the same problem as the question linked below, but I cannot seem to get it to work. I'm getting "cannot apply indexing [] to an expression of type System.Data.DataRow". As far ...
bq1990's user avatar
  • 367
14 votes
5 answers
28k views

Is there a way to iterate over a <li> list in Playwright and click over each element?

I'm trying to iterate over a list of dynamic elements with Playwright, I've tried a couple of things already, but none have been working: await this.page.locator('li').click(); const elements = await ...
Gabriel Costa's user avatar
14 votes
2 answers
8k views

Create tests at run-time (google test)

I have a Parser that has to be tested. There are lots of test input files to this Parser. The expected behaviour of the Parser is tested by comparing output of the Parser with corresponding ...
Egor Okhterov's user avatar
14 votes
2 answers
21k views

Clicking 'OK' on alert or confirm dialog through jquery/javascript?

I was thinking of writing some UI tests in backbone.js and jquery. They may not be the best way to do it but it's something that I was thinking about - to automate the tests without record and ...
PhD's user avatar
  • 11.2k
14 votes
4 answers
24k views

Playwright before each for all spec files

I am very new to Playwright. Due to my test suites, I need to login into my application before running each test. Inside a single spec file that is easy, I can simply call test.beforeEach. My issue is:...
Pelicer's user avatar
  • 1,476
14 votes
3 answers
28k views

Set environment variable for Go tests

I am trying to run my Go tests like this, setting an environment variable: FOO=BAR go list ./... | grep -v vendor | xargs -n1 go test -timeout=3s Inside my tests I do: log.Print(os.Getenv("FOO")) ...
Richard Knop's user avatar
  • 82.4k
14 votes
3 answers
26k views

How can I check URL content with Cypress

I want to check my URL content and do something like this: if (URL.include('path')) { //do something } else { // do something else } I can check my URL like this cy.url().should('include', '...
Narine Poghosyan's user avatar
14 votes
2 answers
6k views

TestNG skips test after raising Exception in @DataProvider method

I'm a bit confused. How can I get TestNG to report an error for a test? // ... @DataProvider(name = "foo") public Object[][] provideData () { throw new SomeRuntimeException("Some error occurred. ...
Doe Johnson's user avatar
  • 1,404
14 votes
4 answers
35k views

Please, set "CHROME_BIN" env variable inside docker npm test

'npm run test' works completely fine on the server or on my local but its failing on my docker machine. I am bit new to this docker world so I am just confused about whats going wrong here. I was ...
undefined's user avatar
  • 3,574
14 votes
11 answers
28k views

How to perform drag and drop using selenium-webdriver when target and destination element are in different frames?

I have to drag an image and drop it into a CQ5 component. The image and component are in different frames. Here is the code which did not work as webelement destinationcould not be found when the ...
9ikhan's user avatar
  • 1,177
14 votes
3 answers
9k views

Correct way to use IdlingResource in Espresso Android

I'm writing UI tests with Espresso. App cooperates tightly with server, so in many cases, I need to wait for either value to be calculated, or data is got and displayed, etc. Espresso suggests using ...
Lanitka's user avatar
  • 932
14 votes
1 answer
3k views

'!_debugInitialized': is not true while running flutter integration tests

I am trying to run a basic flutter integration test to invoke my main app widget but it's failing. I have followed the approach as described in the official docs [https://docs.flutter.dev/testing/...
Bhupesh Varshney's user avatar
14 votes
2 answers
2k views

One test watcher to report results of individual tests in JUnit Suite

So I have a suite, something like this: @RunWith(Suite.class) @Suite.SuiteClasses({TestClass1.class, TestClass2.class, TestClass3.class}) public class TestSuite { static List<ExtentTest> ...
SeeYaLater Automator's user avatar
14 votes
2 answers
10k views

Cypress login command with cy.request causes subsequent cy.visit to fail

I'm trying to make a programmatic login with Cypress before each test. My tokens are persisted in localStorage. If I alter it synchronously, i.e. simpy doing localStorage.setItem without involving cy....
Johan's user avatar
  • 35.3k
13 votes
8 answers
9k views

Can I run an XCTest suite multiple times?

Is it possible to have Xcode run your unit tests multiple times? I had an issue in several unit tests that caused intermittent failures. Now that I think I've fixed it, my only option appears to mash ...
T Blank's user avatar
  • 1,418
13 votes
2 answers
26k views

InvalidArgumentException: Message: invalid argument: 'using' must be a string

im very new to python, trying to create reusable code. when i try to call the class Login and function login_user in test_main.py by passing all the arguments that were used under Login class, im ...
Mohan's user avatar
  • 461
13 votes
1 answer
7k views

Rails 3 - Testing controller's GET method - trying to use JSON and getting 406 errors

I have a simple controller that specifies: respond_to :json When I try to build a functional test that calls it like this: test "GET" do get 'index', :format => :json end Everything works ...
Bryan's user avatar
  • 133
13 votes
5 answers
6k views

How to test all ASP.NET Core Controllers Dependency Injection is valid?

We occasionally have issues whereby someone adds some DI into a controller but forgets to add the relevant line into Startup.cs to set the scope of the object. This does not prevent the application ...
Michael Parker's user avatar
13 votes
5 answers
17k views

Selenium: Runtime.executionContextCreated has invalid 'context':

I looked the similar question here Protractor / Selenium Webdriver : Runtime.executionContextCreated has invalid 'context' and here BUG-1473, but I cannot get the answer hence I decided to ...
Humoyun Ahmad's user avatar
13 votes
2 answers
12k views

Checking if an element exists without losing time in Capybara

I like to keep things DRY, that's why I want to have the following in one of my steps: if first(:css, "#blabla") != nil find_by_id(blabla).click end find_by_id(....) .... This means, that it ...
TrashyMcTrash's user avatar
13 votes
2 answers
6k views

what browser does zombie.js use?

So I came across zombie.js, is this a headless browser? If so, what browser engine does it use? Could I rely on it for doing lot of automated tests? Basically, I am restricted to a single server, so ...
KJW's user avatar
  • 15.1k
13 votes
5 answers
10k views

How to putExtra data using newest ActivityScenarioRule/ActivityScenario?[Espresso/Jetpack]

There were added new classes to test Activities, such as ActivityScenarioRule and ActivityScenario And there is no documentation how to use them when you want put some extra data. For now I've found ...
Akbolat SSS's user avatar
  • 1,941
13 votes
3 answers
7k views

Is there a good tutorial on cocoa touch automated UI testing?

Typically I find that nearly all my most important test cases for iPhone development revolve around UI testing rather than business logic or data testing. I'm not very familiar with automated UI ...
memmons's user avatar
  • 40.4k
13 votes
8 answers
6k views

Who writes the automated UI tests? Developers or Testers?

We're in the initial stages of a large project, and have decided that some form of automated UI testing is likely going to be useful for us, but have not yet sorted out exactly how this is going to ...
Orion Edwards's user avatar
13 votes
1 answer
9k views

what is slow parameter in mocha?

When we define mochaOpts in Protractor, we define one parameter as slow. I do not understand what is the use of that parameter. I tried changing it's value but I can't see any change in test execution ...
Priyanshu's user avatar
  • 3,060
13 votes
3 answers
8k views

How to use a virtual machine with automated tests?

I am attempting to setup automated tests for our applications using a virtual machine environment. What I would like to have is something like the following scenario: Build server is automatically ...
Stécy's user avatar
  • 12.2k
13 votes
2 answers
4k views

How does testing a connection to a third-party API fit into continuous integration?

I wrote a test some time ago that tests an integration I wrote between my code and a third-party API. The test makes sure that the integration works properly and that we get back the expected results. ...
Vivin Paliath's user avatar
13 votes
1 answer
9k views

Executing thread groups separately in jmeter

I have 2 thread groups in my test case. Group A should complete first before Group B starts to execute(at least I though this was the way it worked). Unfortunately they are firing at the same time ...
ant's user avatar
  • 22.7k
13 votes
1 answer
8k views

Should I mock APIs in end-to-end testing?

When you are doing e2e tests for your application, you want to test the whole application, not some portions of it like unit tests or integration testing. But in some situations, people do mock APIs. ...
Shadowalker's user avatar
13 votes
5 answers
16k views

Automating serial port communication on Linux

I have a linux server (Red Hat 4) with one serial port connection to an embedded linux device, and another serial port connection to a power controller for that device. My current way to control them ...
jasper77's user avatar
  • 1,553
13 votes
2 answers
8k views

Error when using source in a python Tox ini file

I'm trying to get Tox and Conda to play together well. Mainly because I have a lot of non-python dependencies that need to be installed and it was easy to create Conda distributions. Then I can ...
JudoWill's user avatar
  • 4,781
13 votes
2 answers
9k views

How can I reliably wait for JavaScript alerts using Selenium2 / WebDriver?

I am currently assisting in a proof of concept using Selenium 2 / WebDriver with C# against an ASP.NET MVC application using the InternetExplorerDriver. The application uses a standard pattern for ...
Paul Williams's user avatar

1
3 4
5
6 7
265