I&#39;m using the Python bindings to run Selenium WebDriver:

    from selenium import webdriver
    wd = webdriver.Firefox()

I know I can grab a webelement like so:

    elem = wd.find_element_by_css_selector(&#39;#my-id&#39;)

And I know I can get the full page source with...

    wd.page_source

But is there a way to get the &quot;element source&quot;?

    elem.source   # &lt;-- returns the HTML as a string

The Selenium WebDriver documentation for Python are basically non-existent and I don&#39;t see anything in the code that seems to enable that functionality.

What is the best way to access the HTML of an element (and its children)?





Get HTML source of WebElement in Selenium WebDriver using Python

I see this only in Chrome.

The full error message reads:

&gt; &quot;org.openqa.selenium.WebDriverException: Element is not clickable at point (411, 675). Other element would receive the click: ...&quot;

The element that &#39;would receive the click&#39; is to the side of the element in question, not on top of it and not overlapping it, not moving around the page.

I have tried adding an offset, but that does not work either.  The item is on the displayed window without any need for scrolling.

Debugging &quot;Element is not clickable at point&quot; error

I&#39;m using Puppeteer and Jest to run some front end tests.

My tests look as follows:

&lt;!-- language: lang-html --&gt;

    describe(&quot;Profile Tab Exists and Clickable: /settings/user&quot;, () =&gt; {
        test(`Assert that you can click the profile tab`, async () =&gt; {
          await page.waitForSelector(PROFILE.TAB);
          await page.click(PROFILE.TAB);
        }, 30000);
    });

&lt;!-- end snippet --&gt;

Sometimes, when I run the tests, everything works as expectedly. Other times, I get an error:

&gt; Timeout - Async callback was not invoked within the 5000 ms timeout specified by jest.setTimeout.
&gt;
&gt;          at node_modules/jest-jasmine2/build/queue_runner.js:68:21 &lt;br/&gt;
&gt;          at Timeout.callback [as _onTimeout] (node_modules/jsdom/lib/jsdom/browser/Window.js:633:19)

This is strange because:

1. I specified the timeout to be 30000

2. Whether or not I get this error is seemingly very random

Why is this happening?







Message &quot;Async callback was not invoked within the 5000 ms timeout specified by jest.setTimeout&quot;

I&#39;m looking for a quick way to type the &lt;kbd&gt;Enter&lt;/kbd&gt; or &lt;kbd&gt;Return&lt;/kbd&gt; key in Selenium. 

Unfortunately, the form I&#39;m trying to test (not my own code, so I can&#39;t modify) doesn&#39;t have a &lt;kbd&gt;Submit&lt;/kbd&gt; button. When working with it manually, I just type &lt;kbd&gt;Enter&lt;/kbd&gt; or &lt;kbd&gt;Return&lt;/kbd&gt;. How can I do that with the Selenium `type` command as there is no button to click?



Typing the Enter/Return key in Selenium

When I use MSTest Framework, and copy the code that Selenium IDE generated for me, MSTest doesn&#39;t recognize `[TearDown]` and `[SetUp]`. What is the alternative to this?

What would be an alternate to [TearDown] and [SetUp] in MSTest?

Is there any way in either Selenium 1.x or 2.x to scroll the browser window so that a particular element identified by an XPath is in view of the browser? There is a focus method in Selenium, but it does not seem to physically scroll the view in FireFox. Does anyone have any suggestions on how to do this?

The reason I need this is I&#39;m testing the click of an element on the page. Unfortunately the event doesn&#39;t seem to work unless the element is visible. I don&#39;t have control of the code that fires when the element is clicked, so I can&#39;t debug or make modifications to it, so, easiest solution is to scroll the item into view.

Scroll Element into View with Selenium

I want to make sure that an element is present before the webdriver starts doing stuff.

I&#39;m trying to get something like this to work:

    WebDriverWait wait = new WebDriverWait(driver, new TimeSpan(0, 0, 5));
    wait.Until(By.Id(&quot;login&quot;));

I&#39;m mainly struggling how to setup up the anonymous function...


Selenium C# WebDriver: Wait until element is present

I am currently using selenium webdriver to parse through facebook user friends page and extract all ids from the AJAX script. But I need to scroll down to get all the friends. How can I scroll down in Selenium. I am using python.

How can I scroll a web page using selenium webdriver in python?

I&#39;ve found the proper use (or at least the documentation) of JUnit very confusing.
This question serves both as a future reference and as a real question.

If I&#39;ve understood correctly, there are two main approaches to create and run a JUnit test:

**Approach A (JUnit 3-style):** create a class that extends TestCase, and start test methods with the word `test`. When running the class as a JUnit Test (in Eclipse), all methods starting with the word `test` are automatically run.

    import junit.framework.TestCase;

    public class DummyTestA extends TestCase {

        public void testSum() {
            int a = 5;
            int b = 10;
            int result = a + b;
            assertEquals(15, result);
        }
    }

**Approach B (JUnit 4-style):** create a &#39;normal&#39; class and prepend a `@Test` annotation to the method. Note that you do NOT have to start the method with the word `test`.

    import org.junit.*;
    import static org.junit.Assert.*;

    public class DummyTestB {

        @Test
        public void Sum() {
            int a = 5;
            int b = 10;
            int result = a + b;
            assertEquals(15, result);
        }
    }


Mixing the two seems not to be a good idea, see e.g. [this stackoverflow question](https://stackoverflow.com/questions/1151237/junit-expected-tag-not-working-as-expected): 

Now, my questions(s):

 1. **What is the preferred approach**, or when would you use one instead of the other?
 2. Approach B allows for testing for exceptions by extending the @Test annotation like in `@Test(expected = ArithmeticException.class)`. **But how do you test for exceptions when using approach A?**
 3. When using approach A, you can group a number of test classes in a test suite like this:

    `TestSuite suite = new TestSuite(&quot;All tests&quot;);`&lt;br/&gt;
    `suite.addTestSuite(DummyTestA.class);`&lt;br/&gt;
    `suite.addTestSuite(DummyTestAbis.class);`&lt;br/&gt;&lt;br/&gt;
But this can&#39;t be used with approach B (since each testclass should subclass TestCase). **What is the proper way to group tests for approach B?**

Edit: I&#39;ve added the JUnit versions to both approaches


JUnit confusion: use &#39;extends TestCase&#39; or &#39;@Test&#39;?

I want to toggle only running one test, so I don&#39;t have to wait for my other tests to see the result of one test.

Currently, I comment out my other tests, but this is really annoying.

Is there a way to toggle only running one test in `Cypress`?



Cypress: run only one test

I&#39;m hoping it&#39;s just me, but Selenium Webdriver seems like a complete nightmare.  The Chrome webdriver is currently unusable, and the other drivers are quite unreliable, or so it seems.  I am battling many problems, but here is one.  

Randomly, my tests will fail with a 

    &quot;org.openqa.selenium.StaleElementReferenceException: Element is no longer attached 
    to the DOM    
    System info: os.name: &#39;Windows 7&#39;, os.arch: &#39;amd64&#39;,
     os.version: &#39;6.1&#39;, java.version: &#39;1.6.0_23&#39;&quot;

I&#39;m using webdriver versions 2.0b3.  I have seen this happen with FF and IE drivers.  The only way I can prevent this is to add an actual call to `Thread.sleep` before the exception occurs.  That is a poor workaround though, so I&#39;m hoping someone can point out an error on my part that will make this all better.

Random &quot;Element is no longer attached to the DOM&quot; StaleElementReferenceException

I ran into a problem while working with Selenium. For my project, I have to use Chrome. However, I can&#39;t connect to that browser after launching it with Selenium.

For some reason, Selenium can&#39;t find Chrome by itself. This is what happens when I try to launch Chrome without including a path:

    Traceback (most recent call last):
      File &quot;./obp_pb_get_csv.py&quot;, line 73, in &lt;module&gt;
        browser = webdriver.Chrome() # Get local session of chrome
      File &quot;/usr/lib64/python2.7/site-packages/selenium/webdriver/chrome/webdriver.py&quot;, line 46, in __init__
        self.service.start()
      File &quot;/usr/lib64/python2.7/site-packages/selenium/webdriver/chrome/service.py&quot;, line 58, in start
        and read up at http://code.google.com/p/selenium/wiki/ChromeDriver&quot;)
    selenium.common.exceptions.WebDriverException: Message: &#39;ChromeDriver executable needs to be available in the path.                 Please download from http://code.google.com/p/selenium/downloads/list                and read up at http://code.google.com/p/selenium/wiki/ChromeDriver&#39;

To solve this problem, I then included the Chromium path in the code that launches Chrome. However, the interpreter fails to find a socket to connect to:

    Traceback (most recent call last):
      File &quot;./obp_pb_get_csv.py&quot;, line 73, in &lt;module&gt;
        browser = webdriver.Chrome(&#39;/usr/bin/chromium&#39;) # Get local session of chrome
      File &quot;/usr/lib64/python2.7/site-packages/selenium/webdriver/chrome/webdriver.py&quot;, line 46, in __init__
        self.service.start()
      File &quot;/usr/lib64/python2.7/site-packages/selenium/webdriver/chrome/service.py&quot;, line 64, in start
        raise WebDriverException(&quot;Can not connect to the ChromeDriver&quot;)
    selenium.common.exceptions.WebDriverException: Message: &#39;Can not connect to the ChromeDriver&#39;

I also tried solving the problem by launching chrome with:
&lt;pre&gt;chromium --remote-shell-port=9222&lt;/pre&gt;
However, this did not work either.

PS. Here&#39;s some information about my system:
&lt;pre&gt;www-client: chromium 15.0.874.121  
dev-lang:   python 2.7.2-r3 Selenium 2.11.1  
OS:         GNU/Linux Gentoo Kernel 3.1.0-gentoo-r1&lt;/pre&gt;  

Running Selenium WebDriver python bindings in chrome

I&#39;m going to start coding some automated tests of our presentation soon. It seems that everyone recommends [WatiN][1] and [Selenium][2]. Which do you prefer for automated testing of ASP.NET web forms? Which of these products work better for you?

As a side note, I noticed that WatiN 2.0 has been in CTP since March 2008, is that something to be concerned about?


  [1]: http://watin.sourceforge.net/index.html
  [2]: http://seleniumhq.org/

WatiN or Selenium?

I&#39;m starting to learn Cypress. I have a 4 row table (with a class of datatable). I can verify the number of rows this way:

    cy.get(&#39;.datatable&#39;).find(&#39;tr&#39;).each(function(row, i){
            expect(i).to.be.lessThan(4)
    })

This is fine, but it seems awkward, since I just want to count the length and don&#39;t really need to access the stuff in the rows, and I assume it&#39;s faster to do one thing than do 4 things.

If I log the selection (not sure what else to call it):

    cy.log(cy.get(&#39;.datatable&#39;).find(&#39;tr&#39;))

it comes out as `[object Object]` and I&#39;m not quite sure how to deconstruct that, which suggests to me that I&#39;m thinking about this all wrong.

If I try:

    expect(cy.get(&#39;.datatable&#39;).find(&#39;tr&#39;)).to.have.lengthOf(4)

I get `AssertionError: expected { Object (chainerId, firstCall) } to have a property &#39;length&#39;`

If I try:

        expect(Cypress.$(&#39;.datatable &gt; tr&#39;)).to.have.lengthOf(4)

I get `AssertionError: expected { Object (length, prevObject, ...) } to have a length of 4 but got 0` so at least it has a length here?

If I log that method of selection I get `Object{4}`. I&#39;m not sure where to go from here. It seems like this would be a very common thing to deal with.

In Cypress how to count a selection of items and get the length?

I&#39;m trying to assert that one object is &quot;equal&quot; to another object. 

The objects are just instances of a class with a bunch of public properties. Is there an easy way to have NUnit assert equality based on the properties?

This is my current solution but I think there may be something better:

    Assert.AreEqual(LeftObject.Property1, RightObject.Property1)
    Assert.AreEqual(LeftObject.Property2, RightObject.Property2)
    Assert.AreEqual(LeftObject.Property3, RightObject.Property3)
    ...
    Assert.AreEqual(LeftObject.PropertyN, RightObject.PropertyN)

What I&#39;m going for would be in the same spirit as the CollectionEquivalentConstraint wherein NUnit verifies that the contents of two collections are identical.

Compare equality between two objects in NUnit

We have a system that has some Bash scripts running besides Java code. Since we are trying to *test everything that could possibly break*, and those Bash scripts may break, we want to test them.

The problem is it is hard to test Bash scripts.

Is there a way or a best practice to test Bash scripts? Or should we quit using Bash scripts and look for alternative solutions that are testable?



Unit testing Bash scripts

TL;DR - I&#39;m looking for xUnit&#39;s equivalent of MSTest&#39;s `AssemblyInitialize` (aka the ONE feature it has that I like).

Specifically I&#39;m looking for it because I have some Selenium smoke tests which I would like to be able to run with no other dependencies.  I have a Fixture that will launch IisExpress for me and kill it on disposal. But doing this before every test hugely bloats runtime.

I would like to trigger this code once at the start of testing, and dispose of it (shutting down the process) at the end.  How could I go about doing that? 

Even if I can get programmatic access to something like &quot;how many tests are currently being run&quot; I can figure something out.

Run code once before and after ALL tests in xUnit.net

I am using Ruby on Rails with Cucumber and Capybara.

How would I go about testing a simple confirm command (&quot;Are you sure?&quot;)?

Also, where could I find further documentation on this issue?

How to test a confirm dialog with Cucumber?

I have two projects, project A and Project B. Both are written in groovy and use gradle as their build system. 

Project A requires project B. 
This holds for both the compile and test code. 

How can I configure that the test classes of project A have access to the test classes of project B?

Gradle Test Dependency

We are building a complex Android application consisting of many screens and workflows spread across many Activities. Our workflows are similar to what you might see on a Bank&#39;s ATM machine, for example, there is an `Activity` to login in that transitions to a main menu `Activity` which can transition to other activities based on the user&#39;s choices.

Since we have so many workflows we need to create automated tests that span multiple activities so we can test a workflow from end to end. For example, using the ATM example, we would want to enter a valid PIN, verify that sends us to the main menu, choose withdraw cash, verify that we are on the withdraw cash screen, etc., etc., and eventually find ourselves back on the main menu or &quot;logged&quot; out.

We&#39;ve toyed with the test APIs that come with Android (e.g. `ActivityInstrumentationTestCase2`) and also with [Positron][1], but neither seem capable of testing beyond the bounds of a single `Activity`, and while we can find some utility in these tools for some unit testing, they won&#39;t meet our needs for testing scenarios that cut across multiple Activities.

We are open to an xUnit framework, scripting, GUI recorders/playbacks, etc. and would appreciate any advice.


  [1]: http://code.google.com/p/autoandroid/

How do you test an Android application across multiple Activities?

Getting the following error when running rspec tests

&gt;&gt; unable to obtain stable firefox connection in 60 seconds (127.0.0.1:7055) in rails

Using latest ruby (1.9.2) and firefox (6.0)

Using rspec-rails, capybara and several other gems, but they don&#39;t seem to be a problem. These tests run fine in another environment (linux).

unable to obtain stable firefox connection in 60 seconds (127.0.0.1:7055)

What options are there for building automated tests for GUIs written in Java Swing?

I&#39;d like to test some GUIs which have been written using the [NetBeans Swing GUI Builder][1], so something that works without requiring special tampering of the code under test would be ideal.


  [1]: http://www.netbeans.org/features/java/swing.html

Automated tests for Java Swing GUIs

I&#39;m looking at Selenium Server at the moment, and I don&#39;t seem to notice a driver that supports headless browser testing.

Unless I&#39;m mistaken, it doesn&#39;t support it.  If you&#39;re on X, you can create a virtual framebuffer to hide the browser window, but that&#39;s not really a headless browser.

Can anyone enlighten me?  Does Selenium support headless browser testing?

Does Selenium support headless browser testing?

I know this one is going to be a long-shot, but I thought I&#39;d try.  Does anyone know of any automated test *anything* for the iPhone simulator?  I&#39;d love it if there was something like Selenium but for the iPhone simulator.  I don&#39;t need anything fancy like assertions, just something that can fake out taps on a screen so I can stop abusing my trackpad. :)

Is there a way to send taps or keyevents (like on android over adb) to iOS devices?

Automated testing for iPhone

We have tried to introduce unit testing to our current project but it doesn&#39;t seem to be working. The extra code seems to have become a maintenance headache as when our internal Framework changes we have to go around and fix any unit tests that hang off it.

We have an abstract base class for unit testing our controllers that acts as a template calling into the child classes&#39; abstract method implementations i.e. Framework calls Initialize so our controller classes all have their own Initialize method.

I used to be an advocate of unit testing but it doesn&#39;t seem to be working on our current project.

Can anyone help identify the problem and how we can make unit tests work for us rather than against us?

Unit test adoption

So I have used the default docker for testcafe which on docker hub is testcafe/testcafe and I have to run a few testcafe scripts.  

However, I need the screenshot that fires on error, to be uploaded to somewhere where I can look at it later after the docker image is done running.  

I am using the Imgur program which uses bash so I re-did a few things to make it sh compatible and everything works except I need curl.  I tried running 

    apk add curl

but I&#39;m getting the error 

    ERROR: Unable to lock database: Permission denied ERROR: Failed to open apk database: 

Now I no this means that I do not have permission to do this but can I get around this is there some way to become root (this is in bitbucket pipeline).  


I do NOT really want to create my own docker.

Also note all questions I have found relating to this are about installing while creating the docker, however, my question is how to do this after the docker is created.  thx (a fine answer would be another way to save the screen shot, but preferably not with ssh).

Alpine Docker ERROR: Unable to lock database: Permission denied ERROR: Failed to open apk database: Permission denied

I have a test case in which I have a link which opens in a new tab. Since Cypress doesn&#39;t support multiple tabs, I want to get the `href` attribute of that link and then open it in the same tab. I&#39;m trying to do it this way, but for some reason it doesn&#39;t work.

    it(&#39;Advertise link should refer to Contact page&#39;, () =&gt; {
		var link = document.querySelector(&quot;div.footer-nav &gt; ul &gt; li:nth-child(2) &gt; a&quot;).href;
		cy.visit(link);
		cy.title().should(&#39;include&#39;, &#39;Text&#39;);
    });

Cypress get href attribute

I wanted to run the following test:

    package com.xxx.yyy;
    
    import android.content.Context;
    import androidx.test.InstrumentationRegistry;
    import androidx.test.runner.AndroidJUnit4;
    
    import org.junit.Test;
    import org.junit.runner.RunWith;
    
    import static org.junit.Assert.*;
    
    /**
     * Instrumented test, which will execute on an Android device.
     *
     * @see &lt;a href=&quot;http://d.android.com/tools/testing&quot;&gt;Testing documentation&lt;/a&gt;
     */
    @RunWith(AndroidJUnit4.class)
    public class ExampleInstrumentedTest {
        @Test
        public void useAppContext() {
            // Context of the app under test.
            Context appContext = InstrumentationRegistry.getTargetContext();
    
            assertEquals(&quot;com.xxx.yyy&quot;, appContext.getPackageName());
        }
    }

But I get the error in the console:

    $ adb shell am instrument -w -r   -e debug false -e class &#39;com.xxx.yyy.ExampleInstrumentedTest&#39; com.xxx.yyy.test/android.support.test.runner.AndroidJUnitRunner
    Client not ready yet..
    Started running tests
    Test running failed: Instrumentation run failed due to &#39;Process crashed.&#39;
    Empty test suite.

I can not figgure out why its not working.

Here is my gradle file:

    apply plugin: &#39;com.android.application&#39;
    apply plugin: &#39;kotlin-android&#39;
    
    apply plugin: &#39;org.greenrobot.greendao&#39; // das kann dann sp&#228;ter weg
    //apply plugin: &#39;kotlin-kapt&#39; // if using Kotlin
    //apply plugin: &#39;io.objectbox&#39;
    
    
    android {
        compileSdkVersion 28
        defaultConfig {
            applicationId &quot;com.xxx.yyy&quot;
            minSdkVersion 21
            targetSdkVersion 28    
            versionCode 130
            versionName &quot;1.3.0&quot;
            testInstrumentationRunner &quot;android.support.test.runner.AndroidJUnitRunner&quot;
            vectorDrawables.useSupportLibrary = true
        }
        buildTypes {
            release {
                minifyEnabled false
                proguardFiles getDefaultProguardFile(&#39;proguard-android.txt&#39;), &#39;proguard-rules.pro&#39;
            }
        }
    }
    
    greendao {
        schemaVersion 4
    }
    
    dependencies {
        implementation fileTree(dir: &#39;libs&#39;, include: [&#39;*.jar&#39;])
        implementation &#39;androidx.appcompat:appcompat:1.0.0&#39;
        implementation &#39;com.google.android.material:material:1.0.0&#39;
        implementation &#39;androidx.vectordrawable:vectordrawable:1.0.0&#39;
        implementation &#39;androidx.legacy:legacy-support-v4:1.0.0&#39;
        implementation &#39;androidx.constraintlayout:constraintlayout:2.0.0-alpha2&#39;
        implementation &#39;org.greenrobot:greendao:3.2.2&#39;
        implementation &#39;com.google.firebase:firebase-core:16.0.3&#39;
        implementation &#39;com.google.firebase:firebase-ads:15.0.1&#39;
        testImplementation &#39;junit:junit:4.12&#39;
        implementation &#39;com.github.PhilJay:MPAndroidChart:v3.0.2&#39;
        implementation &quot;org.jetbrains.kotlin:kotlin-stdlib-jdk7:$kotlin_version&quot;
        implementation &#39;com.android.support.constraint:constraint-layout:1.1.3&#39;
        androidTestImplementation &#39;com.android.support.test.espresso:espresso-core:3.0.2&#39;
        androidTestImplementation &#39;com.android.support.test:runner:1.0.2&#39;
        androidTestImplementation &#39;com.android.support.test:rules:1.0.2&#39;
    }
    
    apply plugin: &#39;com.google.gms.google-services&#39;

Any suggestions?

Instrumentation run failed due to &#39;Process crashed.&#39;

We have a distributed test environment with the robotremoteserver starting a bunch of other applications and working with them as part of the test. The test that I am trying to run requires me to run over a million test cases in a single suite. The issue here is, when the `pybo`t starts running, it blocks up 8 GB of RAM and results in slow performance. After a while it freezes up.

To overcome this issue I was planning to create separate suites with less than 100 cases in each. But in this case I am not able to use the keywords from the other remoteservers initiated from other suites. The only way I can use it is by disconnecting from the remoteserver and reconnecting it in each suite - which would defeat the purpose of the test.

I am not sure if anybody has come across this scenario. I would appreciate if anybody can think of a solution to this issue.

### Additional information

Another thing that helps solve this: Is it is possible to call a keyword from a library (with state) that is initiated by another suite?

Can I use **get library instance** when using RIDE? I am importing the library in one suite, then try to get the library instance in other suite. Is this possible?

I keep getting the following error:

&gt; AttributeError: Remote instance has no attribute &#39;replace&#39;

In Suite 1 this is what I am doing:

    Import Library    Remote    ${verifix_xmlrpc_url}    WITH NAME    Verifix
    ${lib}=    BuiltIn.Get Library Instance    Verifix
    Set Global Variable    ${lib}

In Suite 2:

    ${lib}.remove messages    ${VenueNSDQ}


Running a test suite with over a million test cases

I am familiar with nunit for unit testing of the business layer however I am looking now to automate the test of the win forms gui layer.  

I have seen [watin][1] and the watin recorder for automating tests on web application by accessing the controls and automating them. However I am struggling to find a watin equivalent for windows forms (written in c# or vb.net) preferably that is open source.    

Does one exist or are all products based on recording mouse and keyboard presses?


**Update:** I have looked at this [blog post on white][2] and it seems the sort of thing I am looking for. The blog post raises some issues but as white is only in version 0.6 these may be resolved. Be interested if others have used white or any others for comparison. 


  [1]: http://watin.sourceforge.net/
  [2]: http://blog.benhall.me.uk/2008/02/project-white-automated-ui-testing.html

Is there any way to automate windows forms testing?

Given software where ...

- The system consists of a few subsystems
- Each subsystem consists of a few components
- Each component is implemented using many classes

... I like to write automated tests of each subsystem or component.

I don&#39;t write a test for each internal class of a component (except inasmuch as each class contributes to the component&#39;s public functionality and is therefore testable/tested from outside via the component&#39;s public API).

When I refactor the implementation of a component (which I often do, as part of adding new functionality), I therefore don&#39;t need to alter any existing automated tests: because the tests only depend on the component&#39;s public API, and the public APIs are typically being expanded rather than altered.

I think this policy contrasts with a document like [Refactoring Test Code][1], which says things like ...

- &quot;... unit testing ...&quot;
- &quot;... a test class for every class in the system ...&quot;
- &quot;... test code / production code ratio ... is ideally considered to approach a ratio of 1:1 ...&quot;

... all of which I suppose I disagree with (or at least don&#39;t practice).

**My question is, if you disagree with my policy, would you explain why? In what scenarios is this degree of testing insufficient?**

In summary:

- Public interfaces are tested (and retested), and rarely change (they&#39;re added to but rarely altered)
- Internal APIs are hidden behind the public APIs, and can be changed without rewriting the test cases which test the public APIs

---

Footnote: some of my &#39;test cases&#39; are actually implemented as data. For example, test cases for the UI consist of data files which contain various user inputs and the corresponding expected system outputs. Testing the system means having test code which reads each data file, replays the input into the system, and asserts that it gets the corresponding expected output.

Although I rarely need to change test code (because public APIs are usually added to rather than changed), I do find that I sometimes (e.g. twice a week) need to change some existing data files. This can happens when I change the system output for the better (i.e. new functionality improves existing output), which might cause an existing test to &#39;fail&#39; (because the test code only tries to assert that output hasn&#39;t changed). To handle these cases I do the following:

- Rerun the automated test suite which a special run-time flag, which tells it to not assert the output, but instead to capture the new output into a new directory
- Use a visual diff tool to see which output data files (i.e. what test cases) have changed, and to verify that these changes are good and as expected given the new functionality
- Update the existing tests by copying new output files from the new directory into the directory from which test cases are run (over-writing the old tests)

---

Footnote: by &quot;component&quot;, I mean something like &quot;one DLL&quot; or &quot;one assembly&quot; ... something that&#39;s big enough to be visible on an architecture or a deployment diagram of the system, often implemented using dozens or 100 classes, and with a public API that consists of only about 1 or a handful of interfaces ... something that may be assigned to one team of developers (where a different component is assigned to a different team), and which will therefore according to [Conway&#39;s Law][2] having a relatively stable public API.

---

Footnote: The article _[Object-Oriented Testing: Myth and Reality][3]_ says,

&gt; **Myth: Black box testing is sufficient.**
&gt; If you do a careful job of test case
&gt; design using the class interface or
&gt; specification, you can be assured that
&gt; the class has been fully exercised.
&gt; White-box testing (looking at a
&gt; method&#39;s implementation to design
&gt; tests) violates the very concept of
&gt; encapsulation. 
&gt; 
&gt; **Reality: OO structure matters, part
&gt; II.** Many studies have shown that
&gt; black-box test suites thought to be
&gt; excruciatingly thorough by developers
&gt; only exercise from one-third to a half
&gt; of the statements (let alone paths or
&gt; states) in the implementation under
&gt; test. There are three reasons for
&gt; this. First, the inputs or states
&gt; selected typically exercise normal
&gt; paths, but don&#39;t force all possible
&gt; paths/states. Second, black-box
&gt; testing alone cannot reveal surprises.
&gt; Suppose we&#39;ve tested all of the
&gt; specified behaviors of the system
&gt; under test. To be confident there are
&gt; no unspecified behaviors we need to
&gt; know if any parts of the system have
&gt; not been exercised by the black-box
&gt; test suite. The only way this
&gt; information can be obtained is by code
&gt; instrumentation. Third, it is often
&gt; difficult to exercise exception and
&gt; error-handling without examination of
&gt; the source code.

I should add that I&#39;m doing whitebox functional testing: I see the code (in the implementation) and I write functional tests (which drive the public API) to exercise the various code branches (details of the feature&#39;s implementation).


  [1]: http://www.agilealliance.org/system/article/file/995/file.pdf
  [2]: http://en.wikipedia.org/wiki/Conway&#39;s_Law
  [3]: http://www.rbsc.com/pages/myths.html

Should one test internal implementation, or only test public behaviour?

I decided to try out [MiniTest][1] and noticed pretty quickly that it supported something called &quot;specs&quot;. I had seen these [referenced before][2] but thought it was just an alternate test syntax associated with factories, but if that were the case then why would MiniTest need to support them both?

We only covered tests when I was taught Ruby on Rails, so I don&#39;t really know anything about specs. When I Google specs I find a lot of stuff about how to write good ones but nothing explaining what they *are*. What&#39;s the difference between tests and specs?


  [1]: http://bfts.rubyforge.org/minitest/
  [2]: http://railscasts.com/episodes/158-factories-not-fixtures

What&#39;s the difference between tests and specs?

I&#39;m new on protractor, and I&#39;m trying to implement an e2e test.
I don&#39;t know if this is the right way to do this, but...
The page that I want to test is not a full angular page based, so... I&#39;m having some trouble.

On my first spec I have: 

    describe(&#39;should open contact page&#39;, function() {
    var ptor = protractor.getInstance();

    beforeEach(function(){

       var Login = require(&#39;./util/Login&#39;);
       new Login(ptor);
    });

I have created this Login class, but after login I want to open the contact page, but protractor immediately try to find element before the page is fully loaded.

I&#39;ve tried to use:

    browser.driver.wait(function() {

        expect(browser.findElement(by.xpath(&quot;//a[@href=&#39;#/contacts&#39;]&quot;)).isDisplayed());
        ptor.findElement(by.xpath(&quot;//a[@href=&#39;#/contacts&#39;]&quot;)).click();

    });

But it doesn&#39;t work... it always try to find the element before the page loads.
I tried this one too:

    browser.driver.wait(function() {
        expect(ptor.isElementPresent(by.xpath(&quot;//a[@href=&#39;#/contacts&#39;]&quot;)));          
        ptor.findElement(by.xpath(&quot;//a[@href=&#39;#/contacts&#39;]&quot;)).click();
    });

I&#39;m able to do that using `browser.sleep();` but I don&#39;t think that is a good option. Any idea? On my login class I have:

    ptor.ignoreSynchronization = true;

How can I wait for this `@href=&#39;#/contacts` before protractor tries to click on it?


How can I wait for a condition?

Is there such a thing as unit test generation? If so...

...does it work well? 

...What are the auto generation solutions that are available for .NET?

...are there examples of using a technology like this?

...is this only good for certain types of applications, or could it be used to replace all manually written unit testing?

All Automated Tests Solutions on Gang of Coders

Total of 34 Automated Tests Solutions