We have an Android and iOS applications and we wrote some Xamarin Test Cloud tests in Calabash. We can run them successfully both locally and on the cloud. Taken from the docs on the Xamarin website, we have a few parameters available when we submit to the cloud, but none of them provides a possibility to run only specific tests (features). Our tests are put in source control, so at the moment, the only resolution we could find is to temporary delete the ones we do not want to submit and run the test-cloud command.
My question:
Is there a way to only submit a specific *.feature file? Or run only tests based on a tag (e.g. #somefeature)
Yes, but not with a feature file. The best way to do this is by Categorizing your tests. Then you can use the --category parameter in your Xamarin Test Cloud command line submission.
Related
My Web Application based on Salesforce has few steps that can be performed through mobile application only. With current automation tool I can execute test cases either on Web page or on Mobile device/emulator. Both can not be switched in between withing single test case. What is another tool available can be used in such case?
I need to test my wordpress install which I have set up already and deployed. I have to debug, so waiting 10-15 mins for it to deploy to test one thing isn't going to work.
All they mention in their docs: https://cloud.google.com/appengine/docs/flexible/php/testing-and-deploying-your-app#running_locally
Running locally
"To test your application's functionality before deploying, run your application in your local environment with the development tools that you usually use."
That's it. How can I actually serve my wordpress application? My tools I "usually use" are xampp...very confused.
Can someone help me run my flex env locally to test it?
You may want to take a look at this for the initial tests for your PHP application. You would have to install composer on your shell for it, if you haven't done it already.
Then, for the WordPress application, follow the steps described here to test the Cloud SQL instance that is associated to the app. There is also the possibility to test all the updates you want to apply to the WordPress side. Skip the deploying part until you confirm all your changes work for you, so that you don't have to wait all that time for a deployment.
I have developed an Angular JS Web Console. Web Console is basically creating, deleting, retrieving and deleting Users.
I want to do its performance testing using Chrome Dev Tool or Jmeter
If I use Jmeter how can I actually monitor the behavior of web console itself because from Jmeter I can only check the response time of API.
If I use chrome dev tool then how can I test it for multiple users against post and get operations.
For Example I have a Scenario that 10 Users are registering or signing in at a time. How can I test this behaviour.
OR
50 Persons are creating or deleting or retrieving a user using a form at a time.
OR
What will be the behavior of web console if 50 users are using web console at a time.
NOTE: Web Console is deployed on server. I want to test it locally and on server as well.
Need help. Thanks in advance!
Server side performance and client-side performance are different beasts so you can break down your performance testing requirements into 2 major parts:
Conduct the required load onto your web console using JMeter HTTP Request samplers. Make sure you configure JMeter properly to handle cookies, cache, headers, embedded resources (scripts, styles, images). See How To Make JMeter Behave More Like A Real Browser article for comprehensive explanation with regards to how to configure JMeter properly. If you need the requests to be fired in exactly the same moment of time also consider Synchronizing Timer
As JMeter neither actually render pages nor executes client-side JavaScript you can check client-side performance using one of below approaches (or any combination)
Using YSlow software
Using aforementioned Chrome Dev Tools
Using WebDriver Sampler (which provides Selenium and JMeter integration) so you will be able to measure page rendering time. If necessary you can add custom scripting logic using Navigation Timing API to get some extended information on page loading events in automated manner
So I started to play with Google Mobile Backend Starter.
Now I want to clean this instance and anything that this starter thingy created into the project (e.g. task queues, data store, etc...)
How do we achieve this?
Is this done through some command line somewhere along the lines described in this page?
appengine-java-sdk/bin
EDIT: I should have made it clearer, I don't intend to delete the project. I just want to "clean" it and replace with my own application. Anyway, I ended up using the appengine SDK tools mentioned above (Updating and Managing a Java App). It was a long process, and tedious. It could be improved.
What I did:
Using the appengine SDK tool, downloaded the application first. It prompted me for a password. I had to create a new "App Password" entry in my Google account, since it didn't accept my "usual" Google password (e.g. GMAIL)
To clean the Scheduled Tasks, edit cron.xml so that no entries are left. A sample empty cron.xml file is shown in the documentation page. Run the update procedure of the SDK tool for cron jobs
To clean the Queues, use the same approach (queue.xml)
Clean DataStore by going to DataStore Admin page (if applicable)
Upload your new application (either thru SDK, or thru Android/Eclipse AppEngine plugin)
There will now be 2 (or more) versions of your AppEngine. If necessary, make your newly uploaded application, the default version. This is done in the Developer Console.
Check the instances as well. Remove if necessary
I need to write some automated tests for our AngularJS apps with Protractor. Currently I am facing two problems:
before the page is fully rendered some calls to services are made that require user name and password. These are prompted with a basic auth popup. I am not able to get my hands on this popup as all attempts to get the window handles fail. (or more explicit: the callback for the promise is never executed)
for a different case I am getting the "select certificate" popup which I am also unable to get my hands on.
For both cases I have now the question if I am even able to ever capture them somehow or is it just that these are not accessible via automated tests via WebDriver? Currently I am trying to test the app with Chrome and PhantomJS but I would prefer to have them running with PhantomJS for an easier integration to our build environment.
There is a possibility to automatically select the certificate with Chrome. Just have a look at the documentation:
http://www.chromium.org/administrators/policy-list-3#AutoSelectCertificateForUrls
I had the problem and when such security pop-up occurs I couldn't handle them with WebDriver. PhantomJS of course is even worse in such case.
You have 2 or 3 options here :
deploy in a environment where security is not a concern, test with WebDriver the app, and test security manually in a prod-like env.
test with sikuli, there is zero adherence with the app under test, I did test this way, combined with Jenkins Jacoco etc it was very powerful once you build a DSL on top of the jar (don't use the GUI tool)
a third way is to combine sikuli and WebDriver, letting sikuli do the job only when required, but I didn't follow that way since mixing up approaches is somehow ugly.