Filter scenario by status


#1

Hi,

I try to use the hiptest-publisher option “filter on status” to extract only failed scenario (or scenario marked as “retest”) of a specific test run but I have some errors:

I can’t extract tests with datatable and at least 2 dataset with failed status :

NoMethodError: undefined method `css' for nil:NilClass
  c:/Ruby23/lib/ruby/gems/2.3.0/gems/hiptest-publisher-1.9.1/lib/hiptest-publisher/xml_parser.rb:357:in `css_first'
  c:/Ruby23/lib/ruby/gems/2.3.0/gems/hiptest-publisher-1.9.1/lib/hiptest-publisher/xml_parser.rb:310:in `build_project'
  c:/Ruby23/lib/ruby/gems/2.3.0/gems/hiptest-publisher-1.9.1/lib/hiptest-publisher.rb:105:in `block in get_project'
  c:/Ruby23/lib/ruby/gems/2.3.0/gems/hiptest-publisher-1.9.1/lib/hiptest-publisher/formatters/reporter.rb:27:in 
`with_status_message'
  c:/Ruby23/lib/ruby/gems/2.3.0/gems/hiptest-publisher-1.9.1/lib/hiptest-publisher.rb:103:in `get_project'
  c:/Ruby23/lib/ruby/gems/2.3.0/gems/hiptest-publisher-1.9.1/lib/hiptest-publisher.rb:63:in `run'
  c:/Ruby23/lib/ruby/gems/2.3.0/gems/hiptest-publisher-1.9.1/bin/hiptest-publisher:38:in `<top (required)>'
  c:/Ruby23/bin/hiptest-publisher:22:in `load'
  c:/Ruby23/bin/hiptest-publisher:22:in `<main>'

If I mark thoses dataset as “retest”, only one is extracted (with correct filter option),

If only one dataset is marked and extracted, the result is pushed on first dataset in each case

Normal Run:
<testsuite name="Accessibilité" tests="2" skipped="0" failures="0" errors="0">
    <testcase name="Accès direct à une page (uid:cfcc4517-527d-4f1d-924d-7ff54731fe0a) #1" status="passed"></testcase>
    <testcase name="Accès direct à une page (uid:cfcc4517-527d-4f1d-924d-7ff54731fe0a) #2" status="passed"></testcase>
  </testsuite>

Run with Filter on #2 dataset status:
<testsuite name="Accessibilité" tests="1" skipped="0" failures="0" errors="0">
     <testcase name="Accès direct à une page (uid:cfcc4517-527d-4f1d-924d-7ff54731fe0a) #1" status="passed"></testcase>
</testsuite>

Run under BeHat 3.4.1.

Best regards,
Eric.


#2

Hi,

A fix for the first issue has been deployed to Hiptest. Could you please confirm it is working now?

Regarding the second issue we need to investigate more, we’ll keep you informed.

Regards,
Aurélien


#3

Thanks, it seem to work.

I wait your feedback for the second issue.