QA Execution Meeting Notes – 1/13/2010

Tony Chung

Discussion Items

  • handling pref'd off litmus tests for automation (henrik)

    • discussion we should only automate enabled tests for now
    • what we care most is synchronize the mozmill spreadsheet with the list of enabled tests in litmus.
    • Create an email alias on test case changes only? (edits/enable/disabled). and have henrik can monitor changes once a month? (whimboo to follow up with coop)
  • bugday discussion (tracy)

    • Alternate every other friday with testdays? or move to another day?
    • discussion not a large event like triaging every time, but place with good documentation, a list of tasks, and a lot of hands off work
    • Be more active in the channel, doling out bugs, and getting people to work on them for the day
    • Shoot for thursdays this quarter. Pending when Tracy is ready.
  • profile management tool requirements (henrik)

    • Come up with some requirements from QAE
    • bug 539524 : New Test/Triage Profile Manager Application
    • See discussion in m.d.planning
      • Some early use cases:
      • the ability to manage a large set of profiles
      • the ability to choose a profile and branch of Firefox to launch
      • the ability for end users to reset their profile or create a new one
      • To that I'll add a bunch more requirements that I think would be even MORE useful for you:
      • the ability to clone or duplicate a profile
      • the ability to create a one-time-use profile
      • the ability to generate a profile with certain default preferences or in a snapshot state
      • the ability to back up an entire profile
      • the ability to package a profile for migration to a new system
      • the ability to unpack a profile that's being migrated from an existing system
    • Discussion Henrik had a chat with bsmedberg, and a blogpost will be coming soon.
    • for the basic requirements: Creating a profile, Selecting a profile, removing a profile, editing a profile name. The rest can be pushed toward a v2.
  • Lab update?

    • mac mini and the VMs (abillings, henrik)
      • Computer just arrived, installing 10.6/10.5, then will install vmware, remote desktop, and install into the lab. (ETA by tomorrow)
    • Remote access to lab machines (marcia, raymond)
      • No ETA or update
  • Welcome Aravindm to QAE

    • Contracting through Smartware on release testing, unclear litmus results, bug work
    • aravindm on irc, prasadkdm on irc (supervisor)
  • Mozilla QA Swag (marcia)

    • Supplies are low, will reorder bags/shirts
      • Lets restock and order now. get rid of the “bugger” one
    • Should we have a design change?
      • maybe start a contest on the next design idea

Project Updates

  • Firefox 3.0.18, 3.5.8 (abillings)

    • Schedule:
      • QA starts: January 20
      • Builds start: February 1
      • QA with builds start: February 1
      • Beta period starts: February 4 – 5
      • Final release: February 16
    • Juan and Henrik looking at security bugs while Al is in Hawaii from 1/20 to 1/31.
      • Unthrottle major update for 3.0 migration tomorrow
  • Firefox 3.6 (juanb)

    • Finish FFTs and extensions/plugins testing.
    • Shipping in Jan 19, 20?
      • biggest area of concern are in the FFT assignment list. Please sign up for a platform.
  • Tegra (marcia)

    • project HALTED. devices aren't ready for Fx3.6, so development stops for now.
  • Fennec (aakashd)

    • Testing nightlies; there's a problem with versioning which makes the nightly repos broken right now; download the debs
    • Shipping Fennec 1.0 on the 26th…probably (pending RC3 feedback)
    • Code freeze on RC3 tomorrow, builds sometime next week
    • Broken website reporter, plans to implement into as extension by Jorge V, and potentially design it for mobile firefox.
    • Fennec bug components is looking to be implemented post 1.0
  • Labs (Weave/Test Pilot) (tracy)

    • Weave – RC2 in testing with 3.6rc1 (need help with Fennec checks)
    • Test Pilot – scoping out a lightweight test plan
  • Mozmill Testcase automation (henrik)

    • Detailed Test Status:
      • Smoketests: Blocked (9), Assigned (1), Fixed (23 – 68%), Not Doable (3 – 8%)
      • BFT: Blocked (17), Assigned (13), Fixed (76 – 31%)[+0], Not Doable (26) => Target Q1 (~110)
      • FFT: Blocked (12), Assigned (12), Fixed (83)
    • Improvements for test automation:
      • Discovering subgroups to automate (max. 10 tests per person)
      • Identifying blocking issues which needs to be fixed by testdev
      • Collecting requirements (subgroup owner) for API's and creating those (Henrik)
      • Implementing tests in an easy way by using the API's
    • Fixes for broken tests and test enhancements went in last week
    • TabbedBrowsingAPI created – next is LocationBarAPI
    • New documentation will be started by end of this week
  • QMO & Community (marcia, aakashd)

    • Testdays
      • Mobile Firefox 1.0 RC Testday happened last Friday, 1/8. Recap can be found here
    • Meetups
      • Firefox Mobile Meetup tonight at 6:30 PM. If you have a mobile phone, please get it to marcia so someone in the community can try it out this evening.
      • Weave Meetup planned for 2nd week in Feb. tchung to draft announcement so it can get posted on meetup.com and QMO.
  • Accessibility (marcoz)

    • Firefox 3.6 done. Dog-fooded RC1 for days without any issues.
    • Work has resumed quite full-speed on trunk with improvements to the API and event handling (speed improvements with dynamic pages). Lots of manual testing for me there! 🙂