QMO quality.mozilla.org (alpha)

Agenda Items

• Major Update testing. Enabling updates on thursday afternoon. (juanb, jay)
• Firefox 3 status roundtable. Shipping A6 on friday afternoon. status at: http://wiki.mozilla.org/Firefox3/StatusMeetings/2007-06-26#Work_in_progr... (everyone on Fx3)
• UNCONFIRMED bug verifications. Please continue to help verify them to get the bugcount down. http://quality.mozilla.org/lower-the-number-of-unconfirmed-bugs (sam, carsten)
• Test environment input: http://wiki.mozilla.org/MozillaQualityAssurance:Environments (marcia, carsten)
• Discuss next week fridays' testday subject (2.0.0.5 or Trunk testing?) (carsten)
• QA extension update: http://www.zachlipton.com/qaExtensionMockups (special intern guest: zach lipton)
• QA labspace update (tchung)
• Others topics?

Details

1. Major Update

Shipping at 3:00 PM.
Build team has run verification scripts and results passed.
QA ran spot checks and things were fine.
At 3:00 PM, Juan would like help doing spot checks on the live major updates.
Details of work to do are at here .

2. Firefox 3 Status Roundtable

See http://spreadsheets.google.com/pub?key=p-9pXWWpA7Bih6yFR9FYQWw
A6 is going out Monday morning.
Smoke tests will be run against the RC by Tracy and Tomcat.
People should be running the nightly trunk builds unless they have a reason not to do so.

• Add-ons (Tony): some backend changes have landed. Tony is working on test plans.
• Content Handling (Tomcat, Clint): A large patch just missed A6. Without this, the area is largely still in the A5 state.
• Microformats (Clint): Microformats will require a test extension to allow you to check them on a page. This is automatable via mochitest. Clint should have the test plan for this done by the end of the week.
• Download Manager (Tomcat): Some work done but nothing groundbreaking has landed yet. Tomcat will be checking bugs to update test plans.
• Platform (Martijn): Content-editable patch has just landed. Martijn has already found a crashing bug in it... Martijn is making test scripts for Javascript URL landing (??).
• GFX (Tomcat): Test cases are being created.
• Accessibility (Tim): Tim has been working with people at Sun on automated testing as well as with others. Basic accessibility test plan should be up by 6/29.
• User Support (Sam): Still nothin'. No updates for this week.
• Platform Integration (Tomcat) - No progress on Vista Parental support. No patches have come in. Marcia and Tomcat are working with Josh on Mac integration test cases.
• Crash Reporting (Adam/Sam) - Finishing out the client still. The client works but all the strings are not finished.
• Password and Identity (Juan) - Nothing new has landed. No A6 UI has come in.
• Places (Tracy) - No test plan yet. Performance tweaks are being checked in.
• Site-Specific Preferences (Martijn) - Code has landed.
• Privacy and Security (Juan/Tomcat) - Much of the UI for A6 did not come in. The backend items have made it in though.
• Search (Jay) - Not much happening. UI is targeted for Beta 1.
• Tabbed Browsing (Jay) - Not much happening.
• UI Fixes (Jay) - Not much happening until Beta 1.

Test cases needed to be added for Migration and History. Please take a look at this page.
Please talk to TimR, Tony, or Jay if you have extra time to help out on Firefox 3 components. This is a load balancing exercise.
The Firefox 3 Status spreadsheet needs to be kept up to date. Please look at your lines a couple of times a week and keep stuff up to date.

3. Unconfirmed Bug Verifications

Tomcat states that we are below the goal for this quarter for unconfirmed bugs. We triaged and closed about 260 bugs yesterday.
If you have time to triage unconfirmed bugs, please feel free to do so.
Tomcat will create a wiki page with guidelines for the community on how to triage bugs.

4. Test Environment Discussion

See meeting notes.
People met last week about this and individuals have action items to be completed.
We might put up a survey on Monday or Tuesday to get feedback from the community on this.
TimR would like to get some VMs set up for this and not wait too long for people to get back to us because we need this during the next two weeks.
It would be nice to be able to reproduce a bug with a VM and then allow the developer to look at the VM.
Al will send mail to the team about where he has put his VM images.

5. Test Day

The next Test Day is scheduled for July 6. Tomcat would like to focus on the Trunk build for this.
We agreed to do this.

7. Test Extension

The Test Extension has a page at http://wiki.mozilla.org/Litmus:Extension.
Zach would love to get more volunteers involved with it.
Zach is focusing on the Litmus tab information and notification right now.

8. Update on QA Lab Space

An order was put in for desks and shelves for it. This will allow us to free up space in the lab.
IT will be sharing the space as well.
The ETA is roughly a month.

9. Goals

TimR is looking for the establishment of levels in testing so we can have something in-between very detailed and completely ad-hoc.
How do we want to use VMs? Do we want to set up a policy around this?
Tim mentioned several more goals.
The goals will be published as well.