Friday, November 8, 2013

Twisted 13.2.0 Released

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release of Twisted 13.2!

The highlights of this release are:
  • Twisted now includes a HostnameEndpoint implementation which uses IPv4 and IPv6 in parallel, speeding up the connection by using whichever connects first (the 'Happy Eyeballs'/RFC 6555 algorithm). (#4859)
  • Improved support for Cancellable Deferreds by kaizhang, our GSoC student. (#4320, #6532, #6572, #6639)
  • Improved Twisted.Mail documentation by shira, our Outreach Program for Women intern. (#6649, #6652)
  • twistd now waits for the application to start successfully before exiting after daemonization. (#823)
  • SSL server endpoint string descriptions now support the specification of chain certificates. (#6499)
  • Over 70 closed tickets since 13.1.0.

For more information, check the NEWS file.

You can find the downloads on PyPi (or alternatively the Twisted Matrix Downloads page).

Many thanks to everyone who had a part in this release - the supporters of the Twisted Software Foundation, the developers who contributed code as well as documentation, and all the people building great things with Twisted!

Monday, October 14, 2013

Announcing code.twistedmatrix.com

I'm please to announce that there is a new git mirror hosted on twistedmatrix.com infrastructure.
git clone https://code.twistedmatrix.com/git/Twisted
or
https://git.twistedmatrix.com/Twisted
For those that prefer bzr, the bzr mirror is also available as
bzr branch https://code.twistedmatrix.com/bzr/Twisted/trunk Twisted
The build bots are now using these mirrors for checking out code.

Friday, July 19, 2013

July Report

This will be my last report, until the beginning of September. I have, for many years, been a volunteer at the Edmonton Folk Music Festival. For the next month, I will be busy setting it up (and then taking it down, and so will not have time to devote to twisted.

This month, 23 tickets got some attention that they would not have received without the sponsored development. The result was 5 closed tickets and 11 other tickets unblocked for other developers to resume work on.

This month, I made a number of improvements to the buildobt:

  • Switched most of the buildslaves to use git to checkout the source.
  • All the git-using builders merge to trunk, before running tests, so the tests results reflect the code as it would be merged. In particular, all the lint steps should now accurately report only the regressions relative to current trunk of the merged result.
  • I added a bunch of new builders on VMs provided by Rackspace (thanks to Jesse Noller) and the Fedora Project (thanks to Seth Vidal). These cover all recent versions of Debian, Fedora, Ubuntu and RHEL. As part of this, I automated the deployment of buildslaves, (currently only Debian and Fedora derivatives are supported).

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

The tickets I reviewed, that have now been closed:

Other tickets I have reviewed:

Tickets I have worked on:

Tuesday, July 2, 2013

Introducing our new Google Summer of Code and Outreach Program for Women interns

This year as part of the Outreach Program for Women and Google Summer of Code we have three summer interns working on Twisted. We are pleased to welcome them to our development community:

Stacey Sern ("shira" on IRC) is from New Jersey, USA. She is returning to programming after a ten year hiatus to take care of her family. Previously, she developed real-time embedded software in C and C++ in the telecom industry. This past winter, she participated in Hacker School where she used Twisted for a BitTorrent client and submitted her first Twisted patches. Stacey will be working on supporting Twisted's mail infrastructure.

Kai Zhang ("kaizhang" on IRC) is 24 years old graduate student from China who likes playing soccer. Kai is working on Deferred cancellation, implementing the API for all the various sources of Deferreds in Twisted.

Shiyao Ma ("introom" on IRC) is a senior student of Tsinghua University, P.R.C.. Shiyao will continue on to a PhD program in Hong Kong UST this September, doing research on wireless sensor network. Shiyao's hobbies range from programming to Japanese animation. This summer Shiyao will be working on integrating Twisted with the Parsley parser-generator, and any necessary improvements to Parsley.


June End-month report

I spent the majority of my time in the last half of the month, clearing the review queue, from 45 tickets when I started to a low of 19 tickets. All told, 34 tickets got some attention that they would not have received without the sponsored development. The result was 9 closed tickets and 22 other tickets unblocked for other developers to resume work on.

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

The tickets I reviewed, that have now been closed:

Other tickets I have reviewed:

Tickets I have worked on:

Wednesday, June 19, 2013

June Mid-month report

During the first half of the month, 24 tickets got some attention that they would not have received without the sponsored development. The result was 2 closed tickets and 22 other tickets unblocked for other developers to resume work on.

Also, as mentioned before, I've released a collection of tools for helping with twisted development on github and pypi.

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

The tickets I reviewed, that have now been closed:

Other tickets I have reviewed:

Friday, June 14, 2013

Announcing twisted-dev-tools

I'd like to announce the release of twisted-dev-tools. It is a project that collects various python scripts useful for developer working on twisted itself.

Right now, it contains the following tools.

force-build:

This is an updated version of force-builds.py from twisted-trac-integration. It has a different (more flexible) syntax.

If run from a git repository, where the current commit has been pushed to svn, running it with no arguments will automatically build the corresponding branch.

mkbranch

A helper for those using git: it creates a branch in svn, with a standard commit message.

Eventually, this should be enhanced to automatically fetch that commit, and switch to the branch locally.

review-tickets
Command-line list of tickets currently in review
fetch-ticket:
Command-line tool to view a ticket
get-attachemnt

Tool for interacting with trac attachments.

list
list all attachments on a given ticket
get
gets a gien ticket (defaults to the lat)
apply
applies that last attachment to the current git repository, and commits it with an appropriate message

Most of the functionality is also exposed as a python library, so custom scripts are possible as well.

The code is available at https://github.com/twisted/twisted-dev-tools and on pypi https://pypi.python.org/pypi/twisted-dev-tools

Tuesday, June 4, 2013

May end-of-month report

The migration to the new machine has been successfully completed, and reports are, that trac is much faster now. Special thanks to Jonathan Stoppani, whose help was invaluable in preparing for the migration.

Since the migration, I've returned to doing ticket review, 11 tickets got some attention that they would not have received without the sponsored development. The result was 2 closed tickets and 9 other tickets unblocked for other developers to resume work on.

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

The tickets I reviewed, that have now been closed:

Other tickets I have reviewed:

Saturday, May 18, 2013

Migration Report

I have completed the migration scripts for deploying the services currently running on cube. They have been run against our new machine, dornkirk which is currently running with a snapshot of data.

It can currently be accessed by putting

66.35.39.66     twistedmatrix.com speed.twistedmatrix.com

in /etc/hosts. Please tests it, and verify that things appear to be working, but be aware that any changes will be lost, when the transition occurs.

At some point Monday or Tuesday, there will be some downtime for mail and the mailing lists, as mail-service is migrated to the new machine. For those that have accounts on cube, your data will be copied to the new machine at this point.

On Wednesday, at about 10 MDT (16 UTC), there will be downtime of all twisted services, as live data is transfered over. This may last up-to a couple of hours.

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

Friday, May 3, 2013

April end-month report

During the second half of the month, I have concentrated on the continuing development tools to automate the deployment of twisted infrastructure.

I've also spent some time developing some command-line tools for interacting with trac. It currently support view tickets, listing review tickets, and grabbing attachments (including applying them in git with an appropriate commit message). I plan to add support for doing reviews, as well.

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

Thursday, April 18, 2013

April mid-month Fellowship report

During the first half of the month, 43 tickets got some attention that they would not have received without the sponsored development. The result was 17 closed tickets and 24 other tickets unblocked for other developers to resume work on.

I set up an official git mirror that contains all the branches, including release branches and tags on github and documented my workflow on the wiki.

I've documened how our current infrastructure (cube), and with the help of Jonathan Stoppani, I've been working on scripts to automate the deployment of its successor (dornkirk).

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

The tickets I reviewed, that have now been closed:

Other tickets I have reviewed:

Other tickets I have worked on:

Thursday, April 4, 2013

Join Twisted for Google Summer of Code and the Outreach Program for Women


Twisted is once again participating in Google's Summer of Code this year, as well as the GNOME Outreach Program for Women. If you're a student interested in working on Twisted as part of a paid internship, please visit our Google SoC page. We use best practices like in-depth code reviews and full coverage unit tests, so this is a great way to improve your technical skills whether you're a beginner or an expert programmer.

In addition, Twisted is once again participating the GNOME Outreach Program for Women, with the generous support of Mozilla, providing a paid internship for one woman to spend the summer participating in and contributing to Twisted. Unlike Google's program, the outreach program is not restricted to students; if you qualify, we do encourage you to apply to both. This internship is appropriate for any level of open source experience.

If you have worked on an open source project before, great! If not, we'll help you learn the development and communication tools we use as part of the internship. Some Python experience is a prerequisite, and a small initial contribution to Twisted is a part of applying (if this sounds intimidating, don't worry, we'll help you pick a task to complete and you'll have lots of support as you work through submitting your first patch.) Please check out the full OPW and GSoC descriptions and apply today!

Wednesday, April 3, 2013

Twisted 13.0.0 released

On behalf of Twisted Matrix Laboratories, I am pleased to announce the release of Twisted 13.0.

Among the 70 tickets closed, we can see:
  • A new Introduction to Deferreds  document.
  • A fix in twisted.web.template where attributes were not quoted properly, risking HTML injection. 
  • Support for unicode domain names in twisted.names SRVConnector and Name classes, after a 12.3 regression
  • A workaround for platform limitations when trying to schedule events far in the future.
For more information, see the NEWS file here: NEWS.txt

Download it now from Twisted-13.0.0.tar.bz2 or Twisted-13.0.0.win32-py2.7.msi

Thanks to the supporters of Twisted via the Software Freedom Conservancy and to the many contributors for this release.

Thursday, March 28, 2013

Report the Third

During the past three weeks, 23 tickets got some attention that they would not have received without the sponsored development. The result was 9 closed tickets and 8 other tickets unblocked for other developers to resume work on.

I also spent some time working on getting newly donated slaves setup, as well as documenting the setup of the main twistedmatrix.com server, in preparation for automating the redeployment of services to new hardware.

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

The tickets I reviewed, that have now been closed:

Other tickets I have reviewed:

Tickets I have closed:

Other tickets I have worked on:

Thursday, March 7, 2013

Second Fellowship Report

I've completed my second two weeks of development. I again spent a large amount of my time reviewing tickets. In addition, I did some development work, as well as buildbot improvements.

All told, 42 tickets got some attention that they would not have received without the sponsored development. The result was 23 closed tickets and 14 other tickets unblocked for other developers to resume work on.

Buildbot improvements

  • Added a pyflakes builder.
  • Improved lint-like builders to only show new warnings/errors introduced in the branch, rather than relative to the tip of trunk
  • Added a form to the build results page to allow switching branches and forcing builds.
  • Added an easy way to look at the history of the unsupported builders.
  • Removed links to some useless views.

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

The tickets I reviewed, that have now been closed:

Other tickets I have reviewed:

Tickets I have closed:

Other tickets I have worked on:

Friday, March 1, 2013

Welcome our new Twisted Fellow: Tom Prince

Twisted is an open, community-based project that aims for the highest quality and technical standards. As a community-based open source project, Twisted is for the most part run by volunteers, with code contributed by users and developers. As part of our ongoing goal to produce reliable, maintainable software we have strict requirements for coding standards, unit testing and code reviews. Unfortunately, sometimes these goals work at cross purposes. For example, code reviews have become a bottleneck for our development process; they're hard thankless work. There's a reason they'll get you the most points in our high scores.

The Twisted Maintainer Fellowship is our attempt to bridge these two goals: to remove bottlenecks and get necessary work done, thus enabling more contributions from the community. By paying for the Fellow's efforts we can ensure an ongoing focus on the maintenance needs of Twisted, most importantly code reviews.

I am happy to announce that we have signed a contract with Tom Prince to be our new Fellow. Tom Prince is a core developer of Buildbot, who became a Twisted contributor last year via his involvement with the Buildbot project. As a result, he has been maintaining Twisted's buildbot deployment on a volunteer basis for the last eight months.  He also maintains the buildbots of other open source projects.

As you can see from the progress report below, Tom is already hard at work! I encourage you to donate to Twisted via the Software Freedom Conservancy (a 501(c)3 non-profit). By paying for Tom's time you can help support our efforts to maintain and improve Twisted.


Tom Prince's First Progress Report

I'm pleased to announce that I have been accepted as a Twisted fellow and full-time maintainer for 2013. I've completed my first two weeks of development. I spent the majority of my time clearing the review queue, from 32 tickets when I started to a low of 4 tickets.

All told, 42 tickets got some attention that they would not have received without the sponsored development. The result was 10 closed tickets and 29 other tickets unblocked for other developers to resume work on.

This work is made possible by the sponsorship of individuals and organizations which have donated to the Twisted project, part of the Software Freedom Conservancy, a not-for-profit organization that helps promote, improve, and develop open source software. Thanks!

The tickets I reviewed, that have now been closed:
Other tickets I have reviewed:
Other tickets I have worked on:



Saturday, January 12, 2013

Twisted, Python 3, and You

As we described in our last announcement, Twisted 12.3.0 contains partial support for Python 3.3.  But what exactly does "partial support" mean?  Unfortunately, It doesn't mean that Twisted is ready for you to use on Python 3, unless all you need is the core reactor functionality.

What it really means is that it's time for you, Twisted users who care about Python 3, to contribute patches that port specific modules to Python 3.  Our development infrastructure is now set up to efficiently deal with such patches, and to keep modules working once they're ported.

So, if you're interested in using Twisted for a project that runs on Python 3, it should be pretty quick to port the functionality you need and submit a patch.