Hello all,
It's been a while since my last report of sponsored Twisted development. After this hiatus, I'm happy to be able to bring you a new list of accomplishments I was able to achieve thanks to the support of the Twisted sponsors and the Software Freedom Conservancy.
The tickets I reviewed this time around (italics for tickets now resolved):
#3007 - Subsystem's connectionLost method executed twice in certain situation
#3226 - twisted.python.util.initgroups (and thus spawnProcess) potentially does tons of unnecessary IO
#3296 - Account for ISUPPORT information in irc_MODE when parsing mode strings
#3931 - t.p.amp.AmpBox.serialize will _not_ return a string if any value is unicode
#4009 - twisted.python.modules.PythonPath docstring typo
#4029 - Twisted Web's wsgi.input isn't sufficiently file-like in all cases
#4065 - Replace 'callable(foo)' with 'hasattr(foo_ "__call__")'
And the tickets I worked on (often with the help of others):
#733 - twisted's SIGCHLD handler breaks popen
#970 - twisted.names.root.Resolver eats filedescriptors
#1784 - disttrial --hosts=kunai_takkun_muon twisted
#2078 - Twisted shouldn't start processes until the reactor is running
#2884 - Tool to update / generate NEWS file
#3886 - Fixing the Socks4 proxy to be Socksv4a compliant
#3922 - twisted.protocols.amp.BinaryBoxProtocol.connectionLost chokes on reason = main.CONNECTION_DONE
#3932 - HTTPAuthSessionWrapper incorrectly returns a 500 if the wrapped resource doesn't implement the requested method
#3956 - Add arraysize option to runQuery in adbapi
#4019 - t.web.wsgi.WSGIResource - WSGI application error handling
#4029 - Twisted Web's wsgi.input isn't sufficiently file-like in all cases
#4031 - twisted.mail.smtp client doesn't really implement SASL LOGIN
#4049 - Error IMAP4Client.fetchSpecific an HTML body part
#4053 - Replace "x.has_key(y)" with "y in x"
#4063 - Ween trial's --dry-run away from the deprecated TestCase.visitor code
#4066 - `reduce` for Python 3.x
#4075 - Remove deprecated IReactorUDP.connectUDP
#4114 - Test all of the file-related twisted.web.wsgi code-paths with each of the possible file-like objects they might be used with
#4115 - lore -olint's `check_texturl_matches_href` and `check_a_py_listing` methods invoke getAttribute wrong
#4116 - Add a parameterized AMP argument type which can serialize and unserialize 0 or more of a specified type
#4131 - `twisted.web.client.Agent` does not add a Host header if `None` (the default) is passed for the `headers` argument to `request`
#4154 - Skip all release automation related tests on platforms which are not Linux
You can find more details about these tickets in the Twisted issue tracker. To look up a ticket, visit http://twistedmatrix.com/trac/ticket/ticketnumber. For example, http://twistedmatrix.com/trac/ticket/4063
Additionally, you may have noticed that we managed to finally release Twisted 9.0. This was mostly thanks to the efforts of Chris Armstrong (as usual), but I also helped out reviewing some of that process.
This should signal the beginning of more regular sponsored development. Look forward to seeing another one of these reports soon. :)
Monday, December 14, 2009
Friday, November 20, 2009
Twisted 9 is in the works, first pre-release is available
Hi all! I've done an initial pre-release of Twisted 9. I've made available a set of tarballs (The one called Twisted-9.0.0pre1.tar.bz2 is the main release) and the release notes.
Please try out this prerelease and tell us about any regressions or other release-related problems you find. If all goes well, we want to hear about that too.
Please try out this prerelease and tell us about any regressions or other release-related problems you find. If all goes well, we want to hear about that too.
Friday, November 6, 2009
New OS X build slave
As some of you may recall, Apple lent Twisted an Xserve G5 a few years back. This was invaluable in maintaining Twisted support for OS X. A few weeks ago we unfortunately lost the ability to host this machine. Fortunately, David Reid came through and very generously donated a
which is now set up and running the Twisted test suite continuously. Thanks, David!
which is now set up and running the Twisted test suite continuously. Thanks, David!
Monday, May 25, 2009
Canonical Men of Twistery
The title of this quick little post goes to the excellent name mwh gave the linked photo :-) Taken at a dinner during AllHands in a gorgeous area outside of Barcelona, this pic shows the collection of Twisted developers that Canonical has hired (so far!).
Top row, left to right: Andrew Bennetts (spiv), Thomas Herve (therve), Chris Armstrong (radix), Michael Hudson (mwh), Jamu Kakar (jkakar).
Bottom row, left to right: Nicola Larosa (tekNico), Duncan McGreggor (oubiwann), Jonathan Lange (jml).
Pretty freakin' cool :-)
Saturday, May 23, 2009
Sponsorship In 2009
It's that time of year again; the time when you all have the excellent opportunity to settle your karmic debt and sponsor the Twisted project.
Actually, that time is every day of the year. Right now is just when we have arbitrarily decided to make you aware of this opportunity, so that we're not annoying you all year-round. Sometime soon we'll be taking down the current list of sponsors for 2008 — hopefully, to make room for a new list of sponsors for 2009. But without your help, that list will be empty!
Thanks to our founding sponsors, Twisted has had a great year. If you've been reading this news feed, you know that we've been able to review, respond to, and close tons of tickets this year.
As Jean-Paul Calderone previously wrote, this is the first year we've had a year-over-year decrease in the number of open tickets; and that's despite an increase in the number of filed tickets. We believe that Twisted is setting a great example for how other open source projects can effectively use sponsorship to fund development.
Many open source projects are perpetually crunched for volunteer labor. Twisted is no different in this respect — we could always use more help from the community. However, we are lucky to have something that most projects don't: the ability to convert dollars directly into maintenance that benefits the project.
When you contribute money to the Twisted project, you are directly contributing to get bugs fixed, features implemented, and tickets reviewed. Last year we told the same story, but this year we have an excellent track record. I invite you to read the history of our sponsored development — just scroll down and have a look. I'll wait.
... Done?
If you prefer visual representations of our success instead, consider these graphs. Here's a graph of all tickets reviewed this year, by the handle of the person who reviewed them:

Here's the same breakdown of all tickets that were closed this year:

In case you don't already know: "exarkun" is the handle for Jean-Paul Calderone. By his own calculation, at least 75% of his work this year has been sponsored development.
This isn't to say that Twisted is being supported entirely by sponsorship: as you can see from the huge number of tickets that exarkun has reviewed, a substantial proportion of development has been coming from the community, but sponsorship has allowed us to be more responsive to the community and integrate contributions much faster. (Developers may not review their own tickets, so there's no overlap between the code JP has been writing and the tickets he's been reviewing.)
This year of sponsorship has been great for the project. But, we're coming to the end of our first year of funding, and we need your help to keep going.
Every little bit helps, from small, one-time individual donations to monthly subscriptions to corporate sponsorships. This year, we need even more help from individuals, as some of our corporate sponsors have been impacted by the current economic climate and may not be able to contribute at the same level this year.
To summarize, there are a few things you can do to help the Twisted project:

Thanks for your interest in Twisted.
Actually, that time is every day of the year. Right now is just when we have arbitrarily decided to make you aware of this opportunity, so that we're not annoying you all year-round. Sometime soon we'll be taking down the current list of sponsors for 2008 — hopefully, to make room for a new list of sponsors for 2009. But without your help, that list will be empty!
Thanks to our founding sponsors, Twisted has had a great year. If you've been reading this news feed, you know that we've been able to review, respond to, and close tons of tickets this year.
As Jean-Paul Calderone previously wrote, this is the first year we've had a year-over-year decrease in the number of open tickets; and that's despite an increase in the number of filed tickets. We believe that Twisted is setting a great example for how other open source projects can effectively use sponsorship to fund development.
Many open source projects are perpetually crunched for volunteer labor. Twisted is no different in this respect — we could always use more help from the community. However, we are lucky to have something that most projects don't: the ability to convert dollars directly into maintenance that benefits the project.
When you contribute money to the Twisted project, you are directly contributing to get bugs fixed, features implemented, and tickets reviewed. Last year we told the same story, but this year we have an excellent track record. I invite you to read the history of our sponsored development — just scroll down and have a look. I'll wait.
... Done?
If you prefer visual representations of our success instead, consider these graphs. Here's a graph of all tickets reviewed this year, by the handle of the person who reviewed them:
Here's the same breakdown of all tickets that were closed this year:
In case you don't already know: "exarkun" is the handle for Jean-Paul Calderone. By his own calculation, at least 75% of his work this year has been sponsored development.
This isn't to say that Twisted is being supported entirely by sponsorship: as you can see from the huge number of tickets that exarkun has reviewed, a substantial proportion of development has been coming from the community, but sponsorship has allowed us to be more responsive to the community and integrate contributions much faster. (Developers may not review their own tickets, so there's no overlap between the code JP has been writing and the tickets he's been reviewing.)
This year of sponsorship has been great for the project. But, we're coming to the end of our first year of funding, and we need your help to keep going.
Every little bit helps, from small, one-time individual donations to monthly subscriptions to corporate sponsorships. This year, we need even more help from individuals, as some of our corporate sponsors have been impacted by the current economic climate and may not be able to contribute at the same level this year.
To summarize, there are a few things you can do to help the Twisted project:
- Contribute code. Any contribution is welcome, but the best would be to attack an existing ticket in the tracker, especially one that has stalled on its way through review.
- Donate money directly. You'll find donation buttons on the front page of twistedmatrix.com.
- Donate money from your organization. Doing so gets you a voice on our sponsors-only mailing list, and can help you to set priorities for the coming year of development. You also get your logo on twistedmatrix.com, our gratitude, and last but not least, more Twisted development in the coming year!
- Help us in our discussions with larger organizations. If you're a software developer using Twisted in a big company, we need your help to convince your organization that they should be contributing. Even if not, the board of the Twisted project is small and strapped for time - we could use some help just finding the right person to talk to, and making sure that all of their questions are answered promptly. (If you'd like to help with this effort, please contact me directly.)
Thanks for your interest in Twisted.
Monday, March 2, 2009
February Sponsored Twisted Development
Another month, another round of Twisted development. February saw progress on a miscellany of bug fixes, as well as further work on the new SIP implementation. List of tickets I worked on (bold tickets are now closed):
#2036 - trial runs tests from .pyc files even if there is no .py file
#2194 - small bug in SIP Via header generation
#3634 - restat in render in static.File raise Exception if file doesn't exists
#3639 - suppress deprecation warnings emitted by twisted.test.test_sip
#3643 - MemCacheProtocol does not return an error if it is used after disconnecting
#3648 - twisted.cred.credentials.UsernameHashedPassword doesn't hash password strings when checkPassword
#3654 - unlink of unix socket in connectionLost may cause twistd daemons to ignore SIGTERM
#3584 - SIP transport and transaction layer
#3660 - IRCClient reports ":None:None" to CTCP version request
Work on #3654 unearthed a more general problem where twistd fails to exit when a service encounters an exception during shutdown. So hopefully there'll be less need to use kill -9 during development :)
RFC 3261 is the longest RFC for a network protocol the IETF has ever produced. The SIP transport/transaction branch only provides the bottom two layers of a full SIP stack, but introduces 1700 new lines of code. Special thanks to Chris Armstrong and Jean-Paul Calderone for their amazingly detailed review. I managed to get halfway through the issues they raised, and expect to finish it up next time.
Once again, thanks to the Software Freedom Conservancy, all of the Twisted Sponsors, and all the other developers who contribute to Twisted.
#2036 - trial runs tests from .pyc files even if there is no .py file
#2194 - small bug in SIP Via header generation
#3634 - restat in render in static.File raise Exception if file doesn't exists
#3639 - suppress deprecation warnings emitted by twisted.test.test_sip
#3643 - MemCacheProtocol does not return an error if it is used after disconnecting
#3648 - twisted.cred.credentials.UsernameHashedPassword doesn't hash password strings when checkPassword
#3654 - unlink of unix socket in connectionLost may cause twistd daemons to ignore SIGTERM
#3584 - SIP transport and transaction layer
#3660 - IRCClient reports ":None:None" to CTCP version request
Work on #3654 unearthed a more general problem where twistd fails to exit when a service encounters an exception during shutdown. So hopefully there'll be less need to use kill -9 during development :)
RFC 3261 is the longest RFC for a network protocol the IETF has ever produced. The SIP transport/transaction branch only provides the bottom two layers of a full SIP stack, but introduces 1700 new lines of code. Special thanks to Chris Armstrong and Jean-Paul Calderone for their amazingly detailed review. I managed to get halfway through the issues they raised, and expect to finish it up next time.
Once again, thanks to the Software Freedom Conservancy, all of the Twisted Sponsors, and all the other developers who contribute to Twisted.
Sunday, February 1, 2009
January Sprint Report
Today, we had a last-minute unofficial Twisted sprint for January, at the Divmod office in Porter Square, Cambridge, Massachusetts.
Thanks to everyone who contributed.
We are tentatively planning to hold our next sprint on Sunday, February 22. If you're in the Cambridge, Massachusetts area, please stop by!
Thanks to everyone who contributed.
- Glyph Lefkowitz (that's me) reviewed 4 tickets, shortening the review queue by half.
- Jean-Paul Calderone addressed review feedback for some of our old favorite tickets, compatibility with
os.popenand lore's handling of whitespace. - Christopher Armstrong created a tool to generate the official API documentation, as well as reviewing Jean-Paul's lore work.
- Itamar Shtull-Trauring helped with various things, including —
- David Sturgis worked to fix twisted.words's IRC compatibility with Pidgin, among other IRC clients.
We are tentatively planning to hold our next sprint on Sunday, February 22. If you're in the Cambridge, Massachusetts area, please stop by!
Subscribe to:
Posts (Atom)