NeverBlock Blog

NeverBlock Ready for the Big Time

Mon, 01 Jun 2009 12:13:32 GMT

eSpace has had NeverBlock enabled on its own Ruby applications for quite some time now and with a great degree of success. But NeverBlock has so much more to offer to the development community; eSpace is now providing a service in which you can get NeverBlock enabled in your very own application.

eSpace's RubyConf Talk

Wed, 03 Dec 2008 09:43:44 GMT

A video of eSpace's Yasser Wahba's talk at the 2008 RubyConf is now online and you can watch it right here! Yasser's talk, which was entitled “NeverBlock: Trivial Non-Blocking IO for Ruby”, covered how people can use NeverBlock to transparently gain IO parallelism in Ruby (and Rails) web applications.

Enjoy the presentation!

NeverBlock Unleashed

Thu, 27 Nov 2008 16:53:51 GMT

After months of development and meticulous hard work, NeverBlock is finally in production, having been deployed on eSpace's very own MeOwns.com. NeverBlock allows memory usage to decrease by 75%, while capacity for concurrent requests has been effectively doubled. This allows sites that utilize NeverBlock to increase their capacity for handling concurrent requests, while at the same time reducing memory requirements significantly. We also spent some time fixing the subtle MySQL connection issues that happened with long running requests. The result of the work is a more polished and solid NeverBlock that has been running smoothly on MeOwns.com for a while now, which increases our level of confidence in the library and makes us believe that NeverBlock is now ready for prime time.

NeverBlock: Instant Scaling For Your Rails Apps

Thu, 04 Sep 2008 10:49:00 GMT

Today marks a milestone in the short history of NeverBlock. We have pushed a new release with lots of new features, mainly:

NeverBlock now supports Ruby1.8.
NeverBlock support for Thin and Mongrel servers.
NeverBlock now supports Ruby on Rails.

Let's iterate over the above points and explain them in more detail.

NeverBlock Now Supports Ruby 1.8

Utilizing Aman Gupta's Poor Man's Fibers we were able to add Ruby 1.8 support to NeverBlock. Thankfully this does not mean that applications written for NeverBlock now require full thread safety. Aman's implementation makes sure one thread is scheduled at a time. The fibers don't fight for CPU time so the solution is free of race conditions. The performance penalty is not very big and we were able to extract some very good figures during lab testing.

NeverBlock MySQL Support

Thu, 28 Aug 2008 10:45:27 GMT

We are pleased to announce the availability of a MySQL database driver for NeverBlock. This is the second database driver for NeverBlock after the PostgreSQL driver. We hope that with time, this family will grow.

Of course the driver does all that you expect from a decent NeverBlock driver. It can do IO operations concurrently and in a transparent manner, thanks to NeverBlock. An interesting side effect emerged during the development of this driver. We were required to update the current MySQL driver to be able to do async operations. Once those were done, we discovered that the basic foundation for threaded support was there. Hence we went forward and implemented it (with help from Ruby gurus like Aman Gupta and Roger Pack).

NeverBlock and ActiveRecord, Concurrent DB Access Without Threads

Sun, 24 Aug 2008 15:32:47 GMT

A new neverblock_postgresql activerecord adapter has been released. This new adapter makes it possible for applications using activerecord to utilize multiple connections to do queries in parallel in single threaded applications. This results in much higher performance and better CPU utilization.

What do I need to do?

If you were using the vanilla postgresql adapter you would’ve initialized the connection as follows:

Now, to use NeverBlock all you need to do is:

Note: you must have the pg, neverblock, neverblock-pg and the activerecord-neverblock-postgresql-adapter gems installed

This way the AR library will pick the gem and use neverblock_postgresql instead of the postgresql adapter

Fiber Pooling With NeverBlock

Thu, 21 Aug 2008 12:18:10 GMT

As mentioned in my earlier introduction about fibers I will be talking today about the fiber pooling features that are implemented as part of the NeverBlock library.

The fiber pool is implemented as the NeverBlock::Pool::FiberPool class. The interface is super easy, with only one public method spawn that is. Here’s an example

The spawn method take only one argument, which is a code block to be run as a fiber. The spawned fiber will resume immediately (that is, if the pool managed to find us a free fiber immediately).

An Introduction To Fibers

Tue, 19 Aug 2008 00:08:35 GMT

You know Thread, but have you heard of his red haired step child? Fiber? Fibers are a new and a note worthy addition to Ruby that appeared with 1.9. They are essentially code blocks that can be paused and resumed. They have to be forced to do so, unlike threads which are well mannered and just step aside when someone is in a hurry. Fibers are not a totally new ideas, they have been known for ages as Coroutines. But how does those fibers work? Let’s start by the canonical example:

The very first time we called resume, the fiber sprang to life and the loop started, then when it hit Fiber.yield it returned to the caller with the value to the right side of the Fiber.yield (i in this case which is equal to zero in the first iteration).

When resume is called again, the fiber continues from where it stopped so the loop continues, i picks the value 1 and then yields it back. This continues till the fiber block is exhausted, at this point, calling resume on the fiber will raise an error.