Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Using fork in Ruby on Rails for creating parallel process

I have a Rails 3 app in production with Passenger on Apache. I have this code:

class Billing < ActiveRecord::Base
  after_save :sendEmails

  private
    def sendEmails
      fork do 
        UserMailer.clientBilling(self.user, self).deliver
      end
    end
end

In localhost, when the app creates a billing, after it is saved, the app sends an email to the user, everything works fine. But in the server, after the app creates a billing, it throws me errors related to the gem MySQL2, errors like "MySQL server has gone away" or "Connection lost", and the app doesn't send the emails. If I remove the fork it works fine, but I want to use fork, I want to create a separated process because it takes to long when sending emails. What could be the problem?

like image 360
pablomarti Avatar asked Jan 18 '12 16:01

pablomarti


3 Answers

The problem is that a forked process inherits some of its parent's resources, such as its file descriptors. In particular one such shared resource is the MySQL connection. When the child process finishes its email sending and exits it closes the MySQL connection, which closes the parent processes connection.

If you do continue down this path (and it is frought with similar subtleties) then you need to do something like this:

# Clear existing connections before forking to ensure they do not get inherited.
::ActiveRecord::Base.clear_all_connections! 

fork do
  # Establish a new connection for each fork.
  ::ActiveRecord::Base.establish_connection 
  
  # The rest of the code for each fork...
end

You'll have to do similar thing with services like memcached or mongodb if you use those.

like image 53
Frederick Cheung Avatar answered Oct 22 '22 23:10

Frederick Cheung


Be extremely careful when using fork with rails/passenger, it can become very messy! Instead, you should use resque or delayed_job for this task!

like image 9
J-_-L Avatar answered Oct 22 '22 23:10

J-_-L


You can reestablish the connection inside of the fork:

dbconfig = YAML::load(File.open('your_app_dir/config/database.yml'))
ActiveRecord::Base.establish_connection(dbconfig['development'])
like image 2
pavlovt Avatar answered Oct 22 '22 23:10

pavlovt