Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to nest numba jitclass

Tags:

python

jit

numba

I'm trying to understand how the @jitclass decorator works with nested classes. I have written two dummy classes: fifi and toto fifi has a toto attribute. Both classes have the @jitclass decorator but compilation fails. Here's the code:

fifi.py

from numba import jitclass, float64
from toto import toto

spec = [('a',float64),('b',float64),('c',toto)]

@jitclass(spec)
class fifi(object):
  def __init__(self, combis):
    self.a = combis
    self.b = 2
    self.c = toto(combis)

  def mySqrt(self,x):
    s = x
    for i in xrange(self.a):
      s = (s + x/s) / 2.0
    return s

toto.py:

from numba import jitclass,int32

spec = [('n',int32)]

@jitclass(spec)
class toto(object):
  def __init__(self,n):
    self.n = 42 + n

  def work(self,y):
    return y + self.n

The script that launches the code:

from datetime import datetime
from fifi import fifi
from numba import jit

@jit(nopython = True)
def run(n,results):
  for i in xrange(n):
    q = fifi(200)
    results[i+1] = q.mySqrt(i + 1)

if __name__ == '__main__':
  n = int(1e6)
  results = [0.0] * (n+1)
  starttime = datetime.now()
  run(n,results)
  endtime = datetime.now()

  print("Script running time: %s"%str(endtime-starttime))
  print("Sqrt of 144 is %f"%results[145])

When I run the script, I get [...]

TypingError: Untyped global name 'toto' File "fifi.py", line 11

Note that if I remove any reference to 'toto' in 'fifi', the code works fine and I get a x16 speed up thanks to numba.

like image 724
ma3oun Avatar asked Jul 31 '16 08:07

ma3oun


1 Answers

It is possible to use a jitclass as a member of another jitclass, although the way of doing this isn't well documented. You need to use a deferred_type instance. This works in Numba 0.27 and possibly earlier. Change fifi.py to:

from numba import jitclass, float64, deferred_type
from toto import toto

toto_type = deferred_type()
toto_type.define(toto.class_type.instance_type)

spec = [('a',float64),('b',float64),('c',toto_type)]

@jitclass(spec)
class fifi(object):
  def __init__(self, combis):
    self.a = combis
    self.b = 2
    self.c = toto(combis)

  def mySqrt(self,x):
    s = x
    for i in xrange(self.a):
      s = (s + x/s) / 2.0
    return s

I then get as output:

$ python test.py
Script running time: 0:00:01.991600
Sqrt of 144 is 12.041595

This functionality can be seen in some of the more advanced jitclass examples of data structures, for example:

  • stack.py
  • linkedlist.py
  • binarytree.py
like image 91
JoshAdel Avatar answered Sep 20 '22 14:09

JoshAdel